-- Logs begin at Mon 2021-11-01 00:26:21 UTC, end at Mon 2021-11-01 02:09:44 UTC. -- Nov 01 01:08:34.923989 dv-cinder-815614-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Nov 01 01:08:34.932794 dv-cinder-815614-2-iscsi devstack@n-api.service[101288]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Nov 01 01:08:34.934838 dv-cinder-815614-2-iscsi devstack@n-api.service[101288]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Nov 1 01:08:34 2021] *** Nov 01 01:08:34.934838 dv-cinder-815614-2-iscsi devstack@n-api.service[101288]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Nov 01 01:08:34.934838 dv-cinder-815614-2-iscsi devstack@n-api.service[101288]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Nov 01 01:08:34.934838 dv-cinder-815614-2-iscsi devstack@n-api.service[101288]: nodename: dv-cinder-815614-2-iscsi Nov 01 01:08:34.934838 dv-cinder-815614-2-iscsi devstack@n-api.service[101288]: machine: x86_64 Nov 01 01:08:34.934838 dv-cinder-815614-2-iscsi devstack@n-api.service[101288]: clock source: unix Nov 01 01:08:34.934838 dv-cinder-815614-2-iscsi devstack@n-api.service[101288]: pcre jit disabled Nov 01 01:08:34.934838 dv-cinder-815614-2-iscsi devstack@n-api.service[101288]: detected number of CPU cores: 4 Nov 01 01:08:34.934838 dv-cinder-815614-2-iscsi devstack@n-api.service[101288]: current working directory: / Nov 01 01:08:34.934838 dv-cinder-815614-2-iscsi devstack@n-api.service[101288]: detected binary path: /usr/bin/uwsgi-core Nov 01 01:08:34.935588 dv-cinder-815614-2-iscsi devstack@n-api.service[101288]: your processes number limit is 47680 Nov 01 01:08:34.935588 dv-cinder-815614-2-iscsi devstack@n-api.service[101288]: your memory page size is 4096 bytes Nov 01 01:08:34.935588 dv-cinder-815614-2-iscsi devstack@n-api.service[101288]: detected max file descriptor number: 2048 Nov 01 01:08:34.935588 dv-cinder-815614-2-iscsi devstack@n-api.service[101288]: lock engine: pthread robust mutexes Nov 01 01:08:34.935588 dv-cinder-815614-2-iscsi devstack@n-api.service[101288]: thunder lock: enabled Nov 01 01:08:34.935588 dv-cinder-815614-2-iscsi devstack@n-api.service[101288]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Nov 01 01:08:34.935588 dv-cinder-815614-2-iscsi devstack@n-api.service[101288]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Nov 01 01:08:34.980228 dv-cinder-815614-2-iscsi devstack@n-api.service[101288]: Python main interpreter initialized at 0x5625f5b4f9c0 Nov 01 01:08:34.980228 dv-cinder-815614-2-iscsi devstack@n-api.service[101288]: python threads support enabled Nov 01 01:08:34.980228 dv-cinder-815614-2-iscsi devstack@n-api.service[101288]: your server socket listen backlog is limited to 100 connections Nov 01 01:08:34.980228 dv-cinder-815614-2-iscsi devstack@n-api.service[101288]: your mercy for graceful operations on workers is 90 seconds Nov 01 01:08:34.980535 dv-cinder-815614-2-iscsi devstack@n-api.service[101288]: mapped 403077 bytes (393 KB) for 2 cores Nov 01 01:08:34.980607 dv-cinder-815614-2-iscsi devstack@n-api.service[101288]: *** Operational MODE: preforking *** Nov 01 01:08:34.980885 dv-cinder-815614-2-iscsi devstack@n-api.service[101288]: *** uWSGI is running in multiple interpreter mode *** Nov 01 01:08:34.980885 dv-cinder-815614-2-iscsi devstack@n-api.service[101288]: spawned uWSGI master process (pid: 101288) Nov 01 01:08:34.981071 dv-cinder-815614-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Nov 01 01:08:34.983698 dv-cinder-815614-2-iscsi devstack@n-api.service[101288]: spawned uWSGI worker 1 (pid: 101289, cores: 1) Nov 01 01:08:34.983698 dv-cinder-815614-2-iscsi devstack@n-api.service[101288]: spawned uWSGI worker 2 (pid: 101290, cores: 1) Nov 01 01:08:34.983698 dv-cinder-815614-2-iscsi devstack@n-api.service[101288]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Nov 01 01:08:36.641935 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 01 01:08:36.641935 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: from cryptography.utils import int_from_bytes Nov 01 01:08:36.642571 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 01 01:08:36.642571 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: from cryptography.utils import int_from_bytes Nov 01 01:08:36.643010 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 01 01:08:36.643010 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: from cryptography.utils import int_from_bytes Nov 01 01:08:36.643120 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 01 01:08:36.643120 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: from cryptography.utils import int_from_bytes Nov 01 01:08:39.252290 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 01 01:08:39.252850 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 01 01:08:39.253218 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 01 01:08:39.253314 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 01 01:08:39.253396 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 01 01:08:39.253474 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 01 01:08:39.253550 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 01 01:08:39.253639 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 01 01:08:39.253717 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 01 01:08:39.253791 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 01 01:08:39.253951 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.254140 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.254276 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.254487 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.254628 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.254814 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.254949 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.255132 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.255278 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.255461 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.255588 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.255770 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.255908 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.256089 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.256234 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.256410 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.256558 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.256734 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.256818 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.256994 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.257117 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.257305 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.257441 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-815614-2-iscsi {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.257625 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-815614-2-iscsi {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.257760 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.257943 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.258066 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.258249 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.258377 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.258581 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.258718 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.258895 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.259024 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.259196 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.259347 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.259514 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.259654 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.259833 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.260149 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.260340 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.260587 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.260711 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.260896 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.261007 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.261212 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.261340 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.261549 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.261689 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.261856 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.261985 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.262161 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.262247 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.262501 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.262599 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.262810 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.262899 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.263133 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.263274 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.263435 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.263521 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.263833 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-815614-2-iscsi {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.263925 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-815614-2-iscsi {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.264147 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.264233 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.265035 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.265179 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.265609 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.265697 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.266019 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.266107 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.266333 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.266463 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.266667 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.266752 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.266987 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.267070 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.267306 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.267391 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.267612 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.267694 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.267935 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.268026 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.268252 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.268341 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.268567 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.268661 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.268884 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.268976 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.269183 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.269273 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.269491 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.269579 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.269794 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.269885 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.270110 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.270199 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.270411 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.270546 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.270739 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.270826 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.270989 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.271072 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.271295 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.271422 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.271615 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.271731 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.271932 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.272029 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.272250 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.272336 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.272498 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.272584 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.272745 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.272827 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.273057 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.273162 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.273378 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.273473 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.273683 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.273769 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.273991 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.274079 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.274297 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.274387 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.274632 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.274720 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.274938 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.275023 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.275243 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.275325 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.275547 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.275631 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.275853 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.275945 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.276165 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.276255 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.276478 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.276570 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.276796 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.276881 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.277103 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.277185 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.277417 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.277512 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.277811 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.47 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.277901 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.47 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.278059 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.47 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.278143 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.47 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.278366 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.278492 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.278729 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.278820 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.279045 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.279127 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.279351 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.279443 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.279668 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.279757 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.279990 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.280086 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.280324 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.280415 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.280626 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.280717 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.280931 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.281014 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.281246 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.281331 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.281580 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.281665 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.281879 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.281961 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.282128 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.282214 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.282441 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.282537 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.282750 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.282835 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.283065 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.283150 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.283372 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.283482 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.283676 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.283785 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.283980 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.284073 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.284278 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.284370 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.284579 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.284680 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.284883 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.284981 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.285186 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.285279 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.285489 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.285590 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.285791 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.285883 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.286089 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.286181 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.286392 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.286538 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.286718 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.286807 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.287016 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.287106 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.287328 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.287426 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.287645 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.287740 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.287948 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.288043 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.288250 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.288348 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.288553 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.288641 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.288854 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.288952 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.289168 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.289265 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.289470 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.289559 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.289773 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.289860 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.290091 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.290189 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.290391 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.290502 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.290718 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.290817 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.291030 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.291128 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.291334 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.291422 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.291634 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.291729 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.291947 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.292043 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.292243 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.292342 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.292544 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.292629 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.292853 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.292939 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.293159 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.293250 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.293469 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.293601 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.293757 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.293841 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.294054 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.294137 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.294356 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.294458 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.294690 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.294784 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.294991 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.295074 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.295293 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.295383 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.295586 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.295684 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.295927 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.296116 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.296244 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.296337 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.296559 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.296687 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.296855 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.296945 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.297156 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.297247 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.297470 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.297553 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:08:39.297801 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.297884 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.298128 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.298224 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.298490 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.298595 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.298807 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.298901 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.299133 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.299237 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.299464 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.299556 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.299778 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.299871 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.300092 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.300185 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.300404 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.300496 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.300726 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.300824 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.301035 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.301130 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.301341 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.301423 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.301653 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.301746 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.301968 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.302053 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.302281 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.302365 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.302631 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.302742 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.302947 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.303033 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.303261 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.303344 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.303575 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.303702 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.303887 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.303974 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.304200 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.304292 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.304524 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.304608 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.304840 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.304924 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.305150 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.305234 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.305486 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.305584 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.305821 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.305904 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.306134 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.306217 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.306475 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.306574 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.306790 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.306873 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.307110 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.307194 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.307426 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.307518 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.307737 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.307821 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.308045 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.308135 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.308369 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.308463 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.308679 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.308763 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.308986 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.309069 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.309317 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.309401 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.309628 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.309712 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.309940 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.310029 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.310245 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.310330 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.310577 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.310661 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.310884 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.310990 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.311192 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.311788 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.312018 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.312120 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.312337 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.312461 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.312662 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.312747 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.312968 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.313058 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.313299 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.313394 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.313603 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.313687 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.313911 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.313998 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.314221 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.314314 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.314552 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.314639 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.314866 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.314960 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.315176 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.315268 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.315479 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.315563 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.315798 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.315888 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.316106 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.316202 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.316410 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.316494 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.316731 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.316851 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.317034 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.317119 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.317336 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.317420 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.317649 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.317734 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.317955 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.318040 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.318266 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.318350 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.318603 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.318701 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.318925 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.319017 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.319235 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.319319 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.319543 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.319635 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.319875 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.319959 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.320201 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.320291 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.320504 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.320596 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.320825 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.320910 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.321145 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.321228 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.321457 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.321557 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.321757 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.321847 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.322066 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.322168 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.322366 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.322485 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.322696 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.322791 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.322998 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.323082 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.323303 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.323395 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.323602 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.323686 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.323903 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.323986 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.324206 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.324293 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.324510 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.324595 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.324810 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.324894 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.325131 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.325217 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.325437 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.325524 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.325737 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.325821 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.326038 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.326122 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.326337 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.326463 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.326702 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.326786 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.327566 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.327663 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.327909 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.328000 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.328240 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.328336 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.328556 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.328646 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.328876 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.328966 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.329189 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.329280 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.329501 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.329593 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.329811 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.329895 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.330121 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.330213 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.330445 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.330542 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.330763 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.330846 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.331083 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.331180 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.331395 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.331486 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.331711 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.331802 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.332021 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.332119 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.332345 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.332440 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.332651 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.332735 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.332968 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.333053 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.333270 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.333365 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.333580 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.333671 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.333914 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.334045 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.334243 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.334327 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.334586 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.334685 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.334911 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.334998 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.335221 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.335305 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.335533 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.335617 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.335841 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.335925 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.336147 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.336230 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.336454 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.336546 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.336760 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.336844 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.337076 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.337160 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.337383 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.337479 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.337700 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.337785 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.338008 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.338091 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.338325 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.338417 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.338671 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.338757 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.338988 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.339070 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.339288 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.339384 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.339600 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.339684 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.339923 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.340006 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.340253 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.340344 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.340564 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.340648 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.340874 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.340958 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.341192 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.341347 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.341498 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.341610 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.341810 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.341920 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.342118 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.342229 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.342445 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.342595 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.342786 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.342896 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.343096 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.343215 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.343412 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.343522 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.343719 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.343837 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.344074 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.344198 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.344327 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.344436 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.344640 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.344764 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.344945 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.345055 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.345251 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.345373 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.345554 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.345673 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.345863 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.345979 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.346186 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.346297 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.346519 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.346648 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.346846 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.346937 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.347166 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.347250 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.347470 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.347563 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.347774 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.347856 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.348097 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.348187 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.348406 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.348491 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.348709 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.348794 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.349012 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.349096 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.349315 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.349407 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.349658 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.349748 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.349966 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.350052 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.350269 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.350354 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.350612 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.350699 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.350934 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.351017 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.351242 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.351328 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.351552 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.351636 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.351861 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.351956 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.352168 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.352252 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.352488 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.352606 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.352802 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.352905 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.353108 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.353200 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.353418 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.353506 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.353726 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.353889 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.354037 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.354142 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.354350 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.354476 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.354693 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.354795 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.355005 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.355090 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.355318 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.355402 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.355630 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.355717 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.355936 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.356023 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.356244 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.356334 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.356559 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.356654 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.357126 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.357216 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.357457 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.357554 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.357770 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.357867 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.358086 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.358198 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.358445 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.358543 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.358773 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.358859 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.359100 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.359183 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.359426 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.359517 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.359737 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.359820 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.360041 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.360134 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.360349 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.360445 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.360653 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.360727 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.360957 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.361031 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.361264 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.361346 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.361569 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.361642 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.361873 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.361946 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.362174 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.362256 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.362501 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.362594 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.362809 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.362894 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.363110 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.363186 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.363441 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.363516 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.363744 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.363826 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.364056 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.364140 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.364391 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.364492 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.364666 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.364741 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.364968 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.365099 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.365289 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.365364 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.365594 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.365669 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.365897 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.365978 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.366197 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.366283 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.366523 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.366623 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.366866 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.366973 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.367167 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.367258 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.367500 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.367584 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.367825 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.367917 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.368162 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.368254 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.368466 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.368550 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.368769 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.368854 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.369090 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.369174 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.369391 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.369482 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.369694 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.369778 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.369994 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.370077 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.370300 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.370383 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.370636 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.370723 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.370942 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.371033 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.371248 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.371332 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.371556 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.371647 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.371863 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.371946 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.372172 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.372262 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.372470 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.372555 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.372794 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.372936 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.373075 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.373168 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.373388 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.373472 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.373693 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.374321 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.374553 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.374677 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.374859 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.374955 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.375165 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.375257 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.375471 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.375568 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.375771 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.375854 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.376077 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.376163 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.376380 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.376475 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.376692 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.376777 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.376994 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.377082 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.377295 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.377381 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.377598 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.377681 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.377903 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.377986 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.378208 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.378294 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.378539 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.378626 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.378865 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.378948 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.379173 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.379258 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.379509 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.379593 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.379814 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.379898 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.380120 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.380204 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.380418 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.380501 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.380719 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.380811 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.381029 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.381114 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.381348 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.381439 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.381660 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.381753 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.381961 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.382044 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.382267 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.382349 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.382597 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.382703 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.382900 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.383029 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.383200 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.383284 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.383504 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.383599 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.383804 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.383888 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.384104 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.384187 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.384403 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.384488 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.384706 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.384802 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.385003 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.385086 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.385321 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.385406 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.385627 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.385710 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.385927 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.386010 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.386228 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.386313 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.387025 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.387565 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.387645 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.387711 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.387789 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.387857 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.387857 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.387857 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.388164 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.388602 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.388705 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.388914 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.389006 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.389233 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.389333 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.390119 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.390503 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.390708 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.390802 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.391029 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.391118 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.391344 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.391432 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.391654 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.391741 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.391959 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.392045 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.392266 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.392355 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.392577 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.392663 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.392883 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.392982 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.393190 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.393282 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.393512 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.393598 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.393822 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.393918 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.394135 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.394226 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.394468 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.394558 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.394794 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.394908 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.395108 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.395199 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.395411 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.395496 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.395720 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.395821 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.396030 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.396131 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.396342 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.396439 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.396647 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.396743 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.396957 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.397045 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.397268 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.397354 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.397579 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.397674 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.397886 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.397972 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.398225 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.398324 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.398520 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.398623 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.398829 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.398917 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.399133 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.399219 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.399453 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.399542 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.399755 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.399840 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.400066 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.400161 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.400373 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.400468 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.400676 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.400987 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.401293 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.401610 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.401917 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.402347 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.402688 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.403014 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.403322 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.403636 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.403949 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.404265 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.404582 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.404812 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.404959 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.405182 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.405360 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.405652 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.405741 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.405973 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.406069 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.406288 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.406375 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.406622 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.406711 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.406929 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.407031 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.407242 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.407329 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.407567 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.407654 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.407875 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.407971 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.408181 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.408283 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.408490 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.408646 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.408810 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.408980 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.409115 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.409363 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.409452 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.409734 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.409873 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.410057 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.410185 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.410374 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.410514 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.410726 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.410957 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.411050 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.411221 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.411362 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.411533 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.411678 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.411863 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.411995 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.412185 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.412328 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.412510 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.412643 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.412818 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.412972 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.413135 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.413396 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.413491 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.413715 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.413804 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.414028 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.414116 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.414364 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.414502 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.414708 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.414798 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.415015 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.415102 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.415339 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.415428 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.415662 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.415751 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.415976 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.416069 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.416298 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.416396 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.416633 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.416720 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.416952 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.417038 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.417285 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.417382 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.417616 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.417704 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.417935 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.418023 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.418240 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.418339 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.418575 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.418676 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.418885 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.418984 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.419192 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.419281 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.419498 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.419598 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.419819 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.419907 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.420126 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.420242 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.420439 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.420572 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.420779 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.420919 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.421091 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.421249 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.421399 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.421582 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.421712 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.421898 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.422052 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.422211 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.422393 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.422552 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.422666 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.422866 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.422967 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.423179 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.423282 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.423508 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.423596 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.423818 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.423916 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.424135 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.424231 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.424454 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.424541 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.424767 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.424855 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.425075 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.425172 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.425377 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.425464 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.425701 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.425787 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.426012 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.426101 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.426331 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.426439 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.426672 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.426770 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.426999 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.427089 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.427312 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.427405 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.427621 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.427715 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.427951 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.428040 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.428264 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.428352 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.428585 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.428727 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.428892 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.428981 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.429196 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.429282 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.429505 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.429601 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.429817 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.429906 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.430128 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.430215 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.430457 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.430561 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.430771 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.430859 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.431084 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.431174 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.431394 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.431490 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.431710 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.431797 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.432017 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.432112 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.432340 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.432437 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.432647 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.432736 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.432963 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.433050 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.433273 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.433362 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.433578 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.433661 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.433885 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.433972 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.434190 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.434277 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.434517 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.434607 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.434832 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.434929 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.435140 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.435230 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.435450 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.435537 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.435757 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.435938 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.436080 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.436170 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.436916 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.437033 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.437246 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.437345 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.437561 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.437650 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.437871 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.437966 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.438179 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.438277 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.438513 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.438605 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.438830 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.438928 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.439149 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.439246 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.439466 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.439554 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.439779 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.439868 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.440097 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.440194 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.440413 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.440509 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.440722 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.440815 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.441048 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.441264 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.441353 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.441595 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.441686 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.441912 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.442009 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.442234 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.442329 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.442580 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.442672 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.442899 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.443006 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.443215 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.443304 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.443526 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.443634 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.443838 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.443938 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.444156 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.444251 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.444467 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.444555 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.444793 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.444997 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.445116 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.445329 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.445441 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.445647 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.445762 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.445964 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.446081 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.446279 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.446398 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.446623 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.446728 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.446941 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.447030 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.447256 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.447382 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.447572 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.447699 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.447887 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.448008 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.448200 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.448323 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.448530 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.448627 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.448855 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.448996 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.449184 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.449281 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.449527 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.449617 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.449836 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.449949 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.450149 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.450247 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.450480 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.450585 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.450796 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.450885 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.451111 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.451274 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.451424 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.451513 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.451748 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.451834 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.452618 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.452719 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.452942 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.453031 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.453255 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.453348 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.453569 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.453664 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.453883 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.453972 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.454196 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.454402 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.454586 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.454740 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.454831 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.455074 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.455171 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.455400 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.455490 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.455726 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.455814 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.456044 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.456132 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.456362 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.456452 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.456685 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.456779 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.456989 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.457076 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.457295 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.457384 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.457609 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.457696 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.457921 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.458129 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.458227 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.458464 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.458555 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.458803 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.458928 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.459135 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.459232 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.459465 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.459551 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.459775 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.459864 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.460094 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.460319 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.460417 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.460671 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.460766 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.460991 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.461088 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.461310 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.461397 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.461622 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.461708 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.461929 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.462018 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.462233 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.462321 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.462579 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.462667 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.462889 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.462985 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.463196 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.463284 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.463508 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.463594 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.463815 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.464048 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.464136 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.464401 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.464490 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.464710 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.464807 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.465021 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.465108 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.465325 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.465412 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.465636 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.465725 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.465939 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.466033 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.466268 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.466354 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.466600 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.466690 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.466907 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.466993 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.467213 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.467303 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.467547 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.467645 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.467853 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.467940 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.468158 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.468245 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.468463 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.468551 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.468769 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.468857 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.469071 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.469170 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.469373 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.469459 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.469682 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.469768 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.469983 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.470078 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.470295 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.470382 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.470625 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.470713 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.470934 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.471034 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.471237 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.471323 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.471540 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.471626 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.471848 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.471948 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.472151 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.472237 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.472454 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.472542 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.472768 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.472858 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.473071 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.473164 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.473382 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.473470 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.473689 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.473778 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.474004 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.474091 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.474309 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.474462 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.474658 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.474884 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.474980 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.475268 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.475355 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.475572 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.475668 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.475879 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.475971 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.476193 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.476280 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.476506 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.476595 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.476831 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.476918 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.477135 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.477221 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.477446 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.477541 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.477756 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.477843 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.478068 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.478164 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.478381 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.478642 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.478732 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.479013 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.479147 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.479326 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.479426 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.479638 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.479728 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.479951 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.480088 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.480263 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.480360 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.480601 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.480695 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.480912 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.480999 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.481228 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.481318 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.481540 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.481626 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.481855 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.481943 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.482165 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.482253 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.482502 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.482592 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.482818 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.482915 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.483147 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.483237 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.483467 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.483556 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.483781 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.483878 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.484095 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.484183 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.484401 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.484495 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.484749 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.484844 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.485069 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.485158 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.485389 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.485477 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.485711 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.485815 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.486025 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.486115 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.486339 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.486479 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.486678 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.486768 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.486993 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.487079 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.487311 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.487398 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.487622 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.487710 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.487948 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.488036 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.488259 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.488346 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.488604 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.488700 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.488931 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.489020 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.489241 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.489383 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.489550 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.489639 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.489857 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.489946 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.490169 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.490266 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.490531 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.490623 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.490849 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.490936 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.491170 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.491270 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.491482 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.491569 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.491802 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.491890 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.492113 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.492205 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.492436 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.492523 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.492767 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.492862 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.493072 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.493161 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.493381 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.493469 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.493688 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.493782 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.493999 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.494088 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.494308 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.494404 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.494649 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.494752 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.494965 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.495053 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.495276 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.495364 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.495584 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.495679 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.495897 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.495984 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.496217 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.496342 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.496522 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.496621 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.496844 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.496930 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.497155 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.497244 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.497472 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.497569 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.497787 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.497881 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.498097 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.498184 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.498407 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.498517 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.499248 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.499344 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.499577 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.499662 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.499893 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.499982 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.500204 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.500290 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.500522 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.500609 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.500828 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.500916 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.501155 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.501243 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.501473 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.501569 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.501796 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.501892 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.502113 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.502200 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.502510 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.502616 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.502780 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.502868 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.503095 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.503182 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.503413 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.503513 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.503675 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 01 01:08:39.503763 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.504029 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.504349 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.504670 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.504999 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.505327 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.505655 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.505983 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.506329 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.506670 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.507017 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.507345 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:08:39.507589 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 01 01:08:39.527016 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG oslo_db.sqlalchemy.engines [None req-b8e88df8-9a12-49f1-a07c-c4abde0e08a8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101290) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 01 01:08:39.530696 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG oslo_db.sqlalchemy.engines [None req-85ee3b57-1d1f-4763-b02c-d6fdd5514bb2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101289) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 01 01:08:39.699677 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.context [None req-b8e88df8-9a12-49f1-a07c-c4abde0e08a8 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),4c03a77a-7438-491d-92a6-ffcc24307f49(cell1) {{(pid=101290) load_cells /opt/stack/nova/nova/context.py:464}} Nov 01 01:08:39.702115 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.context [None req-85ee3b57-1d1f-4763-b02c-d6fdd5514bb2 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),4c03a77a-7438-491d-92a6-ffcc24307f49(cell1) {{(pid=101289) load_cells /opt/stack/nova/nova/context.py:464}} Nov 01 01:08:39.704116 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG oslo_concurrency.lockutils [None req-b8e88df8-9a12-49f1-a07c-c4abde0e08a8 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:08:39.705713 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG oslo_concurrency.lockutils [None req-b8e88df8-9a12-49f1-a07c-c4abde0e08a8 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:08:39.706483 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG oslo_concurrency.lockutils [None req-85ee3b57-1d1f-4763-b02c-d6fdd5514bb2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:08:39.706582 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG oslo_concurrency.lockutils [None req-b8e88df8-9a12-49f1-a07c-c4abde0e08a8 None None] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:08:39.708064 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG oslo_concurrency.lockutils [None req-85ee3b57-1d1f-4763-b02c-d6fdd5514bb2 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:08:39.708449 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG oslo_concurrency.lockutils [None req-b8e88df8-9a12-49f1-a07c-c4abde0e08a8 None None] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:08:39.708861 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG oslo_concurrency.lockutils [None req-85ee3b57-1d1f-4763-b02c-d6fdd5514bb2 None None] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:08:39.710800 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG oslo_concurrency.lockutils [None req-85ee3b57-1d1f-4763-b02c-d6fdd5514bb2 None None] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:08:39.719170 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG oslo_db.sqlalchemy.engines [None req-b8e88df8-9a12-49f1-a07c-c4abde0e08a8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101290) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 01 01:08:39.720898 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG oslo_db.sqlalchemy.engines [None req-b8e88df8-9a12-49f1-a07c-c4abde0e08a8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101290) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 01 01:08:39.722530 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG oslo_db.sqlalchemy.engines [None req-85ee3b57-1d1f-4763-b02c-d6fdd5514bb2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101289) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 01 01:08:39.724631 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG oslo_db.sqlalchemy.engines [None req-85ee3b57-1d1f-4763-b02c-d6fdd5514bb2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101289) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 01 01:08:39.983634 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG oslo_db.sqlalchemy.engines [None req-b8e88df8-9a12-49f1-a07c-c4abde0e08a8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101290) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 01 01:08:39.988691 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG oslo_db.sqlalchemy.engines [None req-85ee3b57-1d1f-4763-b02c-d6fdd5514bb2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101289) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 01 01:08:40.410620 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: WARNING keystonemiddleware.auth_token [None req-b8e88df8-9a12-49f1-a07c-c4abde0e08a8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 01 01:08:40.417102 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: WARNING keystonemiddleware.auth_token [None req-b8e88df8-9a12-49f1-a07c-c4abde0e08a8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 01 01:08:40.446302 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: WARNING keystonemiddleware.auth_token [None req-85ee3b57-1d1f-4763-b02c-d6fdd5514bb2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 01 01:08:40.453290 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: WARNING keystonemiddleware.auth_token [None req-85ee3b57-1d1f-4763-b02c-d6fdd5514bb2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 01 01:08:40.767072 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: WARNING keystonemiddleware.auth_token [None req-b8e88df8-9a12-49f1-a07c-c4abde0e08a8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 01 01:08:40.772242 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: WARNING keystonemiddleware.auth_token [None req-b8e88df8-9a12-49f1-a07c-c4abde0e08a8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 01 01:08:40.778397 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5625f5b4f9c0 pid: 101290 (default app) Nov 01 01:08:40.780502 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi [None req-b8e88df8-9a12-49f1-a07c-c4abde0e08a8 None None] Calling method '>' {{(pid=101290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:08:40.781682 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: INFO nova.api.openstack.requestlog [None req-b8e88df8-9a12-49f1-a07c-c4abde0e08a8 None None] 10.222.0.47 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001758 Nov 01 01:08:40.782100 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: [pid: 101290|app: 0|req: 1/1] 10.222.0.47 () {50 vars in 788 bytes} [Mon Nov 1 01:08:40 2021] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:08:40.797992 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: WARNING keystonemiddleware.auth_token [None req-85ee3b57-1d1f-4763-b02c-d6fdd5514bb2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 01 01:08:40.803193 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: WARNING keystonemiddleware.auth_token [None req-85ee3b57-1d1f-4763-b02c-d6fdd5514bb2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 01 01:08:40.809324 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5625f5b4f9c0 pid: 101289 (default app) Nov 01 01:10:04.649780 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi [None req-b8e88df8-9a12-49f1-a07c-c4abde0e08a8 None None] Calling method '>' {{(pid=101290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:10:04.650948 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: INFO nova.api.openstack.requestlog [None req-b8e88df8-9a12-49f1-a07c-c4abde0e08a8 None None] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001561 Nov 01 01:10:04.651442 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: [pid: 101290|app: 0|req: 2/2] 10.222.0.47 () {54 vars in 930 bytes} [Mon Nov 1 01:10:04 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:10:05.067059 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi [None req-29f476b5-0f3a-49aa-ac0b-9b5521344f59 admin admin] Calling method '>' {{(pid=101289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:10:05.097995 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: INFO nova.api.openstack.requestlog [None req-29f476b5-0f3a-49aa-ac0b-9b5521344f59 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.438215 Nov 01 01:10:05.099041 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: [pid: 101289|app: 0|req: 1/3] 10.222.0.47 () {60 vars in 1291 bytes} [Mon Nov 1 01:10:04 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:10:07.421423 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi [None req-b8e88df8-9a12-49f1-a07c-c4abde0e08a8 None None] Calling method '>' {{(pid=101290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:10:07.422337 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: INFO nova.api.openstack.requestlog [None req-b8e88df8-9a12-49f1-a07c-c4abde0e08a8 None None] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001495 Nov 01 01:10:07.422809 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: [pid: 101290|app: 0|req: 3/4] 10.222.0.47 () {54 vars in 930 bytes} [Mon Nov 1 01:10:07 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:10:07.482326 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi [None req-bce6c8d0-b7bc-4c65-8048-e96eaeea5c9f admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "name": "cirros256", "swap": 0, "os-flavor-access:is_public": true, "ram": 256, "disk": 1, "id": "c1", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=101289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:10:07.500287 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 01 01:10:07.500287 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: warnings.warn(msg) Nov 01 01:10:07.595874 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: INFO nova.api.openstack.requestlog [None req-bce6c8d0-b7bc-4c65-8048-e96eaeea5c9f admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.166100 Nov 01 01:10:07.596456 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: [pid: 101289|app: 0|req: 2/5] 10.222.0.47 () {64 vars in 1282 bytes} [Mon Nov 1 01:10:07 2021] POST /compute/v2.1/flavors => generated 407 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 01 01:10:07.821814 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi [None req-337170aa-6cc8-49eb-9351-335d97a20afe admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:10:07.824181 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 01 01:10:07.824181 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: warnings.warn(msg) Nov 01 01:10:07.946943 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: INFO nova.api.openstack.requestlog [None req-337170aa-6cc8-49eb-9351-335d97a20afe admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.341099 Nov 01 01:10:07.950553 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: [pid: 101290|app: 0|req: 4/6] 10.222.0.47 () {64 vars in 1335 bytes} [Mon Nov 1 01:10:07 2021] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:10:10.250081 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi [None req-bce6c8d0-b7bc-4c65-8048-e96eaeea5c9f admin admin] Calling method '>' {{(pid=101289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:10:10.251232 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: INFO nova.api.openstack.requestlog [None req-bce6c8d0-b7bc-4c65-8048-e96eaeea5c9f admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001520 Nov 01 01:10:10.251814 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: [pid: 101289|app: 0|req: 3/7] 10.222.0.47 () {54 vars in 930 bytes} [Mon Nov 1 01:10:10 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:10:10.375750 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi [None req-437f8074-0930-4c5f-a035-207537d9540d admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "swap": 0, "id": "d1", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 5, "os-flavor-access:is_public": true, "name": "ds512M", "rxtx_factor": 1.0}} {{(pid=101290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:10:10.395720 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 01 01:10:10.395720 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: warnings.warn(msg) Nov 01 01:10:10.505088 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: INFO nova.api.openstack.requestlog [None req-437f8074-0930-4c5f-a035-207537d9540d admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.246141 Nov 01 01:10:10.505555 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: [pid: 101290|app: 0|req: 5/8] 10.222.0.47 () {64 vars in 1282 bytes} [Mon Nov 1 01:10:10 2021] POST /compute/v2.1/flavors => generated 404 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 01 01:10:10.519653 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi [None req-bd9694a9-9219-4cee-9c47-3d14700177fa admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:10:10.521269 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 01 01:10:10.521269 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: warnings.warn(msg) Nov 01 01:10:10.623598 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: INFO nova.api.openstack.requestlog [None req-bd9694a9-9219-4cee-9c47-3d14700177fa admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.107626 Nov 01 01:10:10.624192 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: [pid: 101289|app: 0|req: 4/9] 10.222.0.47 () {64 vars in 1335 bytes} [Mon Nov 1 01:10:10 2021] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:10:12.942358 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi [None req-437f8074-0930-4c5f-a035-207537d9540d admin admin] Calling method '>' {{(pid=101290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:10:12.943516 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: INFO nova.api.openstack.requestlog [None req-437f8074-0930-4c5f-a035-207537d9540d admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001529 Nov 01 01:10:12.944020 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: [pid: 101290|app: 0|req: 6/10] 10.222.0.47 () {54 vars in 930 bytes} [Mon Nov 1 01:10:12 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:10:13.011539 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi [None req-50e64d82-15e2-4fbf-83bc-3e575cadc488 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "swap": 0, "vcpus": 1, "os-flavor-access:is_public": true, "id": "d2", "ram": 1024, "rxtx_factor": 1.0}} {{(pid=101289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:10:13.105761 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: INFO nova.api.openstack.requestlog [None req-50e64d82-15e2-4fbf-83bc-3e575cadc488 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.154208 Nov 01 01:10:13.106415 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: [pid: 101289|app: 0|req: 5/11] 10.222.0.47 () {64 vars in 1282 bytes} [Mon Nov 1 01:10:12 2021] POST /compute/v2.1/flavors => generated 404 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 01 01:10:13.119095 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi [None req-0581fa11-0bc7-4397-8a94-05a70b616bfc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:10:13.181544 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: INFO nova.api.openstack.requestlog [None req-0581fa11-0bc7-4397-8a94-05a70b616bfc admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.066083 Nov 01 01:10:13.182213 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: [pid: 101290|app: 0|req: 7/12] 10.222.0.47 () {64 vars in 1335 bytes} [Mon Nov 1 01:10:13 2021] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:10:15.492207 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi [None req-50e64d82-15e2-4fbf-83bc-3e575cadc488 admin admin] Calling method '>' {{(pid=101289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:10:15.493868 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: INFO nova.api.openstack.requestlog [None req-50e64d82-15e2-4fbf-83bc-3e575cadc488 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002131 Nov 01 01:10:15.494661 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: [pid: 101289|app: 0|req: 6/13] 10.222.0.47 () {54 vars in 930 bytes} [Mon Nov 1 01:10:15 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 01 01:10:15.556636 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi [None req-9e84eceb-8f00-47f5-be1e-70978509c90d admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "id": "d3", "disk": 10, "name": "ds2G", "os-flavor-access:is_public": true, "vcpus": 2, "swap": 0, "ram": 2048, "rxtx_factor": 1.0}} {{(pid=101290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:10:15.618691 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: INFO nova.api.openstack.requestlog [None req-9e84eceb-8f00-47f5-be1e-70978509c90d admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.116140 Nov 01 01:10:15.619170 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: [pid: 101290|app: 0|req: 8/14] 10.222.0.47 () {64 vars in 1282 bytes} [Mon Nov 1 01:10:15 2021] POST /compute/v2.1/flavors => generated 404 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 01 01:10:15.632159 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi [None req-c58eb638-890d-4e8c-97da-826d47091556 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:10:15.706929 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: INFO nova.api.openstack.requestlog [None req-c58eb638-890d-4e8c-97da-826d47091556 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.078225 Nov 01 01:10:15.707511 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: [pid: 101289|app: 0|req: 7/15] 10.222.0.47 () {64 vars in 1335 bytes} [Mon Nov 1 01:10:15 2021] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:10:18.034678 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi [None req-9e84eceb-8f00-47f5-be1e-70978509c90d admin admin] Calling method '>' {{(pid=101290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:10:18.035685 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: INFO nova.api.openstack.requestlog [None req-9e84eceb-8f00-47f5-be1e-70978509c90d admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001503 Nov 01 01:10:18.036255 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: [pid: 101290|app: 0|req: 9/16] 10.222.0.47 () {54 vars in 930 bytes} [Mon Nov 1 01:10:18 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:10:18.107146 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi [None req-023a3297-b67d-4bb0-aa20-50cbba5f031a admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "os-flavor-access:is_public": true, "vcpus": 4, "name": "ds4G", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "id": "d4", "disk": 20, "rxtx_factor": 1.0}} {{(pid=101289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:10:18.196694 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: INFO nova.api.openstack.requestlog [None req-023a3297-b67d-4bb0-aa20-50cbba5f031a admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.153272 Nov 01 01:10:18.197414 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: [pid: 101289|app: 0|req: 8/17] 10.222.0.47 () {64 vars in 1282 bytes} [Mon Nov 1 01:10:18 2021] POST /compute/v2.1/flavors => generated 404 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 01 01:10:18.209592 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi [None req-c636f235-9e53-40c6-ad0a-3276f9c66a3c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:10:18.285882 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: INFO nova.api.openstack.requestlog [None req-c636f235-9e53-40c6-ad0a-3276f9c66a3c admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.079774 Nov 01 01:10:18.286481 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: [pid: 101290|app: 0|req: 10/18] 10.222.0.47 () {64 vars in 1335 bytes} [Mon Nov 1 01:10:18 2021] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:10:20.714387 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi [None req-023a3297-b67d-4bb0-aa20-50cbba5f031a admin admin] Calling method '>' {{(pid=101289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:10:20.715824 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: INFO nova.api.openstack.requestlog [None req-023a3297-b67d-4bb0-aa20-50cbba5f031a admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002000 Nov 01 01:10:20.716411 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: [pid: 101289|app: 0|req: 9/19] 10.222.0.47 () {54 vars in 930 bytes} [Mon Nov 1 01:10:20 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:10:20.787322 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi [None req-e71dff7d-bbb1-488c-b439-18b286d7d7d9 admin admin] Calling method '>' {{(pid=101290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:10:20.810090 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: INFO nova.api.openstack.requestlog [None req-e71dff7d-bbb1-488c-b439-18b286d7d7d9 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.086737 Nov 01 01:10:20.810661 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: [pid: 101290|app: 0|req: 11/20] 10.222.0.47 () {60 vars in 1291 bytes} [Mon Nov 1 01:10:20 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 01:10:23.495418 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi [None req-023a3297-b67d-4bb0-aa20-50cbba5f031a admin admin] Calling method '>' {{(pid=101289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:10:23.496760 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: INFO nova.api.openstack.requestlog [None req-023a3297-b67d-4bb0-aa20-50cbba5f031a admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001938 Nov 01 01:10:23.497269 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: [pid: 101289|app: 0|req: 10/21] 10.222.0.47 () {54 vars in 930 bytes} [Mon Nov 1 01:10:23 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:10:23.562530 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi [None req-890b128e-8665-4aac-b646-3963047e2b24 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "id": "1", "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.tiny", "rxtx_factor": 1.0, "ram": 512, "vcpus": 1, "disk": 1, "os-flavor-access:is_public": true}} {{(pid=101290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:10:23.635010 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: INFO nova.api.openstack.requestlog [None req-890b128e-8665-4aac-b646-3963047e2b24 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.130199 Nov 01 01:10:23.636428 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: [pid: 101290|app: 0|req: 12/22] 10.222.0.47 () {64 vars in 1282 bytes} [Mon Nov 1 01:10:23 2021] POST /compute/v2.1/flavors => generated 402 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 01 01:10:23.651901 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi [None req-5be6b598-9e27-491a-86c6-1d9efa7fdc85 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:10:23.762517 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: INFO nova.api.openstack.requestlog [None req-5be6b598-9e27-491a-86c6-1d9efa7fdc85 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.114759 Nov 01 01:10:23.763325 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: [pid: 101289|app: 0|req: 11/23] 10.222.0.47 () {64 vars in 1332 bytes} [Mon Nov 1 01:10:23 2021] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:10:26.779827 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi [None req-890b128e-8665-4aac-b646-3963047e2b24 admin admin] Calling method '>' {{(pid=101290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:10:26.780851 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: INFO nova.api.openstack.requestlog [None req-890b128e-8665-4aac-b646-3963047e2b24 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Nov 01 01:10:26.781246 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: [pid: 101290|app: 0|req: 13/24] 10.222.0.47 () {54 vars in 930 bytes} [Mon Nov 1 01:10:26 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:10:26.840779 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi [None req-c1a06865-cd91-49e8-ac08-d78c49667a60 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.small", "id": "2", "vcpus": 1, "ram": 2048, "swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 20}} {{(pid=101289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:10:26.926518 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: INFO nova.api.openstack.requestlog [None req-c1a06865-cd91-49e8-ac08-d78c49667a60 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.138459 Nov 01 01:10:26.927096 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: [pid: 101289|app: 0|req: 12/25] 10.222.0.47 () {64 vars in 1282 bytes} [Mon Nov 1 01:10:26 2021] POST /compute/v2.1/flavors => generated 405 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 01 01:10:26.940093 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi [None req-64263f52-dd72-48f9-8ab9-e5b524f77144 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:10:27.028134 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: INFO nova.api.openstack.requestlog [None req-64263f52-dd72-48f9-8ab9-e5b524f77144 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.091733 Nov 01 01:10:27.028638 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: [pid: 101290|app: 0|req: 14/26] 10.222.0.47 () {64 vars in 1332 bytes} [Mon Nov 1 01:10:26 2021] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:10:29.328170 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi [None req-c1a06865-cd91-49e8-ac08-d78c49667a60 admin admin] Calling method '>' {{(pid=101289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:10:29.329279 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: INFO nova.api.openstack.requestlog [None req-c1a06865-cd91-49e8-ac08-d78c49667a60 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001547 Nov 01 01:10:29.329760 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: [pid: 101289|app: 0|req: 13/27] 10.222.0.47 () {54 vars in 930 bytes} [Mon Nov 1 01:10:29 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:10:29.388317 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi [None req-3d5169e6-42ab-4cb9-9974-f9fd51454730 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "id": "3", "vcpus": 2, "rxtx_factor": 1.0, "name": "m1.medium", "os-flavor-access:is_public": true, "ram": 4096, "disk": 40, "swap": 0}} {{(pid=101290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:10:29.464866 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: INFO nova.api.openstack.requestlog [None req-3d5169e6-42ab-4cb9-9974-f9fd51454730 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.128492 Nov 01 01:10:29.465431 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: [pid: 101290|app: 0|req: 15/28] 10.222.0.47 () {64 vars in 1282 bytes} [Mon Nov 1 01:10:29 2021] POST /compute/v2.1/flavors => generated 406 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 01 01:10:29.477567 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi [None req-844c4d72-c654-4dae-b6e6-410ef0819a61 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:10:29.570887 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: INFO nova.api.openstack.requestlog [None req-844c4d72-c654-4dae-b6e6-410ef0819a61 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.096856 Nov 01 01:10:29.571488 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: [pid: 101289|app: 0|req: 14/29] 10.222.0.47 () {64 vars in 1332 bytes} [Mon Nov 1 01:10:29 2021] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:10:31.919874 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi [None req-3d5169e6-42ab-4cb9-9974-f9fd51454730 admin admin] Calling method '>' {{(pid=101290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:10:31.920804 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: INFO nova.api.openstack.requestlog [None req-3d5169e6-42ab-4cb9-9974-f9fd51454730 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Nov 01 01:10:31.921225 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: [pid: 101290|app: 0|req: 16/30] 10.222.0.47 () {54 vars in 930 bytes} [Mon Nov 1 01:10:31 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:10:31.981910 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi [None req-ffbe9a50-baec-446c-b50c-d931d21c1c63 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 8192, "vcpus": 4, "name": "m1.large", "os-flavor-access:is_public": true, "swap": 0, "disk": 80, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "4"}} {{(pid=101289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:10:32.068625 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: INFO nova.api.openstack.requestlog [None req-ffbe9a50-baec-446c-b50c-d931d21c1c63 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.140492 Nov 01 01:10:32.070033 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: [pid: 101289|app: 0|req: 15/31] 10.222.0.47 () {64 vars in 1282 bytes} [Mon Nov 1 01:10:31 2021] POST /compute/v2.1/flavors => generated 405 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 01 01:10:32.082874 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi [None req-fa7919de-285c-42b2-aa49-d7b20ab94ee0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:10:32.176963 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: INFO nova.api.openstack.requestlog [None req-fa7919de-285c-42b2-aa49-d7b20ab94ee0 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.097721 Nov 01 01:10:32.177662 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: [pid: 101290|app: 0|req: 17/32] 10.222.0.47 () {64 vars in 1332 bytes} [Mon Nov 1 01:10:32 2021] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:10:34.652193 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi [None req-ffbe9a50-baec-446c-b50c-d931d21c1c63 admin admin] Calling method '>' {{(pid=101289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:10:34.652193 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: INFO nova.api.openstack.requestlog [None req-ffbe9a50-baec-446c-b50c-d931d21c1c63 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001518 Nov 01 01:10:34.652780 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: [pid: 101289|app: 0|req: 16/33] 10.222.0.47 () {54 vars in 930 bytes} [Mon Nov 1 01:10:34 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:10:34.716702 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi [None req-4afd1b98-11fe-42a4-8ead-3a8b42174681 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "name": "m1.xlarge", "vcpus": 8, "ram": 16384, "id": "5", "swap": 0, "disk": 160, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true}} {{(pid=101290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:10:34.801815 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: INFO nova.api.openstack.requestlog [None req-4afd1b98-11fe-42a4-8ead-3a8b42174681 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.141634 Nov 01 01:10:34.802503 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: [pid: 101290|app: 0|req: 18/34] 10.222.0.47 () {64 vars in 1282 bytes} [Mon Nov 1 01:10:34 2021] POST /compute/v2.1/flavors => generated 408 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 01 01:10:34.815193 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi [None req-b512cf33-18cb-4331-a192-e69d4f6234f7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:10:34.897135 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: INFO nova.api.openstack.requestlog [None req-b512cf33-18cb-4331-a192-e69d4f6234f7 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.085472 Nov 01 01:10:34.897727 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: [pid: 101289|app: 0|req: 17/35] 10.222.0.47 () {64 vars in 1332 bytes} [Mon Nov 1 01:10:34 2021] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:11:13.768491 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi [None req-4afd1b98-11fe-42a4-8ead-3a8b42174681 admin admin] Calling method '>' {{(pid=101290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:11:13.769481 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: INFO nova.api.openstack.requestlog [None req-4afd1b98-11fe-42a4-8ead-3a8b42174681 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001407 Nov 01 01:11:13.769873 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: [pid: 101290|app: 0|req: 19/36] 10.222.0.47 () {54 vars in 930 bytes} [Mon Nov 1 01:11:13 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:11:13.826548 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi [None req-dfcf2b19-1e65-47bd-b2db-da52137db6c9 admin admin] Calling method '>' {{(pid=101289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:11:13.843420 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: INFO nova.api.openstack.requestlog [None req-dfcf2b19-1e65-47bd-b2db-da52137db6c9 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.066564 Nov 01 01:11:13.843951 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: [pid: 101289|app: 0|req: 18/37] 10.222.0.47 () {60 vars in 1291 bytes} [Mon Nov 1 01:11:13 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 01 01:11:15.354380 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi [None req-4afd1b98-11fe-42a4-8ead-3a8b42174681 admin admin] Calling method '>' {{(pid=101290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:11:15.355411 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: INFO nova.api.openstack.requestlog [None req-4afd1b98-11fe-42a4-8ead-3a8b42174681 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Nov 01 01:11:15.355849 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: [pid: 101290|app: 0|req: 20/38] 10.222.0.47 () {56 vars in 1074 bytes} [Mon Nov 1 01:11:15 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:11:15.545313 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi [None req-4f1a26b9-5c9d-46c8-9ddc-7463bbd66636 admin admin] Calling method '>' {{(pid=101289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:11:15.550683 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: INFO nova.api.openstack.wsgi [None req-4f1a26b9-5c9d-46c8-9ddc-7463bbd66636 admin admin] HTTP exception thrown: Flavor 42 could not be found. Nov 01 01:11:15.551246 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi [None req-4f1a26b9-5c9d-46c8-9ddc-7463bbd66636 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=101289) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 01 01:11:15.552016 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: INFO nova.api.openstack.requestlog [None req-4f1a26b9-5c9d-46c8-9ddc-7463bbd66636 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.057281 Nov 01 01:11:15.552513 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: [pid: 101289|app: 0|req: 19/39] 10.222.0.47 () {60 vars in 1190 bytes} [Mon Nov 1 01:11:15 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 01 01:11:15.562122 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi [None req-8c827932-e140-4e25-ba81-2ab3849f804d admin admin] Calling method '>' {{(pid=101290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:11:15.582452 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: INFO nova.api.openstack.requestlog [None req-8c827932-e140-4e25-ba81-2ab3849f804d admin admin] 10.222.0.47 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.023802 Nov 01 01:11:15.582914 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: [pid: 101290|app: 0|req: 21/40] 10.222.0.47 () {60 vars in 1210 bytes} [Mon Nov 1 01:11:15 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 01:11:15.593181 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi [None req-bd11cfb3-824b-4b0a-af55-0d2ec1c21ed9 admin admin] Calling method '>' {{(pid=101289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:11:15.613582 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: INFO nova.api.openstack.requestlog [None req-bd11cfb3-824b-4b0a-af55-0d2ec1c21ed9 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.023854 Nov 01 01:11:15.614124 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: [pid: 101289|app: 0|req: 20/41] 10.222.0.47 () {60 vars in 1210 bytes} [Mon Nov 1 01:11:15 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 01:11:15.623905 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi [None req-3fb4a91d-d444-43d1-b172-e5e3ab60159d admin admin] Calling method '>' {{(pid=101290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:11:15.629201 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: INFO nova.api.openstack.wsgi [None req-3fb4a91d-d444-43d1-b172-e5e3ab60159d admin admin] HTTP exception thrown: Flavor 42 could not be found. Nov 01 01:11:15.629762 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi [None req-3fb4a91d-d444-43d1-b172-e5e3ab60159d admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=101290) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 01 01:11:15.630564 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: INFO nova.api.openstack.requestlog [None req-3fb4a91d-d444-43d1-b172-e5e3ab60159d admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.010129 Nov 01 01:11:15.631057 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: [pid: 101290|app: 0|req: 22/42] 10.222.0.47 () {60 vars in 1190 bytes} [Mon Nov 1 01:11:15 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Nov 01 01:11:17.085683 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi [None req-bd11cfb3-824b-4b0a-af55-0d2ec1c21ed9 admin admin] Calling method '>' {{(pid=101289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:11:17.086723 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: INFO nova.api.openstack.requestlog [None req-bd11cfb3-824b-4b0a-af55-0d2ec1c21ed9 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001484 Nov 01 01:11:17.087113 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: [pid: 101289|app: 0|req: 21/43] 10.222.0.47 () {56 vars in 1074 bytes} [Mon Nov 1 01:11:17 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:11:17.323422 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi [None req-b3716d39-a123-4543-8f48-26d25a5f418d admin admin] Calling method '>' {{(pid=101290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:11:17.329262 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: INFO nova.api.openstack.wsgi [None req-b3716d39-a123-4543-8f48-26d25a5f418d admin admin] HTTP exception thrown: Flavor 84 could not be found. Nov 01 01:11:17.330367 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi [None req-b3716d39-a123-4543-8f48-26d25a5f418d admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=101290) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 01 01:11:17.331856 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: INFO nova.api.openstack.requestlog [None req-b3716d39-a123-4543-8f48-26d25a5f418d admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.063031 Nov 01 01:11:17.332673 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: [pid: 101290|app: 0|req: 23/44] 10.222.0.47 () {60 vars in 1190 bytes} [Mon Nov 1 01:11:17 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 01 01:11:17.346064 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi [None req-b124ae25-dab3-4de2-963f-c7d8b7cd750a admin admin] Calling method '>' {{(pid=101289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:11:17.359570 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: INFO nova.api.openstack.requestlog [None req-b124ae25-dab3-4de2-963f-c7d8b7cd750a admin admin] 10.222.0.47 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017134 Nov 01 01:11:17.360117 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: [pid: 101289|app: 0|req: 22/45] 10.222.0.47 () {60 vars in 1210 bytes} [Mon Nov 1 01:11:17 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 01:11:17.371009 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi [None req-f9a49b15-d197-414c-a8f5-a48759b63ee4 admin admin] Calling method '>' {{(pid=101290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:11:17.385984 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: INFO nova.api.openstack.requestlog [None req-f9a49b15-d197-414c-a8f5-a48759b63ee4 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019155 Nov 01 01:11:17.386532 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: [pid: 101290|app: 0|req: 24/46] 10.222.0.47 () {60 vars in 1210 bytes} [Mon Nov 1 01:11:17 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 01:11:17.396510 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi [None req-b670ed6b-0fdf-436a-8ca0-1f57efc1957f admin admin] Calling method '>' {{(pid=101289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:11:17.401631 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: INFO nova.api.openstack.wsgi [None req-b670ed6b-0fdf-436a-8ca0-1f57efc1957f admin admin] HTTP exception thrown: Flavor 84 could not be found. Nov 01 01:11:17.402180 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi [None req-b670ed6b-0fdf-436a-8ca0-1f57efc1957f admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=101289) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 01 01:11:17.403050 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: INFO nova.api.openstack.requestlog [None req-b670ed6b-0fdf-436a-8ca0-1f57efc1957f admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.010113 Nov 01 01:11:17.403532 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: [pid: 101289|app: 0|req: 23/47] 10.222.0.47 () {60 vars in 1190 bytes} [Mon Nov 1 01:11:17 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 01 01:11:18.889949 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi [None req-f9a49b15-d197-414c-a8f5-a48759b63ee4 admin admin] Calling method '>' {{(pid=101290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:11:18.890977 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: INFO nova.api.openstack.requestlog [None req-f9a49b15-d197-414c-a8f5-a48759b63ee4 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 Nov 01 01:11:18.891372 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: [pid: 101290|app: 0|req: 25/48] 10.222.0.47 () {56 vars in 1074 bytes} [Mon Nov 1 01:11:18 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:11:19.085351 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi [None req-1cc97e2f-6605-49b1-b118-4cb555ecf3ec admin admin] Calling method '>' {{(pid=101289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:11:19.091406 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: INFO nova.api.openstack.wsgi [None req-1cc97e2f-6605-49b1-b118-4cb555ecf3ec admin admin] HTTP exception thrown: Flavor 451 could not be found. Nov 01 01:11:19.091965 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi [None req-1cc97e2f-6605-49b1-b118-4cb555ecf3ec admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=101289) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 01 01:11:19.092738 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: INFO nova.api.openstack.requestlog [None req-1cc97e2f-6605-49b1-b118-4cb555ecf3ec admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.057402 Nov 01 01:11:19.093230 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: [pid: 101289|app: 0|req: 24/49] 10.222.0.47 () {60 vars in 1193 bytes} [Mon Nov 1 01:11:19 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 01 01:11:19.103557 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi [None req-e3eb3759-095a-4e70-a5ee-5ec7fa8ccb83 admin admin] Calling method '>' {{(pid=101290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:11:19.116609 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: INFO nova.api.openstack.requestlog [None req-e3eb3759-095a-4e70-a5ee-5ec7fa8ccb83 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017217 Nov 01 01:11:19.117197 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: [pid: 101290|app: 0|req: 26/50] 10.222.0.47 () {60 vars in 1210 bytes} [Mon Nov 1 01:11:19 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 01 01:11:19.130986 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi [None req-cfc3ffe3-0ea6-435e-a28a-eda66408a023 admin admin] Calling method '>' {{(pid=101289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:11:19.145041 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: INFO nova.api.openstack.requestlog [None req-cfc3ffe3-0ea6-435e-a28a-eda66408a023 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017693 Nov 01 01:11:19.145576 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: [pid: 101289|app: 0|req: 25/51] 10.222.0.47 () {60 vars in 1210 bytes} [Mon Nov 1 01:11:19 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 01:11:19.156035 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi [None req-aae5fc23-a269-4a9a-934c-bf95d0647c22 admin admin] Calling method '>' {{(pid=101290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:11:19.161458 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: INFO nova.api.openstack.wsgi [None req-aae5fc23-a269-4a9a-934c-bf95d0647c22 admin admin] HTTP exception thrown: Flavor 451 could not be found. Nov 01 01:11:19.162043 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi [None req-aae5fc23-a269-4a9a-934c-bf95d0647c22 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=101290) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 01 01:11:19.162894 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: INFO nova.api.openstack.requestlog [None req-aae5fc23-a269-4a9a-934c-bf95d0647c22 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.010448 Nov 01 01:11:19.163438 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: [pid: 101290|app: 0|req: 27/52] 10.222.0.47 () {60 vars in 1193 bytes} [Mon Nov 1 01:11:19 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 01 01:11:20.607087 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi [None req-cfc3ffe3-0ea6-435e-a28a-eda66408a023 admin admin] Calling method '>' {{(pid=101289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:11:20.608096 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: INFO nova.api.openstack.requestlog [None req-cfc3ffe3-0ea6-435e-a28a-eda66408a023 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001526 Nov 01 01:11:20.608495 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: [pid: 101289|app: 0|req: 26/53] 10.222.0.47 () {56 vars in 1074 bytes} [Mon Nov 1 01:11:20 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:11:20.814056 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi [None req-be0f1eb4-dc97-44c4-8d59-ab3d27e40168 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:11:20.891304 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: INFO nova.api.openstack.requestlog [None req-be0f1eb4-dc97-44c4-8d59-ab3d27e40168 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.129618 Nov 01 01:11:20.891875 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: [pid: 101290|app: 0|req: 28/54] 10.222.0.47 () {64 vars in 1235 bytes} [Mon Nov 1 01:11:20 2021] POST /compute/v2.1/flavors => generated 404 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 01 01:11:22.363819 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi [None req-cfc3ffe3-0ea6-435e-a28a-eda66408a023 admin admin] Calling method '>' {{(pid=101289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:11:22.364818 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: INFO nova.api.openstack.requestlog [None req-cfc3ffe3-0ea6-435e-a28a-eda66408a023 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001418 Nov 01 01:11:22.365242 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: [pid: 101289|app: 0|req: 27/55] 10.222.0.47 () {56 vars in 1074 bytes} [Mon Nov 1 01:11:22 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:11:22.560689 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi [None req-ecf34d77-d50e-4330-9e32-aebd2f1641b2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:11:22.645537 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: INFO nova.api.openstack.requestlog [None req-ecf34d77-d50e-4330-9e32-aebd2f1641b2 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.134974 Nov 01 01:11:22.646006 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: [pid: 101290|app: 0|req: 29/56] 10.222.0.47 () {64 vars in 1235 bytes} [Mon Nov 1 01:11:22 2021] POST /compute/v2.1/flavors => generated 405 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 01 01:11:24.055291 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi [None req-cfc3ffe3-0ea6-435e-a28a-eda66408a023 admin admin] Calling method '>' {{(pid=101289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:11:24.056293 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: INFO nova.api.openstack.requestlog [None req-cfc3ffe3-0ea6-435e-a28a-eda66408a023 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001494 Nov 01 01:11:24.056707 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: [pid: 101289|app: 0|req: 28/57] 10.222.0.47 () {56 vars in 1074 bytes} [Mon Nov 1 01:11:24 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:11:24.244325 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi [None req-dea3a08e-4517-4678-9bbf-eba4eeb66ede admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:11:24.317767 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: INFO nova.api.openstack.requestlog [None req-dea3a08e-4517-4678-9bbf-eba4eeb66ede admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.124007 Nov 01 01:11:24.318237 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: [pid: 101290|app: 0|req: 30/58] 10.222.0.47 () {64 vars in 1235 bytes} [Mon Nov 1 01:11:24 2021] POST /compute/v2.1/flavors => generated 407 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 01 01:11:25.719687 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi [None req-cfc3ffe3-0ea6-435e-a28a-eda66408a023 admin admin] Calling method '>' {{(pid=101289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:11:25.720694 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: INFO nova.api.openstack.requestlog [None req-cfc3ffe3-0ea6-435e-a28a-eda66408a023 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001415 Nov 01 01:11:25.721126 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: [pid: 101289|app: 0|req: 29/59] 10.222.0.47 () {56 vars in 1074 bytes} [Mon Nov 1 01:11:25 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:11:25.910628 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi [None req-048a0184-be89-44a8-b20a-b5f078d02d48 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:11:25.998224 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: INFO nova.api.openstack.requestlog [None req-048a0184-be89-44a8-b20a-b5f078d02d48 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.138816 Nov 01 01:11:25.998729 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: [pid: 101290|app: 0|req: 31/60] 10.222.0.47 () {64 vars in 1235 bytes} [Mon Nov 1 01:11:25 2021] POST /compute/v2.1/flavors => generated 409 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 01 01:11:27.410904 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi [None req-cfc3ffe3-0ea6-435e-a28a-eda66408a023 admin admin] Calling method '>' {{(pid=101289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:11:27.411904 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: INFO nova.api.openstack.requestlog [None req-cfc3ffe3-0ea6-435e-a28a-eda66408a023 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001502 Nov 01 01:11:27.412300 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: [pid: 101289|app: 0|req: 30/61] 10.222.0.47 () {56 vars in 1074 bytes} [Mon Nov 1 01:11:27 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:11:27.599859 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi [None req-0a399357-3584-49e6-8399-b36532318a09 admin admin] Calling method '>' {{(pid=101290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:11:27.619505 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: INFO nova.api.openstack.requestlog [None req-0a399357-3584-49e6-8399-b36532318a09 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.069575 Nov 01 01:11:27.619963 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: [pid: 101290|app: 0|req: 32/62] 10.222.0.47 () {60 vars in 1202 bytes} [Mon Nov 1 01:11:27 2021] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 01:12:13.927410 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi [None req-cfc3ffe3-0ea6-435e-a28a-eda66408a023 admin admin] Calling method '>' {{(pid=101289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:12:13.929007 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: INFO nova.api.openstack.requestlog [None req-cfc3ffe3-0ea6-435e-a28a-eda66408a023 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002041 Nov 01 01:12:13.929436 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: [pid: 101289|app: 0|req: 31/63] 10.222.0.47 () {54 vars in 930 bytes} [Mon Nov 1 01:12:13 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:12:13.985827 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi [None req-2edf8266-77f0-4739-996a-acde3df7d0d7 admin admin] Calling method '>' {{(pid=101290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:12:14.004833 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: INFO nova.api.openstack.requestlog [None req-2edf8266-77f0-4739-996a-acde3df7d0d7 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.068839 Nov 01 01:12:14.005356 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: [pid: 101290|app: 0|req: 33/64] 10.222.0.47 () {60 vars in 1291 bytes} [Mon Nov 1 01:12:13 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 01 01:12:14.028129 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi [None req-dbc28afa-59e7-46dd-8705-54d387be3a65 admin admin] Calling method '>' {{(pid=101289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:12:14.035628 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: INFO nova.api.openstack.requestlog [None req-dbc28afa-59e7-46dd-8705-54d387be3a65 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011022 Nov 01 01:12:14.036148 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: [pid: 101289|app: 0|req: 32/65] 10.222.0.47 () {60 vars in 1282 bytes} [Mon Nov 1 01:12:14 2021] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:12:14.047351 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi [None req-17817881-621e-4c2a-a02f-94704c39a4df admin admin] Calling method '>' {{(pid=101290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:12:14.055200 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: INFO nova.api.openstack.requestlog [None req-17817881-621e-4c2a-a02f-94704c39a4df admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011214 Nov 01 01:12:14.055708 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: [pid: 101290|app: 0|req: 34/66] 10.222.0.47 () {60 vars in 1285 bytes} [Mon Nov 1 01:12:14 2021] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:12:14.068307 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi [None req-fc3afed0-7820-464b-9084-7fa48f8bdf41 admin admin] Calling method '>' {{(pid=101289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:12:14.076306 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: INFO nova.api.openstack.requestlog [None req-fc3afed0-7820-464b-9084-7fa48f8bdf41 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011391 Nov 01 01:12:14.076819 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: [pid: 101289|app: 0|req: 33/67] 10.222.0.47 () {60 vars in 1285 bytes} [Mon Nov 1 01:12:14 2021] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:12:14.088030 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi [None req-e735f928-e4a8-495f-8d25-4e6de1dca4a8 admin admin] Calling method '>' {{(pid=101290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:12:14.095244 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: INFO nova.api.openstack.requestlog [None req-e735f928-e4a8-495f-8d25-4e6de1dca4a8 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010527 Nov 01 01:12:14.095747 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: [pid: 101290|app: 0|req: 35/68] 10.222.0.47 () {60 vars in 1282 bytes} [Mon Nov 1 01:12:14 2021] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 11 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:13:42.641139 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi [None req-3ba4afae-8107-49ff-8273-d0481022aa0b tempest-verify_tempest_config-645991672 tempest-verify_tempest_config-645991672-project] Calling method '>' {{(pid=101289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:13:42.643131 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: INFO nova.api.openstack.requestlog [None req-3ba4afae-8107-49ff-8273-d0481022aa0b tempest-verify_tempest_config-645991672 tempest-verify_tempest_config-645991672-project] 10.222.0.47 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.103339 Nov 01 01:13:42.643705 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: [pid: 101289|app: 0|req: 34/69] 10.222.0.47 () {58 vars in 1133 bytes} [Mon Nov 1 01:13:42 2021] GET /compute/v2.1/extensions => generated 22700 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 01 01:15:11.479546 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi [None req-e735f928-e4a8-495f-8d25-4e6de1dca4a8 admin admin] Calling method '>' {{(pid=101290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:15:11.481132 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: INFO nova.api.openstack.requestlog [None req-e735f928-e4a8-495f-8d25-4e6de1dca4a8 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001992 Nov 01 01:15:11.481512 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: [pid: 101290|app: 0|req: 36/70] 10.222.0.47 () {56 vars in 1074 bytes} [Mon Nov 1 01:15:11 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:15:11.737077 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi [None req-c3753b58-7f0e-450e-bad7-c5c35c9792a0 admin admin] Calling method '>' {{(pid=101289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:15:11.738214 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 01 01:15:11.738214 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: warnings.warn(msg) Nov 01 01:15:11.739947 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG oslo_concurrency.lockutils [None req-c3753b58-7f0e-450e-bad7-c5c35c9792a0 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:15:11.740414 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG oslo_concurrency.lockutils [None req-c3753b58-7f0e-450e-bad7-c5c35c9792a0 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:15:11.741211 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG oslo_concurrency.lockutils [None req-c3753b58-7f0e-450e-bad7-c5c35c9792a0 admin admin] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:15:11.741627 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG oslo_concurrency.lockutils [None req-c3753b58-7f0e-450e-bad7-c5c35c9792a0 admin admin] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:15:11.773597 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: INFO nova.api.openstack.requestlog [None req-c3753b58-7f0e-450e-bad7-c5c35c9792a0 admin admin] 10.222.0.47 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.150176 Nov 01 01:15:11.774146 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: [pid: 101289|app: 0|req: 35/71] 10.222.0.47 () {60 vars in 1193 bytes} [Mon Nov 1 01:15:11 2021] GET /compute/v2.1/os-services => generated 791 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 01 01:15:13.194999 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi [None req-e735f928-e4a8-495f-8d25-4e6de1dca4a8 admin admin] Calling method '>' {{(pid=101290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:15:13.195995 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: INFO nova.api.openstack.requestlog [None req-e735f928-e4a8-495f-8d25-4e6de1dca4a8 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Nov 01 01:15:13.196389 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: [pid: 101290|app: 0|req: 37/72] 10.222.0.47 () {56 vars in 1074 bytes} [Mon Nov 1 01:15:13 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:15:13.387403 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi [None req-f9164ce3-0251-45b6-803a-170746e1ffa3 admin admin] Calling method '>' {{(pid=101289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:15:13.388567 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 01 01:15:13.388567 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: warnings.warn(msg) Nov 01 01:15:13.390059 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG oslo_concurrency.lockutils [None req-f9164ce3-0251-45b6-803a-170746e1ffa3 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:15:13.390515 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG oslo_concurrency.lockutils [None req-f9164ce3-0251-45b6-803a-170746e1ffa3 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:15:13.391283 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG oslo_concurrency.lockutils [None req-f9164ce3-0251-45b6-803a-170746e1ffa3 admin admin] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:15:13.391697 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG oslo_concurrency.lockutils [None req-f9164ce3-0251-45b6-803a-170746e1ffa3 admin admin] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:15:13.409877 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: INFO nova.api.openstack.requestlog [None req-f9164ce3-0251-45b6-803a-170746e1ffa3 admin admin] 10.222.0.47 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.074601 Nov 01 01:15:13.410354 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: [pid: 101289|app: 0|req: 36/73] 10.222.0.47 () {60 vars in 1193 bytes} [Mon Nov 1 01:15:13 2021] GET /compute/v2.1/os-services => generated 791 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 01 01:15:25.273354 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi [None req-e735f928-e4a8-495f-8d25-4e6de1dca4a8 admin admin] Calling method '>' {{(pid=101290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:15:25.274343 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: INFO nova.api.openstack.requestlog [None req-e735f928-e4a8-495f-8d25-4e6de1dca4a8 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001417 Nov 01 01:15:25.274787 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: [pid: 101290|app: 0|req: 38/74] 10.222.0.47 () {56 vars in 1074 bytes} [Mon Nov 1 01:15:25 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:15:25.463935 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi [None req-84f31313-1a0a-4a80-aa89-53c75d609ddb admin admin] Calling method '>' {{(pid=101289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:15:25.465084 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 01 01:15:25.465084 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: warnings.warn(msg) Nov 01 01:15:25.467182 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG oslo_concurrency.lockutils [None req-84f31313-1a0a-4a80-aa89-53c75d609ddb admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:15:25.467614 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG oslo_concurrency.lockutils [None req-84f31313-1a0a-4a80-aa89-53c75d609ddb admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:15:25.468387 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG oslo_concurrency.lockutils [None req-84f31313-1a0a-4a80-aa89-53c75d609ddb admin admin] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:15:25.468807 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG oslo_concurrency.lockutils [None req-84f31313-1a0a-4a80-aa89-53c75d609ddb admin admin] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:15:25.492764 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: INFO nova.api.openstack.requestlog [None req-84f31313-1a0a-4a80-aa89-53c75d609ddb admin admin] 10.222.0.47 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.079610 Nov 01 01:15:25.493247 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: [pid: 101289|app: 0|req: 37/75] 10.222.0.47 () {60 vars in 1193 bytes} [Mon Nov 1 01:15:25 2021] GET /compute/v2.1/os-services => generated 1011 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 01:15:26.920709 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: DEBUG nova.api.openstack.wsgi [None req-e735f928-e4a8-495f-8d25-4e6de1dca4a8 admin admin] Calling method '>' {{(pid=101290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:15:26.922544 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: INFO nova.api.openstack.requestlog [None req-e735f928-e4a8-495f-8d25-4e6de1dca4a8 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002761 Nov 01 01:15:26.923268 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: [pid: 101290|app: 0|req: 39/76] 10.222.0.47 () {56 vars in 1074 bytes} [Mon Nov 1 01:15:26 2021] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:15:27.116582 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG nova.api.openstack.wsgi [None req-f21db4a2-01e0-4b7d-8099-5d86c9d2b243 admin admin] Calling method '>' {{(pid=101289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:15:27.117723 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 01 01:15:27.117723 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: warnings.warn(msg) Nov 01 01:15:27.119287 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG oslo_concurrency.lockutils [None req-f21db4a2-01e0-4b7d-8099-5d86c9d2b243 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:15:27.119725 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG oslo_concurrency.lockutils [None req-f21db4a2-01e0-4b7d-8099-5d86c9d2b243 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:15:27.120510 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG oslo_concurrency.lockutils [None req-f21db4a2-01e0-4b7d-8099-5d86c9d2b243 admin admin] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:15:27.120962 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: DEBUG oslo_concurrency.lockutils [None req-f21db4a2-01e0-4b7d-8099-5d86c9d2b243 admin admin] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:15:27.142469 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: INFO nova.api.openstack.requestlog [None req-f21db4a2-01e0-4b7d-8099-5d86c9d2b243 admin admin] 10.222.0.47 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.077502 Nov 01 01:15:27.142963 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: [pid: 101289|app: 0|req: 38/77] 10.222.0.47 () {60 vars in 1193 bytes} [Mon Nov 1 01:15:27 2021] GET /compute/v2.1/os-services => generated 1011 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 01:16:24.797001 dv-cinder-815614-2-iscsi devstack@n-api.service[101288]: Mon Nov 1 01:16:24 2021 - graceful shutdown triggered... Nov 01 01:16:24.797055 dv-cinder-815614-2-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Nov 01 01:16:24.798130 dv-cinder-815614-2-iscsi devstack@n-api.service[101289]: Gracefully killing worker 1 (pid: 101289)... Nov 01 01:16:24.798538 dv-cinder-815614-2-iscsi devstack@n-api.service[101290]: Gracefully killing worker 2 (pid: 101290)... Nov 01 01:16:25.799218 dv-cinder-815614-2-iscsi devstack@n-api.service[101288]: worker 1 buried after 1 seconds Nov 01 01:16:25.799764 dv-cinder-815614-2-iscsi devstack@n-api.service[101288]: worker 2 buried after 1 seconds Nov 01 01:16:25.799764 dv-cinder-815614-2-iscsi devstack@n-api.service[101288]: goodbye to uWSGI. Nov 01 01:16:25.800864 dv-cinder-815614-2-iscsi systemd[1]: devstack@n-api.service: Succeeded. Nov 01 01:16:25.801417 dv-cinder-815614-2-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Nov 01 01:16:25.804213 dv-cinder-815614-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Nov 01 01:16:25.814262 dv-cinder-815614-2-iscsi devstack@n-api.service[116249]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Nov 01 01:16:25.816271 dv-cinder-815614-2-iscsi devstack@n-api.service[116249]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Nov 1 01:16:25 2021] *** Nov 01 01:16:25.816271 dv-cinder-815614-2-iscsi devstack@n-api.service[116249]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Nov 01 01:16:25.816271 dv-cinder-815614-2-iscsi devstack@n-api.service[116249]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Nov 01 01:16:25.816271 dv-cinder-815614-2-iscsi devstack@n-api.service[116249]: nodename: dv-cinder-815614-2-iscsi Nov 01 01:16:25.816271 dv-cinder-815614-2-iscsi devstack@n-api.service[116249]: machine: x86_64 Nov 01 01:16:25.816271 dv-cinder-815614-2-iscsi devstack@n-api.service[116249]: clock source: unix Nov 01 01:16:25.816271 dv-cinder-815614-2-iscsi devstack@n-api.service[116249]: pcre jit disabled Nov 01 01:16:25.816271 dv-cinder-815614-2-iscsi devstack@n-api.service[116249]: detected number of CPU cores: 4 Nov 01 01:16:25.816271 dv-cinder-815614-2-iscsi devstack@n-api.service[116249]: current working directory: / Nov 01 01:16:25.816271 dv-cinder-815614-2-iscsi devstack@n-api.service[116249]: detected binary path: /usr/bin/uwsgi-core Nov 01 01:16:25.816951 dv-cinder-815614-2-iscsi devstack@n-api.service[116249]: your processes number limit is 47680 Nov 01 01:16:25.816951 dv-cinder-815614-2-iscsi devstack@n-api.service[116249]: your memory page size is 4096 bytes Nov 01 01:16:25.816951 dv-cinder-815614-2-iscsi devstack@n-api.service[116249]: detected max file descriptor number: 2048 Nov 01 01:16:25.816951 dv-cinder-815614-2-iscsi devstack@n-api.service[116249]: lock engine: pthread robust mutexes Nov 01 01:16:25.816951 dv-cinder-815614-2-iscsi devstack@n-api.service[116249]: thunder lock: enabled Nov 01 01:16:25.816951 dv-cinder-815614-2-iscsi devstack@n-api.service[116249]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Nov 01 01:16:25.816951 dv-cinder-815614-2-iscsi devstack@n-api.service[116249]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Nov 01 01:16:25.862092 dv-cinder-815614-2-iscsi devstack@n-api.service[116249]: Python main interpreter initialized at 0x55937698e9c0 Nov 01 01:16:25.862092 dv-cinder-815614-2-iscsi devstack@n-api.service[116249]: python threads support enabled Nov 01 01:16:25.862092 dv-cinder-815614-2-iscsi devstack@n-api.service[116249]: your server socket listen backlog is limited to 100 connections Nov 01 01:16:25.862092 dv-cinder-815614-2-iscsi devstack@n-api.service[116249]: your mercy for graceful operations on workers is 90 seconds Nov 01 01:16:25.862533 dv-cinder-815614-2-iscsi devstack@n-api.service[116249]: mapped 403077 bytes (393 KB) for 2 cores Nov 01 01:16:25.862533 dv-cinder-815614-2-iscsi devstack@n-api.service[116249]: *** Operational MODE: preforking *** Nov 01 01:16:25.862854 dv-cinder-815614-2-iscsi devstack@n-api.service[116249]: *** uWSGI is running in multiple interpreter mode *** Nov 01 01:16:25.862854 dv-cinder-815614-2-iscsi devstack@n-api.service[116249]: spawned uWSGI master process (pid: 116249) Nov 01 01:16:25.863057 dv-cinder-815614-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Nov 01 01:16:25.866591 dv-cinder-815614-2-iscsi devstack@n-api.service[116249]: spawned uWSGI worker 1 (pid: 116266, cores: 1) Nov 01 01:16:25.866591 dv-cinder-815614-2-iscsi devstack@n-api.service[116249]: spawned uWSGI worker 2 (pid: 116267, cores: 1) Nov 01 01:16:25.866591 dv-cinder-815614-2-iscsi devstack@n-api.service[116249]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Nov 01 01:16:27.681198 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 01 01:16:27.681198 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: from cryptography.utils import int_from_bytes Nov 01 01:16:27.681873 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 01 01:16:27.681873 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: from cryptography.utils import int_from_bytes Nov 01 01:16:27.698742 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 01 01:16:27.698742 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: from cryptography.utils import int_from_bytes Nov 01 01:16:27.699347 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 01 01:16:27.699347 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: from cryptography.utils import int_from_bytes Nov 01 01:16:30.238663 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 01 01:16:30.239269 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 01 01:16:30.239558 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 01 01:16:30.239976 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 01 01:16:30.240242 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 01 01:16:30.240686 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.241025 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.241356 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.241683 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.242021 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.242361 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.242712 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.243040 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.243378 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.243647 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.243971 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.244305 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-815614-2-iscsi {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.244631 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.244949 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.245269 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.245595 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.245906 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.246235 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.246572 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.247090 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.247553 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.247871 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.248191 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.248543 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.248906 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.249491 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.249837 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.250153 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.250503 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.250826 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.251246 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-815614-2-iscsi {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.251574 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.251897 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.252222 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.252658 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.252980 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.253297 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.253624 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.253952 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.254284 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.254653 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.254981 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.255307 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.255632 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.255940 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.256257 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.256575 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.256903 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.257215 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.257526 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.257783 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.258098 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.258447 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.258782 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.259117 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.259376 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.259638 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.259964 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.260292 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.260609 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.260925 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.261238 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.261552 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.261865 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.262176 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.262599 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.263581 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.263581 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.263581 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.264045 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.264190 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.264556 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.264972 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.47 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.265228 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.47 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.265542 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.265898 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.266227 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.266617 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.266895 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.268181 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.268181 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.268181 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.268181 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.269487 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.269487 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.269487 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.269487 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.269793 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.269886 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.270443 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.270573 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.270851 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.271240 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.271546 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.271859 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.272174 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.272487 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.272800 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.273113 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.273426 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.273739 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.274054 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.274366 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.274730 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.275060 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.275376 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.275688 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.276001 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.276315 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.276641 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.276954 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.277319 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.277597 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.277910 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.278224 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.278578 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.278894 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.279208 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.279539 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.279846 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.280699 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.281024 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.281342 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.281653 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.281967 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.282281 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.282621 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.282937 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.283248 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.283559 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.283864 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.284190 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.284517 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.284835 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.285147 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.285462 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.285787 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.286133 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.286499 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.286856 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.287179 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.287522 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.287862 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.288191 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.288515 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.288843 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.289184 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.289506 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.289828 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.290157 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.290506 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.290838 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.291187 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.291532 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.292048 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.292384 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.292757 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.293081 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.293964 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.293964 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.294306 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.294583 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.294966 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.295260 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.295593 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.296494 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.296829 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.297155 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.297490 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.298468 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.298468 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.298468 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.298848 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.299129 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.299464 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.299791 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.300110 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.300421 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.300733 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.301052 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.301366 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.301700 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.302035 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.302350 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.302720 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.303037 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.303358 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.303681 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.303997 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.304312 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.304637 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.304951 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.305282 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.305601 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.305913 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.306243 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.306581 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.306896 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.307222 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.307543 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.307860 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.308176 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.308510 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.308830 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.309147 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.309502 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.309834 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.310156 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.310515 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.310854 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.311178 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.311543 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.311897 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.312218 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.312534 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.312848 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.313168 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.313480 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.313794 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.314105 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.314417 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.314757 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.315090 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.315413 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.315728 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.316041 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.316352 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.316708 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.317030 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.317371 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.317718 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.318051 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.318380 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.318730 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.319057 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.319377 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.319697 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.320018 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.320341 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.320666 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.320988 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.321318 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.321639 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.321974 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.322293 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.322647 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.322962 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.323291 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.323639 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.323985 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.324311 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.324643 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.324977 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.325289 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.325611 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.325929 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.326243 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.326582 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.326744 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 01 01:16:30.327750 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.327919 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 01 01:16:30.328081 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.328228 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 01 01:16:30.328379 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.328532 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 01 01:16:30.328685 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.328834 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 01 01:16:30.328977 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.329116 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.329262 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.329403 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.329554 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.329704 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.329844 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.330000 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.330153 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.330328 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.330514 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.330668 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.330818 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.330960 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.331110 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.331260 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.331408 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.331556 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.331703 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.331844 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.332003 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.332156 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.332309 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.332457 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-815614-2-iscsi {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.332833 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.333011 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.333166 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.333321 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.333470 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.333779 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.333930 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.334079 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.334228 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.334382 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.334564 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.334724 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.334874 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.335023 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.335174 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.335174 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.335536 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.335697 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.335845 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.336020 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.336785 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.336949 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.337106 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.337255 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.337402 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.337545 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.337692 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.337854 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.338046 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.338394 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.338581 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.338733 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.338881 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.339035 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.339179 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.339331 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.339606 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.339789 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.339954 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-815614-2-iscsi {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.340109 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.340263 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.340406 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.340561 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.340717 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.340858 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.340999 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.341138 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.346330 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.346565 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.346808 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.346973 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.347127 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.347270 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.349311 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.349489 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.349657 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.349806 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.349959 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.350111 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.350255 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.350442 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.350607 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.350758 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.350901 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.351040 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.351187 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.351342 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.351483 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.351622 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.351770 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.351917 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.352058 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.352206 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.352364 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.352505 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.352661 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.352811 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.352959 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.353112 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.353253 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.353422 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.353565 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.353705 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.353855 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.354042 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.354206 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.354355 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.354525 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.354679 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.354679 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.354967 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.355106 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.355246 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.355386 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.355386 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.355667 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.355816 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.355968 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.356107 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.356246 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.356393 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.356542 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.356683 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.356822 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.356970 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.357110 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.357110 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.357392 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.357828 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.357998 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.358148 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.358297 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.358499 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.358659 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.358802 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.358941 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.359150 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.359446 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.359603 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.359757 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.359899 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.360061 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.47 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.365456 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.366209 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.47 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.366366 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.366565 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.366725 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.366878 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.367037 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.367189 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.367339 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.367481 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.367649 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.367836 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.368010 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.368173 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.368315 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.368470 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.369662 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.369821 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.369974 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.370127 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.370277 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.370449 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.370601 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.370754 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.370905 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.371057 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.371199 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.371348 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.371490 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.371632 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.371779 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.371920 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.372061 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.372210 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.372352 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.372494 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.372643 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.372783 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.372942 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.373085 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.373232 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.373380 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.373535 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.373693 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.373866 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.374278 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.374508 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.374669 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.374669 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.374949 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.375110 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.375259 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.375406 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.375662 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.375810 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.375957 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.376113 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.376256 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.376404 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.376547 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.376737 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.376896 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.377046 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.377205 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.377354 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.377505 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.377655 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.377804 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.377955 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.378097 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.378244 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.378392 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.378571 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.378722 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.378863 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.379085 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.379252 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.379806 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.379959 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.380101 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.380250 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.380411 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.380554 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.380695 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.380843 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.380992 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.381134 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.381290 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.381440 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.381598 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.381746 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.381893 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.382047 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.382204 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.382352 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.382522 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.382670 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.382817 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.382982 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.383139 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.383295 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.383451 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.383613 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.383767 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.383924 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.384074 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.384222 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.384370 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.384517 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.384664 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.384819 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.384974 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.385129 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.385284 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.385451 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.385601 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.385870 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.386080 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.386237 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.386386 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.386589 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.386748 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.386903 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.387051 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.387204 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.387352 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.387507 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 01 01:16:30.387675 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.387830 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.387989 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.388139 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.388286 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.388286 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.388581 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.388730 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.388883 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.389030 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.389185 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.390197 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.390361 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.390607 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.390769 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.390920 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.391075 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.391237 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.391394 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.391544 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.391705 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.391861 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.392010 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.392170 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.392330 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.392489 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.392637 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.392785 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.392939 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.393096 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.393244 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.393391 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.393538 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.393685 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.393842 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.393991 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.394146 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.394295 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.394482 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.394648 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.394810 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.394959 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.395106 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.395261 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.395416 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.395571 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.395730 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.395896 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.396142 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.396306 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.396306 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.396606 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.396765 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.396934 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.397091 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.397417 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.397575 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.397732 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.397896 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.398056 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.398205 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.398361 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.398750 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.398925 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.399088 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.399244 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.399400 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.399557 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.399718 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.399875 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.400447 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.400612 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.400803 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.400965 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.401116 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.401276 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.401437 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.401592 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.401748 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.401896 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.402083 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.402245 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.402401 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.402574 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.402741 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.403441 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.403625 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.403776 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.403925 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.404232 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.404402 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.404552 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.404715 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.404872 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.405066 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.405224 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.405380 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.405528 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.405686 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.405835 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.405990 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.406138 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.406297 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.406618 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.406791 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.406942 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.407089 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.407237 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.407392 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.407549 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.407697 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.407849 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.408008 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.408157 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.408306 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.408473 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.408621 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.408775 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.408775 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.409064 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.409219 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.409383 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.409538 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.409686 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.409839 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.409986 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.410158 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.410807 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.411072 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.411248 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.411248 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.411540 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.411767 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.411925 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.412074 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.412220 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.412375 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.412531 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.412688 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.412837 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.413007 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.413162 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.413323 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.413471 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.413633 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.413782 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.413929 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.414083 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.414231 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.414378 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.414560 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.414712 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.414859 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.415015 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.415169 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.415325 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.415474 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.415621 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.415776 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.415925 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.416072 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.416227 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.416383 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.416538 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.416797 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.416953 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.417119 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.417278 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.417426 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.417573 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.417573 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.417868 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.417868 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.418167 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.418315 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.418493 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.418493 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.418790 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.418956 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.419105 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.419253 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.419400 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.419554 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.419702 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.419859 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.420014 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.420169 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.420336 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.420336 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.421560 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.421560 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.421865 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.421865 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.422145 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.422292 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.422498 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.422671 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.422831 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.422989 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.423138 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.423298 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.423599 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.426174 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.426350 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.426350 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.426766 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.426919 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.427097 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.427342 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.427504 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.427662 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.427811 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.427958 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.428119 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.428276 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.428452 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.429161 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.429333 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.429483 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.429642 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.429792 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.429947 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.430094 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.430248 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.430411 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.430790 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.430967 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.431119 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.431552 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.431729 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.431888 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.432044 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.432192 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.432347 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.432496 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.432644 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.432801 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.432950 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.433097 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.433245 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.433399 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.433573 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.433812 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.433974 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.434123 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.434278 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.434445 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.434617 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.434768 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.434927 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.435076 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.435223 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.435370 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.435549 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.436865 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.437043 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.437194 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.437371 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.437621 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.437792 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.437949 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.438097 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.438251 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.438403 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.438636 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.438797 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.438953 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.439103 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.439268 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.439417 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.439573 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.439722 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.439931 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.440103 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.440253 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.440401 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.440556 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.440705 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.441005 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.441159 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.441344 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.441700 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.441874 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.442025 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.442187 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.442344 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.442526 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.442678 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.442836 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.442986 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.443132 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.443280 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.443434 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.443606 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.443778 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.444000 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.444153 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.444301 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.444448 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.444604 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.444760 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.444915 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.445071 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.445219 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.445373 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.445529 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.445693 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.445842 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.445989 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.446137 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.446290 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.446466 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.446632 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.446781 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.446928 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.447077 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.447306 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.447457 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.447621 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.447876 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.448037 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.448187 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.448351 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.448510 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.448658 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.448806 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.448959 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.449107 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.449264 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.449420 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.449568 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.449726 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.449881 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.450083 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.450247 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.450397 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.450611 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.450769 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.450877 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.451004 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.451098 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.451182 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.451270 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.451359 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.451437 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.451514 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.451920 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.452067 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.452196 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.452288 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.452360 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.452448 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.452526 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.452596 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.452664 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.452732 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.452807 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.452889 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.452960 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.452960 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.453089 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.453159 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.453240 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.453310 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.453377 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.453453 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.453523 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.453597 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.453678 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.453678 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.453810 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.453881 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.453949 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.454046 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.454125 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.454196 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.454263 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.454330 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.454397 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.454487 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.454574 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.454655 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.454724 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.454798 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.454867 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.454944 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.455016 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.455083 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.455157 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.455225 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.455292 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.455367 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.455443 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.455511 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.455578 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.455651 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.455720 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.455800 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.455878 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.455946 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.456086 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.456166 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.456244 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.456321 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.456397 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.456473 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.456542 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.456609 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.456697 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.456768 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.456836 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.456910 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.456979 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.457047 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.457122 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.457191 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.457259 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.457334 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.457403 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.457478 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.457547 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.457621 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.457696 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.457778 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.458012 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.458109 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.458189 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.458261 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.458336 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.458440 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.458516 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.458585 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.458653 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.458804 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.458886 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.458957 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.459025 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.459025 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.459163 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.459233 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.459327 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.459404 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.459475 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.459542 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.459616 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.459686 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.459766 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.459842 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.459911 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.459978 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.460052 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.460129 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.460199 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.460266 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.460334 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.460400 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.460467 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.460543 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.460619 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.460687 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.460755 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.460821 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.460895 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.460980 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.461051 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.461125 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.461261 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.461333 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.461401 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.461480 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.461557 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.461625 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.462086 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.462189 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.462269 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.462346 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.462449 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.462537 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.462615 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.462698 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.462698 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.462823 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.462899 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.462968 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.463042 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.463120 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.463190 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.463257 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.463331 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.463401 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.463481 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.463557 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.463557 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.463557 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.463557 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.463557 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.463881 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.463959 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.464042 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.464181 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.464261 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.464340 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.464417 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.464489 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.464563 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.464634 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.464708 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.464777 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.464905 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.464991 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.465063 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.465139 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.465215 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.465294 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.465371 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.465441 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.465510 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.465590 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.465666 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.465743 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.465824 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.465895 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.465969 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.466040 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.466159 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.466251 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.466329 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.466400 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.466498 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.466578 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.466647 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.466727 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.466870 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.466943 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.467018 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.467088 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.467088 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.467224 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.467292 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.467366 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.467441 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.467583 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.467583 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.467735 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.467854 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.467944 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.468186 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.468288 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.468388 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.468474 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.468545 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.468613 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.468699 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.468779 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.468857 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.468928 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.468996 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.469064 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.469138 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.469220 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.469290 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.469359 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.469434 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.469510 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.469586 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.469586 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.469792 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.469861 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.469930 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.469997 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.470064 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.470140 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.470217 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.470287 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.470354 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.470665 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.470751 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.470841 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.470914 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.470993 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.471064 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.471133 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.471209 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.471209 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.471209 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.471209 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.471209 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.471512 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.471589 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.471589 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.471730 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.471800 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.471896 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.472248 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.472334 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.472407 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.472477 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.472553 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.472697 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.472771 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.472849 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.472919 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.472994 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.473065 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.473140 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.473218 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.473289 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.473357 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.473432 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.473502 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.473570 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.473651 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.473729 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.473806 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.473881 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.473950 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.474019 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.474099 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.474175 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.474251 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.474320 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.474389 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.474499 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.474573 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.474642 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.474770 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.474848 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.474925 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.475068 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.475141 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.475209 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.475283 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.475353 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.475421 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.475497 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.475567 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.475641 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.475716 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.475784 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.475859 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.475936 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.476012 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.476087 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.476163 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.476239 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.476325 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.476402 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.476477 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.476552 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.476621 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.476844 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.476951 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.477080 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.477197 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.477724 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.477880 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.478040 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.478217 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.478566 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.478717 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.478877 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.479025 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.479025 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.479331 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.479486 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.479634 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.479781 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.479928 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.480089 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.480254 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.480993 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.481163 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.481321 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.481490 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.481648 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.481806 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.481955 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.482388 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.482645 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.482797 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.482976 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.483668 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.483825 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.483983 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.484132 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.484384 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.484562 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.484713 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.484862 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.485010 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.485010 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.485309 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.485459 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.485607 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.485607 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.485902 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.486052 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.486213 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.486375 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.486549 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.486709 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.486866 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.487030 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.487180 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.487337 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.487485 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.487640 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.487796 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.487796 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.487796 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.488250 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.488489 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.488658 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.488658 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.488965 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.489121 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.489271 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.489419 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.489566 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.489714 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.489876 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.490026 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.490182 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.490182 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.490525 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.490715 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.490873 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.491029 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.491186 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.491334 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.491490 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.491653 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.491809 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.491965 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.492122 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.492566 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.492741 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.492902 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.493053 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 01 01:16:30.493212 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.493212 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.493212 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.493212 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.493212 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.493909 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.493909 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.494198 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.494356 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.494676 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.494988 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.495308 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.495625 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.495943 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.496255 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.496635 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.497385 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.497385 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.497691 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.497953 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.498369 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.498797 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.499611 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.499943 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.500263 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.500575 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.500887 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.501196 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.501546 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.501857 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.502186 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.502636 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.502880 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.503195 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.503537 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.503872 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.504273 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.504520 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.504851 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.505162 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.505471 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.505790 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.506098 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.506409 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.506790 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.507054 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.507362 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.507671 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.508008 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.508335 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.508662 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.508967 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.509284 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.509593 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.509902 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.510208 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.511268 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.511268 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.511268 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.511734 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.511896 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.512184 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.512781 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.512781 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.513209 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.513432 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.513723 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.514045 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.514398 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.514745 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.515849 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.515849 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.515849 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.516464 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.516464 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.516969 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_db.sqlalchemy.engines [None req-99ebde51-1c4c-4f26-8bae-3e70e9a93e96 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116267) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 01 01:16:30.517142 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.517431 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.518470 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.518470 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.518470 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.518780 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.519023 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.519336 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.519659 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.519979 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.520298 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.520634 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.520962 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.522480 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.522480 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.522480 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.522480 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.522821 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.522966 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.523340 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.523663 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.523975 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.524302 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.524823 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.524997 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.525247 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.525641 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.525878 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.526200 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.526549 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.526943 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.527238 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.527494 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.527828 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.528172 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.528509 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.528961 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.529288 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.529614 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.530257 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.530574 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.530913 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.531246 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.531575 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.531901 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.532224 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.532558 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.532870 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.533179 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.533496 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.533813 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.534129 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.534477 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.534798 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.535109 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.535437 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.535754 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.536292 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.536652 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.536978 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.537316 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.537650 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.537975 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.538291 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.538649 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.538964 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.539277 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.539599 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.539914 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.540225 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.540519 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.540837 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.541151 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.541461 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.541778 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.542082 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.542415 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.542746 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.543060 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.543370 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.543687 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.543996 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.544312 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.544622 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.544931 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.545248 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.545557 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.546398 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.546733 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.547050 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.547359 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.547678 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.547988 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.548317 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.548624 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.548932 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.549255 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.549572 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.549902 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.550224 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.550576 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.550936 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.551260 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.551794 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.552182 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.552529 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.552888 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.553237 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.553553 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.553877 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.554188 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.556653 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.557007 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.557355 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.557702 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.558383 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.558383 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.558714 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.559045 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.559374 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.559702 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.560116 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.560392 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.560725 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.561055 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.561952 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.562311 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.562749 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.563078 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.563399 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.563730 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.564075 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.564396 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.564722 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.565162 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.565503 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.565843 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.566173 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.566519 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.566853 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.567200 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.567508 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.567838 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.568159 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.568501 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.568852 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.569191 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.569522 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.569835 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.570146 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.570477 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.570801 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.571143 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.571468 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.571798 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.572116 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.572446 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.572761 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.573090 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.573528 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.573796 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.574112 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.574470 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.574797 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.583402 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.583402 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.583402 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.583402 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.583402 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.583402 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.583402 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.583402 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.584042 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.584042 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.584042 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.584042 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.584042 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.584042 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.584042 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.584042 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.584694 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.584694 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.584694 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.584694 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.584694 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.584694 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.584694 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.584694 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.585352 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.585352 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.585352 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.585352 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 01 01:16:30.585352 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 01 01:16:30.599453 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.context [None req-99ebde51-1c4c-4f26-8bae-3e70e9a93e96 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),4c03a77a-7438-491d-92a6-ffcc24307f49(cell1) {{(pid=116267) load_cells /opt/stack/nova/nova/context.py:464}} Nov 01 01:16:30.603952 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-99ebde51-1c4c-4f26-8bae-3e70e9a93e96 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:16:30.605564 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-99ebde51-1c4c-4f26-8bae-3e70e9a93e96 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:16:30.606025 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_db.sqlalchemy.engines [None req-7274fbdb-05dd-43d5-b5f6-a19c5b05321d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116266) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 01 01:16:30.606403 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-99ebde51-1c4c-4f26-8bae-3e70e9a93e96 None None] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:16:30.608933 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-99ebde51-1c4c-4f26-8bae-3e70e9a93e96 None None] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:16:30.620052 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_db.sqlalchemy.engines [None req-99ebde51-1c4c-4f26-8bae-3e70e9a93e96 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116267) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 01 01:16:30.620813 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_db.sqlalchemy.engines [None req-99ebde51-1c4c-4f26-8bae-3e70e9a93e96 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116267) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 01 01:16:30.688965 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.context [None req-7274fbdb-05dd-43d5-b5f6-a19c5b05321d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),4c03a77a-7438-491d-92a6-ffcc24307f49(cell1) {{(pid=116266) load_cells /opt/stack/nova/nova/context.py:464}} Nov 01 01:16:30.693379 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7274fbdb-05dd-43d5-b5f6-a19c5b05321d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:16:30.694986 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7274fbdb-05dd-43d5-b5f6-a19c5b05321d None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:16:30.695793 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7274fbdb-05dd-43d5-b5f6-a19c5b05321d None None] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:16:30.697715 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7274fbdb-05dd-43d5-b5f6-a19c5b05321d None None] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:16:30.708280 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_db.sqlalchemy.engines [None req-7274fbdb-05dd-43d5-b5f6-a19c5b05321d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116266) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 01 01:16:30.709285 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_db.sqlalchemy.engines [None req-7274fbdb-05dd-43d5-b5f6-a19c5b05321d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116266) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 01 01:16:30.883323 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_db.sqlalchemy.engines [None req-99ebde51-1c4c-4f26-8bae-3e70e9a93e96 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116267) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 01 01:16:30.969553 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_db.sqlalchemy.engines [None req-7274fbdb-05dd-43d5-b5f6-a19c5b05321d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116266) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 01 01:16:31.208500 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: WARNING keystonemiddleware.auth_token [None req-99ebde51-1c4c-4f26-8bae-3e70e9a93e96 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 01 01:16:31.215257 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: WARNING keystonemiddleware.auth_token [None req-99ebde51-1c4c-4f26-8bae-3e70e9a93e96 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 01 01:16:31.294817 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: WARNING keystonemiddleware.auth_token [None req-7274fbdb-05dd-43d5-b5f6-a19c5b05321d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 01 01:16:31.301993 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: WARNING keystonemiddleware.auth_token [None req-7274fbdb-05dd-43d5-b5f6-a19c5b05321d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 01 01:16:31.565194 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: WARNING keystonemiddleware.auth_token [None req-99ebde51-1c4c-4f26-8bae-3e70e9a93e96 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 01 01:16:31.570499 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: WARNING keystonemiddleware.auth_token [None req-99ebde51-1c4c-4f26-8bae-3e70e9a93e96 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 01 01:16:31.575636 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55937698e9c0 pid: 116267 (default app) Nov 01 01:16:31.650607 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: WARNING keystonemiddleware.auth_token [None req-7274fbdb-05dd-43d5-b5f6-a19c5b05321d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 01 01:16:31.656545 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: WARNING keystonemiddleware.auth_token [None req-7274fbdb-05dd-43d5-b5f6-a19c5b05321d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 01 01:16:31.661654 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55937698e9c0 pid: 116266 (default app) Nov 01 01:17:07.076510 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-05575478-ab1b-45b5-9923-ce608c240e95 tempest-VolumesGetTestJSON-1384663558 tempest-VolumesGetTestJSON-1384663558-project] Action: 'create', calling method: .version_select at 0x7fccf816bf70>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-810976163", "metadata": {"Type": "work"}}} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:17:07.484292 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-5ff06170-0372-4992-a180-3afa164fd3c5 tempest-VolumesSnapshotsTestJSON-1221600107 tempest-VolumesSnapshotsTestJSON-1221600107-project] Action: 'create', calling method: .version_select at 0x7fccf81eaf70>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-120659777"}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:17:10.194818 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-05575478-ab1b-45b5-9923-ce608c240e95 tempest-VolumesGetTestJSON-1384663558 tempest-VolumesGetTestJSON-1384663558-project] 10.222.0.47 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 4.411822 Nov 01 01:17:10.195725 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1/1] 10.222.0.47 () {60 vars in 1155 bytes} [Mon Nov 1 01:17:05 2021] POST /compute/v2.1/os-volumes => generated 352 bytes in 4414 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Nov 01 01:17:10.268563 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-5ff06170-0372-4992-a180-3afa164fd3c5 tempest-VolumesSnapshotsTestJSON-1221600107 tempest-VolumesSnapshotsTestJSON-1221600107-project] 10.222.0.47 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 4.134782 Nov 01 01:17:10.269235 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1/2] 10.222.0.47 () {60 vars in 1154 bytes} [Mon Nov 1 01:17:06 2021] POST /compute/v2.1/os-volumes => generated 344 bytes in 4137 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Nov 01 01:17:10.280509 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-7d6c99d1-7208-4e51-b7e9-18e9ef4b64e4 tempest-VolumesTestJSON-1614519275 tempest-VolumesTestJSON-1614519275-project] Calling method '.version_select at 0x7fccf8047af0>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:17:10.329872 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-7d6c99d1-7208-4e51-b7e9-18e9ef4b64e4 tempest-VolumesTestJSON-1614519275 tempest-VolumesTestJSON-1614519275-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/3477dd16-c19a-4d59-a11e-13ebb32f14f3" status: 200 len: 351 microversion: 2.1 time: 0.053091 Nov 01 01:17:10.330710 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 2/3] 10.222.0.47 () {58 vars in 1244 bytes} [Mon Nov 1 01:17:10 2021] GET /compute/v2.1/os-volumes/3477dd16-c19a-4d59-a11e-13ebb32f14f3 => generated 351 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:17:10.337906 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-345955bd-5bb7-42f6-866d-19725c23ddf5 tempest-VolumesGetTestJSON-1384663558 tempest-VolumesGetTestJSON-1384663558-project] Calling method '.version_select at 0x7fccf8047e50>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:17:10.351175 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-59b349c2-9ff3-41d4-9fc3-4276cc620a07 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1353335339", "imageRef": "b9068d8d-b02d-4043-9f0c-3d774cb372b3", "flavorRef": "452", "networks": [{"uuid": "54d89217-5b11-4e3c-9e30-9c4d2ec2e005"}]}} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:17:10.491073 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.network.neutron [None req-59b349c2-9ff3-41d4-9fc3-4276cc620a07 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] validate_networks() for [('54d89217-5b11-4e3c-9e30-9c4d2ec2e005', None, None, None, None, None)] {{(pid=116267) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Nov 01 01:17:10.524494 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-345955bd-5bb7-42f6-866d-19725c23ddf5 tempest-VolumesGetTestJSON-1384663558 tempest-VolumesGetTestJSON-1384663558-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/3ca31d95-1431-4b98-9d6d-5a8f14787150" status: 200 len: 353 microversion: 2.1 time: 0.192983 Nov 01 01:17:10.525584 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 3/4] 10.222.0.47 () {58 vars in 1244 bytes} [Mon Nov 1 01:17:10 2021] GET /compute/v2.1/os-volumes/3ca31d95-1431-4b98-9d6d-5a8f14787150 => generated 353 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:17:10.531004 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-c4368271-5bc3-403a-b1e8-2521e70a7a94 tempest-VolumesSnapshotsTestJSON-1221600107 tempest-VolumesSnapshotsTestJSON-1221600107-project] Calling method '.version_select at 0x7fccf805b550>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:17:10.848003 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-c4368271-5bc3-403a-b1e8-2521e70a7a94 tempest-VolumesSnapshotsTestJSON-1221600107 tempest-VolumesSnapshotsTestJSON-1221600107-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/4cbc2978-0dcf-4614-aa2c-b59e05783251" status: 200 len: 344 microversion: 2.1 time: 0.321156 Nov 01 01:17:10.855692 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 4/5] 10.222.0.47 () {58 vars in 1244 bytes} [Mon Nov 1 01:17:10 2021] GET /compute/v2.1/os-volumes/4cbc2978-0dcf-4614-aa2c-b59e05783251 => generated 344 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:17:10.855692 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-d25274ab-b70a-4284-b0e7-c75683c50ebe tempest-VolumesGetTestJSON-1384663558 tempest-VolumesGetTestJSON-1384663558-project] Calling method '.version_select at 0x7fccf805be50>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:17:10.942615 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-d25274ab-b70a-4284-b0e7-c75683c50ebe tempest-VolumesGetTestJSON-1384663558 tempest-VolumesGetTestJSON-1384663558-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/3ca31d95-1431-4b98-9d6d-5a8f14787150" status: 200 len: 353 microversion: 2.1 time: 0.091685 Nov 01 01:17:10.943576 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 5/6] 10.222.0.47 () {58 vars in 1244 bytes} [Mon Nov 1 01:17:10 2021] GET /compute/v2.1/os-volumes/3ca31d95-1431-4b98-9d6d-5a8f14787150 => generated 353 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:17:10.970358 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-9e17820c-eeb9-4d78-bcf3-cff354169dda tempest-VolumesGetTestJSON-1384663558 tempest-VolumesGetTestJSON-1384663558-project] Calling method '.version_select at 0x7fccf805bf70>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:17:11.383658 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-9e17820c-eeb9-4d78-bcf3-cff354169dda tempest-VolumesGetTestJSON-1384663558 tempest-VolumesGetTestJSON-1384663558-project] 10.222.0.47 "DELETE /compute/v2.1/os-volumes/3ca31d95-1431-4b98-9d6d-5a8f14787150" status: 202 len: 0 microversion: 2.1 time: 0.425692 Nov 01 01:17:11.394902 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 6/7] 10.222.0.47 () {58 vars in 1247 bytes} [Mon Nov 1 01:17:10 2021] DELETE /compute/v2.1/os-volumes/3ca31d95-1431-4b98-9d6d-5a8f14787150 => generated 0 bytes in 433 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 01 01:17:11.397963 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-896cd179-b020-4d6c-8952-5d13ef4d3790 tempest-VolumesGetTestJSON-1384663558 tempest-VolumesGetTestJSON-1384663558-project] Calling method '.version_select at 0x7fccf805b8b0>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:17:11.468731 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-896cd179-b020-4d6c-8952-5d13ef4d3790 tempest-VolumesGetTestJSON-1384663558 tempest-VolumesGetTestJSON-1384663558-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/3ca31d95-1431-4b98-9d6d-5a8f14787150" status: 200 len: 352 microversion: 2.1 time: 0.077457 Nov 01 01:17:11.469568 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 7/8] 10.222.0.47 () {58 vars in 1244 bytes} [Mon Nov 1 01:17:11 2021] GET /compute/v2.1/os-volumes/3ca31d95-1431-4b98-9d6d-5a8f14787150 => generated 352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:17:11.864384 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-5056b054-2843-4d23-8fdf-be46014b2824 tempest-VolumesSnapshotsTestJSON-1221600107 tempest-VolumesSnapshotsTestJSON-1221600107-project] Calling method '.version_select at 0x7fccf8047dc0>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:17:11.953295 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-5056b054-2843-4d23-8fdf-be46014b2824 tempest-VolumesSnapshotsTestJSON-1221600107 tempest-VolumesSnapshotsTestJSON-1221600107-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/4cbc2978-0dcf-4614-aa2c-b59e05783251" status: 200 len: 345 microversion: 2.1 time: 0.093408 Nov 01 01:17:11.954162 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 8/9] 10.222.0.47 () {58 vars in 1244 bytes} [Mon Nov 1 01:17:11 2021] GET /compute/v2.1/os-volumes/4cbc2978-0dcf-4614-aa2c-b59e05783251 => generated 345 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 01 01:17:11.967377 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-cc8e9e9e-b747-4a65-9a40-16e91722ffbc tempest-VolumesSnapshotsTestJSON-1221600107 tempest-VolumesSnapshotsTestJSON-1221600107-project] Action: 'create', calling method: .version_select at 0x7fccf8047ee0>, body: {"snapshot": {"volume_id": "4cbc2978-0dcf-4614-aa2c-b59e05783251", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-906451787"}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:17:12.155954 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.virt.hardware [None req-59b349c2-9ff3-41d4-9fc3-4276cc620a07 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Flavor limits 0:0:0 {{(pid=116267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 01 01:17:12.157838 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.virt.hardware [None req-59b349c2-9ff3-41d4-9fc3-4276cc620a07 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Image limits 0:0:0 {{(pid=116267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 01 01:17:12.158547 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.virt.hardware [None req-59b349c2-9ff3-41d4-9fc3-4276cc620a07 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Flavor pref 0:0:0 {{(pid=116267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 01 01:17:12.159322 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.virt.hardware [None req-59b349c2-9ff3-41d4-9fc3-4276cc620a07 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Image pref 0:0:0 {{(pid=116267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 01 01:17:12.160444 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.virt.hardware [None req-59b349c2-9ff3-41d4-9fc3-4276cc620a07 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 01 01:17:12.179086 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-59b349c2-9ff3-41d4-9fc3-4276cc620a07 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:17:12.179738 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-59b349c2-9ff3-41d4-9fc3-4276cc620a07 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:17:12.181268 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-59b349c2-9ff3-41d4-9fc3-4276cc620a07 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:17:12.181866 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-59b349c2-9ff3-41d4-9fc3-4276cc620a07 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:17:12.238923 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.quota [None req-59b349c2-9ff3-41d4-9fc3-4276cc620a07 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Getting quotas for project 8a798dc4102c4296b56bf54cd38cde6e. Resources: {'instances', 'cores', 'ram'} {{(pid=116267) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 01 01:17:12.246779 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.quota [None req-59b349c2-9ff3-41d4-9fc3-4276cc620a07 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Getting quotas for user e03064ba5be1410aba9c9c2331b70bd8 and project 8a798dc4102c4296b56bf54cd38cde6e. Resources: {'instances', 'cores', 'ram'} {{(pid=116267) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 01 01:17:12.261075 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-59b349c2-9ff3-41d4-9fc3-4276cc620a07 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Going to run 1 instances... {{(pid=116267) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 01 01:17:12.265019 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-59b349c2-9ff3-41d4-9fc3-4276cc620a07 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] [instance: 09733ccb-dd41-48bf-bf48-eafba2dfc208] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b9068d8d-b02d-4043-9f0c-3d774cb372b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116267) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 01 01:17:12.538277 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-59b349c2-9ff3-41d4-9fc3-4276cc620a07 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.340470 Nov 01 01:17:12.539079 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 2/10] 10.222.0.47 () {60 vars in 1146 bytes} [Mon Nov 1 01:17:10 2021] POST /compute/v2.1/servers => generated 380 bytes in 2342 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 01 01:17:12.548420 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-e4a8d2be-d8b8-4138-834b-b7c0fb783e09 tempest-VolumesGetTestJSON-1384663558 tempest-VolumesGetTestJSON-1384663558-project] Calling method '.version_select at 0x7fccf7f5e280>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:17:12.612365 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-e4a8d2be-d8b8-4138-834b-b7c0fb783e09 tempest-VolumesGetTestJSON-1384663558 tempest-VolumesGetTestJSON-1384663558-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/3ca31d95-1431-4b98-9d6d-5a8f14787150" status: 200 len: 352 microversion: 2.1 time: 0.071755 Nov 01 01:17:12.618572 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 3/11] 10.222.0.47 () {58 vars in 1244 bytes} [Mon Nov 1 01:17:12 2021] GET /compute/v2.1/os-volumes/3ca31d95-1431-4b98-9d6d-5a8f14787150 => generated 352 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:17:12.627581 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-1a88771f-f8ea-48ca-9b80-427f0fd0c76e tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:17:12.628193 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-1a88771f-f8ea-48ca-9b80-427f0fd0c76e tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] [instance: 09733ccb-dd41-48bf-bf48-eafba2dfc208] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:17:12.754880 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-1a88771f-f8ea-48ca-9b80-427f0fd0c76e tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03064ba5be1410aba9c9c2331b70bd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a798dc4102c4296b56bf54cd38cde6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:17:12.766377 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-1a88771f-f8ea-48ca-9b80-427f0fd0c76e tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] 10.222.0.47 "GET /compute/v2.1/servers/09733ccb-dd41-48bf-bf48-eafba2dfc208" status: 200 len: 1215 microversion: 2.1 time: 0.146387 Nov 01 01:17:12.767083 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 4/12] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:17:12 2021] GET /compute/v2.1/servers/09733ccb-dd41-48bf-bf48-eafba2dfc208 => generated 1215 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:17:13.156894 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-cc8e9e9e-b747-4a65-9a40-16e91722ffbc tempest-VolumesSnapshotsTestJSON-1221600107 tempest-VolumesSnapshotsTestJSON-1221600107-project] 10.222.0.47 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 1.193691 Nov 01 01:17:13.162709 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 9/13] 10.222.0.47 () {60 vars in 1161 bytes} [Mon Nov 1 01:17:11 2021] POST /compute/v2.1/os-snapshots => generated 286 bytes in 1200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:17:13.167520 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-08e413e9-099c-4be2-8c31-405b93b563c1 tempest-VolumesSnapshotsTestJSON-1221600107 tempest-VolumesSnapshotsTestJSON-1221600107-project] Calling method '.version_select at 0x7fccf6ef3af0>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:17:13.220870 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-08e413e9-099c-4be2-8c31-405b93b563c1 tempest-VolumesSnapshotsTestJSON-1221600107 tempest-VolumesSnapshotsTestJSON-1221600107-project] 10.222.0.47 "GET /compute/v2.1/os-snapshots/1a0a6287-0199-458b-8336-335a31620270" status: 200 len: 286 microversion: 2.1 time: 0.049151 Nov 01 01:17:13.220870 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 5/14] 10.222.0.47 () {58 vars in 1250 bytes} [Mon Nov 1 01:17:13 2021] GET /compute/v2.1/os-snapshots/1a0a6287-0199-458b-8336-335a31620270 => generated 286 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:17:13.227165 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-23aa5f0f-a30f-4000-9267-34e1ca40bff2 tempest-VolumesSnapshotsTestJSON-1221600107 tempest-VolumesSnapshotsTestJSON-1221600107-project] Calling method '.version_select at 0x7fccf805ba60>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:17:13.286916 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-23aa5f0f-a30f-4000-9267-34e1ca40bff2 tempest-VolumesSnapshotsTestJSON-1221600107 tempest-VolumesSnapshotsTestJSON-1221600107-project] 10.222.0.47 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.063698 Nov 01 01:17:13.287487 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 10/15] 10.222.0.47 () {58 vars in 1139 bytes} [Mon Nov 1 01:17:13 2021] GET /compute/v2.1/os-snapshots => generated 289 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:17:13.297378 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-fff8f0e9-4034-45a7-93f9-bab82f5290bf tempest-VolumesSnapshotsTestJSON-1221600107 tempest-VolumesSnapshotsTestJSON-1221600107-project] Calling method '.version_select at 0x7fccf6f13ee0>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:17:13.333656 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-fff8f0e9-4034-45a7-93f9-bab82f5290bf tempest-VolumesSnapshotsTestJSON-1221600107 tempest-VolumesSnapshotsTestJSON-1221600107-project] 10.222.0.47 "GET /compute/v2.1/os-snapshots/1a0a6287-0199-458b-8336-335a31620270" status: 200 len: 286 microversion: 2.1 time: 0.039795 Nov 01 01:17:13.334574 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 6/16] 10.222.0.47 () {58 vars in 1250 bytes} [Mon Nov 1 01:17:13 2021] GET /compute/v2.1/os-snapshots/1a0a6287-0199-458b-8336-335a31620270 => generated 286 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:17:13.598939 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-642f5020-f377-45ee-bd65-ce323c5cd48f tempest-VolumesTestJSON-1614519275 tempest-VolumesTestJSON-1614519275-project] Calling method '.version_select at 0x7fccf7fec8b0>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:17:13.626798 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-1d512f3c-5892-42a0-bbc8-9bc00da3b21b tempest-VolumesGetTestJSON-1384663558 tempest-VolumesGetTestJSON-1384663558-project] Calling method '.version_select at 0x7fccf6f20820>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:17:13.666873 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.wsgi [None req-1d512f3c-5892-42a0-bbc8-9bc00da3b21b tempest-VolumesGetTestJSON-1384663558 tempest-VolumesGetTestJSON-1384663558-project] HTTP exception thrown: Volume 3ca31d95-1431-4b98-9d6d-5a8f14787150 could not be found. Nov 01 01:17:13.667393 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-1d512f3c-5892-42a0-bbc8-9bc00da3b21b tempest-VolumesGetTestJSON-1384663558 tempest-VolumesGetTestJSON-1384663558-project] Returning 404 to user: Volume 3ca31d95-1431-4b98-9d6d-5a8f14787150 could not be found. {{(pid=116267) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 01 01:17:13.668927 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-1d512f3c-5892-42a0-bbc8-9bc00da3b21b tempest-VolumesGetTestJSON-1384663558 tempest-VolumesGetTestJSON-1384663558-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/3ca31d95-1431-4b98-9d6d-5a8f14787150" status: 404 len: 109 microversion: 2.1 time: 0.048029 Nov 01 01:17:13.670308 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 7/17] 10.222.0.47 () {58 vars in 1244 bytes} [Mon Nov 1 01:17:13 2021] GET /compute/v2.1/os-volumes/3ca31d95-1431-4b98-9d6d-5a8f14787150 => generated 109 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 01:17:13.676522 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-642f5020-f377-45ee-bd65-ce323c5cd48f tempest-VolumesTestJSON-1614519275 tempest-VolumesTestJSON-1614519275-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/3a646f07-4fae-4891-b2a4-21c026797661" status: 200 len: 351 microversion: 2.1 time: 0.084530 Nov 01 01:17:13.677076 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 11/18] 10.222.0.47 () {58 vars in 1244 bytes} [Mon Nov 1 01:17:13 2021] GET /compute/v2.1/os-volumes/3a646f07-4fae-4891-b2a4-21c026797661 => generated 351 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:17:13.783574 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-d253ae24-3849-4a98-b04d-ec84261da4ae tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:17:13.784564 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-d253ae24-3849-4a98-b04d-ec84261da4ae tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] [instance: 09733ccb-dd41-48bf-bf48-eafba2dfc208] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:17:13.852980 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-d253ae24-3849-4a98-b04d-ec84261da4ae tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03064ba5be1410aba9c9c2331b70bd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a798dc4102c4296b56bf54cd38cde6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:17:13.870865 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-d253ae24-3849-4a98-b04d-ec84261da4ae tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] 10.222.0.47 "GET /compute/v2.1/servers/09733ccb-dd41-48bf-bf48-eafba2dfc208" status: 200 len: 1215 microversion: 2.1 time: 0.090798 Nov 01 01:17:13.874478 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 12/19] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:17:13 2021] GET /compute/v2.1/servers/09733ccb-dd41-48bf-bf48-eafba2dfc208 => generated 1215 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:17:14.165792 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-371143a1-d19e-4c5c-8539-2bfe84b71fda tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Action: 'create', calling method: .version_select at 0x7fccf6f20a60>, body: {"keypair": {"name": "tempest-keypair-1207935818"}} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:17:14.165792 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.quota [None req-371143a1-d19e-4c5c-8539-2bfe84b71fda tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Getting quotas for project c7a8cb991f4a4056af85fd3f9a387727. Resources: {'key_pairs'} {{(pid=116267) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 01 01:17:14.165792 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.quota [None req-371143a1-d19e-4c5c-8539-2bfe84b71fda tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Getting quotas for user 246b28121cd749e68ba1686e16dad852 and project c7a8cb991f4a4056af85fd3f9a387727. Resources: {'key_pairs'} {{(pid=116267) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 01 01:17:14.346915 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-d7b348e7-d307-4588-af5d-6f43f4358ce5 tempest-VolumesSnapshotsTestJSON-1221600107 tempest-VolumesSnapshotsTestJSON-1221600107-project] Calling method '.version_select at 0x7fccf7fecf70>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:17:14.386460 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-d7b348e7-d307-4588-af5d-6f43f4358ce5 tempest-VolumesSnapshotsTestJSON-1221600107 tempest-VolumesSnapshotsTestJSON-1221600107-project] 10.222.0.47 "GET /compute/v2.1/os-snapshots/1a0a6287-0199-458b-8336-335a31620270" status: 200 len: 286 microversion: 2.1 time: 0.045128 Nov 01 01:17:14.391029 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 13/20] 10.222.0.47 () {58 vars in 1250 bytes} [Mon Nov 1 01:17:14 2021] GET /compute/v2.1/os-snapshots/1a0a6287-0199-458b-8336-335a31620270 => generated 286 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 01 01:17:14.652720 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.quota [None req-371143a1-d19e-4c5c-8539-2bfe84b71fda tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Getting quotas for project c7a8cb991f4a4056af85fd3f9a387727. Resources: {'key_pairs'} {{(pid=116267) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 01 01:17:14.657248 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.quota [None req-371143a1-d19e-4c5c-8539-2bfe84b71fda tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Getting quotas for user 246b28121cd749e68ba1686e16dad852 and project c7a8cb991f4a4056af85fd3f9a387727. Resources: {'key_pairs'} {{(pid=116267) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 01 01:17:14.672010 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-371143a1-d19e-4c5c-8539-2bfe84b71fda tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 1.000411 Nov 01 01:17:14.673023 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 8/21] 10.222.0.47 () {60 vars in 1157 bytes} [Mon Nov 1 01:17:13 2021] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:17:14.889689 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-50e66ace-fd8c-4d8e-bcc7-5b9ee6e4b0f3 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:17:14.890524 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-50e66ace-fd8c-4d8e-bcc7-5b9ee6e4b0f3 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] [instance: 09733ccb-dd41-48bf-bf48-eafba2dfc208] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:17:14.943169 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-50e66ace-fd8c-4d8e-bcc7-5b9ee6e4b0f3 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03064ba5be1410aba9c9c2331b70bd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a798dc4102c4296b56bf54cd38cde6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:17:14.949961 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-50e66ace-fd8c-4d8e-bcc7-5b9ee6e4b0f3 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] 10.222.0.47 "GET /compute/v2.1/servers/09733ccb-dd41-48bf-bf48-eafba2dfc208" status: 200 len: 1215 microversion: 2.1 time: 0.065158 Nov 01 01:17:14.951183 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 14/22] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:17:14 2021] GET /compute/v2.1/servers/09733ccb-dd41-48bf-bf48-eafba2dfc208 => generated 1215 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:17:15.398443 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-66019393-e2d2-4978-af60-b9bbc213ced6 tempest-VolumesSnapshotsTestJSON-1221600107 tempest-VolumesSnapshotsTestJSON-1221600107-project] Calling method '.version_select at 0x7fccf6f13dc0>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:17:15.437390 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-66019393-e2d2-4978-af60-b9bbc213ced6 tempest-VolumesSnapshotsTestJSON-1221600107 tempest-VolumesSnapshotsTestJSON-1221600107-project] 10.222.0.47 "GET /compute/v2.1/os-snapshots/1a0a6287-0199-458b-8336-335a31620270" status: 200 len: 286 microversion: 2.1 time: 0.036365 Nov 01 01:17:15.437390 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 9/23] 10.222.0.47 () {58 vars in 1250 bytes} [Mon Nov 1 01:17:15 2021] GET /compute/v2.1/os-snapshots/1a0a6287-0199-458b-8336-335a31620270 => generated 286 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:17:15.969509 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-275432bf-c210-4040-8643-b993c5ad7049 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:17:15.970140 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-275432bf-c210-4040-8643-b993c5ad7049 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] [instance: 09733ccb-dd41-48bf-bf48-eafba2dfc208] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:17:15.991225 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-275432bf-c210-4040-8643-b993c5ad7049 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:17:15.991906 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-275432bf-c210-4040-8643-b993c5ad7049 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:17:15.993380 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-275432bf-c210-4040-8643-b993c5ad7049 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:17:15.994242 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-275432bf-c210-4040-8643-b993c5ad7049 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:17:16.175916 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-275432bf-c210-4040-8643-b993c5ad7049 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03064ba5be1410aba9c9c2331b70bd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a798dc4102c4296b56bf54cd38cde6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:17:16.189067 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-275432bf-c210-4040-8643-b993c5ad7049 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] 10.222.0.47 "GET /compute/v2.1/servers/09733ccb-dd41-48bf-bf48-eafba2dfc208" status: 200 len: 1219 microversion: 2.1 time: 0.225267 Nov 01 01:17:16.189872 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 15/24] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:17:15 2021] GET /compute/v2.1/servers/09733ccb-dd41-48bf-bf48-eafba2dfc208 => generated 1219 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:17:16.444808 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-22f058fe-fd98-4644-94b3-e04a5630908c tempest-VolumesSnapshotsTestJSON-1221600107 tempest-VolumesSnapshotsTestJSON-1221600107-project] Calling method '.version_select at 0x7fccf6ee3790>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:17:16.473649 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-22f058fe-fd98-4644-94b3-e04a5630908c tempest-VolumesSnapshotsTestJSON-1221600107 tempest-VolumesSnapshotsTestJSON-1221600107-project] 10.222.0.47 "GET /compute/v2.1/os-snapshots/1a0a6287-0199-458b-8336-335a31620270" status: 200 len: 286 microversion: 2.1 time: 0.032477 Nov 01 01:17:16.474203 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 10/25] 10.222.0.47 () {58 vars in 1250 bytes} [Mon Nov 1 01:17:16 2021] GET /compute/v2.1/os-snapshots/1a0a6287-0199-458b-8336-335a31620270 => generated 286 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:17:17.212978 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-45e08fd2-8c4b-427f-86f9-4f6a399a60df tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:17:17.214132 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-45e08fd2-8c4b-427f-86f9-4f6a399a60df tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] [instance: 09733ccb-dd41-48bf-bf48-eafba2dfc208] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:17:17.228924 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-45e08fd2-8c4b-427f-86f9-4f6a399a60df tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:17:17.229362 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-45e08fd2-8c4b-427f-86f9-4f6a399a60df tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:17:17.230263 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-45e08fd2-8c4b-427f-86f9-4f6a399a60df tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:17:17.230954 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-45e08fd2-8c4b-427f-86f9-4f6a399a60df tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:17:17.307105 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-45e08fd2-8c4b-427f-86f9-4f6a399a60df tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03064ba5be1410aba9c9c2331b70bd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a798dc4102c4296b56bf54cd38cde6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:17:17.316916 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-45e08fd2-8c4b-427f-86f9-4f6a399a60df tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] 10.222.0.47 "GET /compute/v2.1/servers/09733ccb-dd41-48bf-bf48-eafba2dfc208" status: 200 len: 1219 microversion: 2.1 time: 0.107633 Nov 01 01:17:17.318583 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 16/26] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:17:17 2021] GET /compute/v2.1/servers/09733ccb-dd41-48bf-bf48-eafba2dfc208 => generated 1219 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:17:17.485091 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-a87fd8b9-9def-4ca2-94cb-7be86f81b4d6 tempest-VolumesSnapshotsTestJSON-1221600107 tempest-VolumesSnapshotsTestJSON-1221600107-project] Calling method '.version_select at 0x7fccf66680d0>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:17:17.540002 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-a87fd8b9-9def-4ca2-94cb-7be86f81b4d6 tempest-VolumesSnapshotsTestJSON-1221600107 tempest-VolumesSnapshotsTestJSON-1221600107-project] 10.222.0.47 "GET /compute/v2.1/os-snapshots/1a0a6287-0199-458b-8336-335a31620270" status: 200 len: 286 microversion: 2.1 time: 0.058404 Nov 01 01:17:17.540796 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 11/27] 10.222.0.47 () {58 vars in 1250 bytes} [Mon Nov 1 01:17:17 2021] GET /compute/v2.1/os-snapshots/1a0a6287-0199-458b-8336-335a31620270 => generated 286 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:17:18.447397 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-12f63bc8-48e3-4527-b2b3-3c63a992180d tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:17:18.447397 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-12f63bc8-48e3-4527-b2b3-3c63a992180d tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] [instance: 09733ccb-dd41-48bf-bf48-eafba2dfc208] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:17:18.447397 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-12f63bc8-48e3-4527-b2b3-3c63a992180d tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:17:18.447397 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-12f63bc8-48e3-4527-b2b3-3c63a992180d tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:17:18.452501 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-12f63bc8-48e3-4527-b2b3-3c63a992180d tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:17:18.452501 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-12f63bc8-48e3-4527-b2b3-3c63a992180d tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:17:18.452501 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-12f63bc8-48e3-4527-b2b3-3c63a992180d tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03064ba5be1410aba9c9c2331b70bd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a798dc4102c4296b56bf54cd38cde6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:17:18.453502 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-12f63bc8-48e3-4527-b2b3-3c63a992180d tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] 10.222.0.47 "GET /compute/v2.1/servers/09733ccb-dd41-48bf-bf48-eafba2dfc208" status: 200 len: 1219 microversion: 2.1 time: 0.104191 Nov 01 01:17:18.453502 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 17/28] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:17:18 2021] GET /compute/v2.1/servers/09733ccb-dd41-48bf-bf48-eafba2dfc208 => generated 1219 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:17:18.552810 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-243bc18c-7eba-4655-96cf-00b9dde30304 tempest-VolumesSnapshotsTestJSON-1221600107 tempest-VolumesSnapshotsTestJSON-1221600107-project] Calling method '.version_select at 0x7fccf6ee3c10>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:17:18.582897 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-243bc18c-7eba-4655-96cf-00b9dde30304 tempest-VolumesSnapshotsTestJSON-1221600107 tempest-VolumesSnapshotsTestJSON-1221600107-project] 10.222.0.47 "GET /compute/v2.1/os-snapshots/1a0a6287-0199-458b-8336-335a31620270" status: 200 len: 286 microversion: 2.1 time: 0.034176 Nov 01 01:17:18.583449 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 12/29] 10.222.0.47 () {58 vars in 1250 bytes} [Mon Nov 1 01:17:18 2021] GET /compute/v2.1/os-snapshots/1a0a6287-0199-458b-8336-335a31620270 => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:17:19.014603 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-bce34de6-9a42-45b5-9afa-7831f7a6cd02 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-518611671", "imageRef": "b9068d8d-b02d-4043-9f0c-3d774cb372b3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "25e736ba-2e30-403f-83bd-a2deea011882"}], "security_groups": [{"name": "tempest-securitygroup--133853189"}], "key_name": "tempest-keypair-1207935818", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:17:19.155626 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.network.neutron [None req-bce34de6-9a42-45b5-9afa-7831f7a6cd02 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] validate_networks() for [('25e736ba-2e30-403f-83bd-a2deea011882', None, None, None, None, None)] {{(pid=116266) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Nov 01 01:17:19.451860 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-1aa87ee3-8a3e-48f1-aeb7-bc211139ad00 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:17:19.452650 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-1aa87ee3-8a3e-48f1-aeb7-bc211139ad00 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] [instance: 09733ccb-dd41-48bf-bf48-eafba2dfc208] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:17:19.459617 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-1aa87ee3-8a3e-48f1-aeb7-bc211139ad00 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:17:19.460112 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-1aa87ee3-8a3e-48f1-aeb7-bc211139ad00 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:17:19.469731 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-1aa87ee3-8a3e-48f1-aeb7-bc211139ad00 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:17:19.469731 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-1aa87ee3-8a3e-48f1-aeb7-bc211139ad00 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:17:19.603452 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-1aa87ee3-8a3e-48f1-aeb7-bc211139ad00 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03064ba5be1410aba9c9c2331b70bd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a798dc4102c4296b56bf54cd38cde6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:17:19.615283 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-1aa87ee3-8a3e-48f1-aeb7-bc211139ad00 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] 10.222.0.47 "GET /compute/v2.1/servers/09733ccb-dd41-48bf-bf48-eafba2dfc208" status: 200 len: 1211 microversion: 2.1 time: 0.167283 Nov 01 01:17:19.615863 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 13/30] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:17:19 2021] GET /compute/v2.1/servers/09733ccb-dd41-48bf-bf48-eafba2dfc208 => generated 1211 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:17:19.620074 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-aaee4f00-210c-44b9-8f98-725dc622063a tempest-VolumesSnapshotsTestJSON-1221600107 tempest-VolumesSnapshotsTestJSON-1221600107-project] Calling method '.version_select at 0x7fccf665c0d0>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:17:19.726417 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.virt.hardware [None req-bce34de6-9a42-45b5-9afa-7831f7a6cd02 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Flavor limits 0:0:0 {{(pid=116266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 01 01:17:19.726893 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.virt.hardware [None req-bce34de6-9a42-45b5-9afa-7831f7a6cd02 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Image limits 0:0:0 {{(pid=116266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 01 01:17:19.727315 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.virt.hardware [None req-bce34de6-9a42-45b5-9afa-7831f7a6cd02 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Flavor pref 0:0:0 {{(pid=116266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 01 01:17:19.727718 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.virt.hardware [None req-bce34de6-9a42-45b5-9afa-7831f7a6cd02 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Image pref 0:0:0 {{(pid=116266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 01 01:17:19.728123 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.virt.hardware [None req-bce34de6-9a42-45b5-9afa-7831f7a6cd02 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 01 01:17:19.741006 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-bce34de6-9a42-45b5-9afa-7831f7a6cd02 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:17:19.741448 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-bce34de6-9a42-45b5-9afa-7831f7a6cd02 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:17:19.742238 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-bce34de6-9a42-45b5-9afa-7831f7a6cd02 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:17:19.742704 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-bce34de6-9a42-45b5-9afa-7831f7a6cd02 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:17:19.772793 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.quota [None req-bce34de6-9a42-45b5-9afa-7831f7a6cd02 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Getting quotas for project c7a8cb991f4a4056af85fd3f9a387727. Resources: {'instances', 'cores', 'ram'} {{(pid=116266) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 01 01:17:19.777672 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-aaee4f00-210c-44b9-8f98-725dc622063a tempest-VolumesSnapshotsTestJSON-1221600107 tempest-VolumesSnapshotsTestJSON-1221600107-project] 10.222.0.47 "GET /compute/v2.1/os-snapshots/1a0a6287-0199-458b-8336-335a31620270" status: 200 len: 286 microversion: 2.1 time: 0.160786 Nov 01 01:17:19.778266 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 14/31] 10.222.0.47 () {58 vars in 1250 bytes} [Mon Nov 1 01:17:19 2021] GET /compute/v2.1/os-snapshots/1a0a6287-0199-458b-8336-335a31620270 => generated 286 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:17:19.784680 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.quota [None req-bce34de6-9a42-45b5-9afa-7831f7a6cd02 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Getting quotas for user 246b28121cd749e68ba1686e16dad852 and project c7a8cb991f4a4056af85fd3f9a387727. Resources: {'instances', 'cores', 'ram'} {{(pid=116266) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 01 01:17:19.795753 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-bce34de6-9a42-45b5-9afa-7831f7a6cd02 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Going to run 1 instances... {{(pid=116266) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 01 01:17:19.798556 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-bce34de6-9a42-45b5-9afa-7831f7a6cd02 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b9068d8d-b02d-4043-9f0c-3d774cb372b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116266) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 01 01:17:19.978099 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-bce34de6-9a42-45b5-9afa-7831f7a6cd02 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.968382 Nov 01 01:17:19.978798 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 18/32] 10.222.0.47 () {60 vars in 1146 bytes} [Mon Nov 1 01:17:19 2021] POST /compute/v2.1/servers => generated 401 bytes in 970 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 01 01:17:19.988492 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-23db7d84-cfe4-44bd-a500-cea5323d0b86 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:17:19.989235 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-23db7d84-cfe4-44bd-a500-cea5323d0b86 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:17:20.041654 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-23db7d84-cfe4-44bd-a500-cea5323d0b86 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:17:20.048513 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-23db7d84-cfe4-44bd-a500-cea5323d0b86 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1237 microversion: 2.1 time: 0.063385 Nov 01 01:17:20.049318 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 15/33] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:17:19 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1237 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:17:20.634725 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-0ed47ca4-2554-43fd-877d-9ba914a7a28b tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:17:20.635335 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-0ed47ca4-2554-43fd-877d-9ba914a7a28b tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] [instance: 09733ccb-dd41-48bf-bf48-eafba2dfc208] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:17:20.641934 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0ed47ca4-2554-43fd-877d-9ba914a7a28b tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:17:20.642378 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0ed47ca4-2554-43fd-877d-9ba914a7a28b tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:17:20.643163 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0ed47ca4-2554-43fd-877d-9ba914a7a28b tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:17:20.643597 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0ed47ca4-2554-43fd-877d-9ba914a7a28b tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:17:20.702097 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-0ed47ca4-2554-43fd-877d-9ba914a7a28b tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03064ba5be1410aba9c9c2331b70bd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a798dc4102c4296b56bf54cd38cde6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:17:20.709374 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-0ed47ca4-2554-43fd-877d-9ba914a7a28b tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] 10.222.0.47 "GET /compute/v2.1/servers/09733ccb-dd41-48bf-bf48-eafba2dfc208" status: 200 len: 1211 microversion: 2.1 time: 0.078696 Nov 01 01:17:20.709937 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 19/34] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:17:20 2021] GET /compute/v2.1/servers/09733ccb-dd41-48bf-bf48-eafba2dfc208 => generated 1211 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:17:20.790335 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-5dedbec7-4eb5-4d1c-86d6-4822efa41b22 tempest-VolumesSnapshotsTestJSON-1221600107 tempest-VolumesSnapshotsTestJSON-1221600107-project] Calling method '.version_select at 0x7fccf664cdc0>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:17:20.894409 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-5dedbec7-4eb5-4d1c-86d6-4822efa41b22 tempest-VolumesSnapshotsTestJSON-1221600107 tempest-VolumesSnapshotsTestJSON-1221600107-project] 10.222.0.47 "GET /compute/v2.1/os-snapshots/1a0a6287-0199-458b-8336-335a31620270" status: 200 len: 286 microversion: 2.1 time: 0.037806 Nov 01 01:17:20.894409 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 16/35] 10.222.0.47 () {58 vars in 1250 bytes} [Mon Nov 1 01:17:20 2021] GET /compute/v2.1/os-snapshots/1a0a6287-0199-458b-8336-335a31620270 => generated 286 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:17:21.064851 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-5c877f99-f451-463b-b4f6-d373e216c608 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:17:21.065577 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-5c877f99-f451-463b-b4f6-d373e216c608 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:17:21.116756 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-5c877f99-f451-463b-b4f6-d373e216c608 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:17:21.122755 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-5c877f99-f451-463b-b4f6-d373e216c608 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1237 microversion: 2.1 time: 0.061306 Nov 01 01:17:21.123313 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 20/36] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:17:21 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1237 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:17:21.766401 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-a816427c-af23-4d63-88bc-368e086c48f5 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:17:21.767033 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-a816427c-af23-4d63-88bc-368e086c48f5 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] [instance: 09733ccb-dd41-48bf-bf48-eafba2dfc208] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:17:21.772811 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a816427c-af23-4d63-88bc-368e086c48f5 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:17:21.773252 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a816427c-af23-4d63-88bc-368e086c48f5 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:17:21.773999 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a816427c-af23-4d63-88bc-368e086c48f5 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:17:21.774443 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a816427c-af23-4d63-88bc-368e086c48f5 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:17:21.834410 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-a816427c-af23-4d63-88bc-368e086c48f5 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03064ba5be1410aba9c9c2331b70bd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a798dc4102c4296b56bf54cd38cde6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:17:21.841667 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-a816427c-af23-4d63-88bc-368e086c48f5 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] 10.222.0.47 "GET /compute/v2.1/servers/09733ccb-dd41-48bf-bf48-eafba2dfc208" status: 200 len: 1211 microversion: 2.1 time: 0.079542 Nov 01 01:17:21.842214 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 17/37] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:17:21 2021] GET /compute/v2.1/servers/09733ccb-dd41-48bf-bf48-eafba2dfc208 => generated 1211 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:17:21.902810 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-34e67809-9f2b-428b-92b7-8b9a1ba19bfc tempest-VolumesSnapshotsTestJSON-1221600107 tempest-VolumesSnapshotsTestJSON-1221600107-project] Calling method '.version_select at 0x7fccf6def430>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:17:21.945272 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-34e67809-9f2b-428b-92b7-8b9a1ba19bfc tempest-VolumesSnapshotsTestJSON-1221600107 tempest-VolumesSnapshotsTestJSON-1221600107-project] 10.222.0.47 "GET /compute/v2.1/os-snapshots/1a0a6287-0199-458b-8336-335a31620270" status: 200 len: 286 microversion: 2.1 time: 0.046044 Nov 01 01:17:21.945831 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 21/38] 10.222.0.47 () {58 vars in 1250 bytes} [Mon Nov 1 01:17:21 2021] GET /compute/v2.1/os-snapshots/1a0a6287-0199-458b-8336-335a31620270 => generated 286 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:17:22.139254 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-c2151fd8-9d2f-497e-b8aa-65c30a8b6a3b tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:17:22.139864 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-c2151fd8-9d2f-497e-b8aa-65c30a8b6a3b tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:17:22.146531 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c2151fd8-9d2f-497e-b8aa-65c30a8b6a3b tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:17:22.146990 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c2151fd8-9d2f-497e-b8aa-65c30a8b6a3b tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:17:22.147758 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c2151fd8-9d2f-497e-b8aa-65c30a8b6a3b tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:17:22.149030 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c2151fd8-9d2f-497e-b8aa-65c30a8b6a3b tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:17:22.209566 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-c2151fd8-9d2f-497e-b8aa-65c30a8b6a3b tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:17:22.216798 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-c2151fd8-9d2f-497e-b8aa-65c30a8b6a3b tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1241 microversion: 2.1 time: 0.081243 Nov 01 01:17:22.217356 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 18/39] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:17:22 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1241 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:17:22.858316 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-85f4a46d-7297-41b3-896e-e9c476015867 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:17:22.859006 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-85f4a46d-7297-41b3-896e-e9c476015867 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] [instance: 09733ccb-dd41-48bf-bf48-eafba2dfc208] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:17:22.865424 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-85f4a46d-7297-41b3-896e-e9c476015867 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:17:22.865865 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-85f4a46d-7297-41b3-896e-e9c476015867 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:17:22.866688 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-85f4a46d-7297-41b3-896e-e9c476015867 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:17:22.867064 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-85f4a46d-7297-41b3-896e-e9c476015867 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:17:22.930408 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-85f4a46d-7297-41b3-896e-e9c476015867 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03064ba5be1410aba9c9c2331b70bd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a798dc4102c4296b56bf54cd38cde6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:17:22.937676 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-85f4a46d-7297-41b3-896e-e9c476015867 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] 10.222.0.47 "GET /compute/v2.1/servers/09733ccb-dd41-48bf-bf48-eafba2dfc208" status: 200 len: 1267 microversion: 2.1 time: 0.082934 Nov 01 01:17:22.947190 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 22/40] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:17:22 2021] GET /compute/v2.1/servers/09733ccb-dd41-48bf-bf48-eafba2dfc208 => generated 1267 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:17:22.956912 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-7caf4415-84d5-4db8-a969-6fe78c29621d tempest-VolumesSnapshotsTestJSON-1221600107 tempest-VolumesSnapshotsTestJSON-1221600107-project] Calling method '.version_select at 0x7fccf6f20b80>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:17:22.987268 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-7caf4415-84d5-4db8-a969-6fe78c29621d tempest-VolumesSnapshotsTestJSON-1221600107 tempest-VolumesSnapshotsTestJSON-1221600107-project] 10.222.0.47 "GET /compute/v2.1/os-snapshots/1a0a6287-0199-458b-8336-335a31620270" status: 200 len: 286 microversion: 2.1 time: 0.034508 Nov 01 01:17:22.992072 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 19/41] 10.222.0.47 () {58 vars in 1250 bytes} [Mon Nov 1 01:17:22 2021] GET /compute/v2.1/os-snapshots/1a0a6287-0199-458b-8336-335a31620270 => generated 286 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:17:23.233011 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-4fb43378-3ac6-407a-8a90-5165e38efa0a tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:17:23.233702 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-4fb43378-3ac6-407a-8a90-5165e38efa0a tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:17:23.239627 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4fb43378-3ac6-407a-8a90-5165e38efa0a tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:17:23.240168 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4fb43378-3ac6-407a-8a90-5165e38efa0a tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:17:23.240947 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4fb43378-3ac6-407a-8a90-5165e38efa0a tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:17:23.241383 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4fb43378-3ac6-407a-8a90-5165e38efa0a tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:17:23.325248 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-4fb43378-3ac6-407a-8a90-5165e38efa0a tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:17:23.331120 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-4fb43378-3ac6-407a-8a90-5165e38efa0a tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1233 microversion: 2.1 time: 0.101843 Nov 01 01:17:23.331803 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 23/42] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:17:23 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1233 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:17:23.954370 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-51f9df12-c8cb-42d6-86f6-5d7664ec9b38 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:17:23.955040 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-51f9df12-c8cb-42d6-86f6-5d7664ec9b38 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] [instance: 09733ccb-dd41-48bf-bf48-eafba2dfc208] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:17:23.960760 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-51f9df12-c8cb-42d6-86f6-5d7664ec9b38 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:17:23.961307 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-51f9df12-c8cb-42d6-86f6-5d7664ec9b38 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:17:23.961948 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-51f9df12-c8cb-42d6-86f6-5d7664ec9b38 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:17:23.962377 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-51f9df12-c8cb-42d6-86f6-5d7664ec9b38 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:17:23.999143 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-eb239e2b-c091-41d6-8fed-97900b760c34 tempest-VolumesSnapshotsTestJSON-1221600107 tempest-VolumesSnapshotsTestJSON-1221600107-project] Calling method '.version_select at 0x7fccf7644c10>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:17:24.030241 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-eb239e2b-c091-41d6-8fed-97900b760c34 tempest-VolumesSnapshotsTestJSON-1221600107 tempest-VolumesSnapshotsTestJSON-1221600107-project] 10.222.0.47 "GET /compute/v2.1/os-snapshots/1a0a6287-0199-458b-8336-335a31620270" status: 200 len: 287 microversion: 2.1 time: 0.034975 Nov 01 01:17:24.035746 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 24/43] 10.222.0.47 () {58 vars in 1250 bytes} [Mon Nov 1 01:17:23 2021] GET /compute/v2.1/os-snapshots/1a0a6287-0199-458b-8336-335a31620270 => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 01 01:17:24.035891 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-51f9df12-c8cb-42d6-86f6-5d7664ec9b38 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03064ba5be1410aba9c9c2331b70bd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a798dc4102c4296b56bf54cd38cde6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:17:24.039994 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-51f9df12-c8cb-42d6-86f6-5d7664ec9b38 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] 10.222.0.47 "GET /compute/v2.1/servers/09733ccb-dd41-48bf-bf48-eafba2dfc208" status: 200 len: 1275 microversion: 2.1 time: 0.089234 Nov 01 01:17:24.040570 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-791152e7-834e-4dd7-ab78-38a838002f0e tempest-VolumesSnapshotsTestJSON-1221600107 tempest-VolumesSnapshotsTestJSON-1221600107-project] Calling method '.version_select at 0x7fccf7666dc0>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:17:24.040943 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 20/44] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:17:23 2021] GET /compute/v2.1/servers/09733ccb-dd41-48bf-bf48-eafba2dfc208 => generated 1275 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:17:24.238285 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-791152e7-834e-4dd7-ab78-38a838002f0e tempest-VolumesSnapshotsTestJSON-1221600107 tempest-VolumesSnapshotsTestJSON-1221600107-project] 10.222.0.47 "DELETE /compute/v2.1/os-snapshots/1a0a6287-0199-458b-8336-335a31620270" status: 202 len: 0 microversion: 2.1 time: 0.201168 Nov 01 01:17:24.238894 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 25/45] 10.222.0.47 () {58 vars in 1253 bytes} [Mon Nov 1 01:17:24 2021] DELETE /compute/v2.1/os-snapshots/1a0a6287-0199-458b-8336-335a31620270 => generated 0 bytes in 202 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 01 01:17:24.246741 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-990a06fd-948b-4c9b-950d-561b3db982dd tempest-VolumesSnapshotsTestJSON-1221600107 tempest-VolumesSnapshotsTestJSON-1221600107-project] Calling method '.version_select at 0x7fccf6f20d30>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:17:24.275332 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-990a06fd-948b-4c9b-950d-561b3db982dd tempest-VolumesSnapshotsTestJSON-1221600107 tempest-VolumesSnapshotsTestJSON-1221600107-project] 10.222.0.47 "GET /compute/v2.1/os-snapshots/1a0a6287-0199-458b-8336-335a31620270" status: 200 len: 286 microversion: 2.1 time: 0.032178 Nov 01 01:17:24.276344 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 21/46] 10.222.0.47 () {58 vars in 1250 bytes} [Mon Nov 1 01:17:24 2021] GET /compute/v2.1/os-snapshots/1a0a6287-0199-458b-8336-335a31620270 => generated 286 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:17:24.347959 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-709d4899-710a-4a15-b0b9-68f546573844 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:17:24.348597 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-709d4899-710a-4a15-b0b9-68f546573844 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:17:24.354923 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-709d4899-710a-4a15-b0b9-68f546573844 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:17:24.356618 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-709d4899-710a-4a15-b0b9-68f546573844 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:17:24.356618 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-709d4899-710a-4a15-b0b9-68f546573844 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:17:24.356618 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-709d4899-710a-4a15-b0b9-68f546573844 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:17:24.415195 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-709d4899-710a-4a15-b0b9-68f546573844 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:17:24.422982 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-709d4899-710a-4a15-b0b9-68f546573844 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1289 microversion: 2.1 time: 0.078727 Nov 01 01:17:24.423558 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 26/47] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:17:24 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1289 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:17:25.056926 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-650d45de-c5e9-47aa-bada-6f69fb0cf487 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:17:25.057461 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-650d45de-c5e9-47aa-bada-6f69fb0cf487 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] [instance: 09733ccb-dd41-48bf-bf48-eafba2dfc208] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:17:25.064109 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-650d45de-c5e9-47aa-bada-6f69fb0cf487 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:17:25.064606 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-650d45de-c5e9-47aa-bada-6f69fb0cf487 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:17:25.065433 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-650d45de-c5e9-47aa-bada-6f69fb0cf487 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:17:25.065903 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-650d45de-c5e9-47aa-bada-6f69fb0cf487 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:17:25.132909 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-650d45de-c5e9-47aa-bada-6f69fb0cf487 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03064ba5be1410aba9c9c2331b70bd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a798dc4102c4296b56bf54cd38cde6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:17:25.140094 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-650d45de-c5e9-47aa-bada-6f69fb0cf487 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] 10.222.0.47 "GET /compute/v2.1/servers/09733ccb-dd41-48bf-bf48-eafba2dfc208" status: 200 len: 1275 microversion: 2.1 time: 0.086915 Nov 01 01:17:25.140661 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 22/48] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:17:25 2021] GET /compute/v2.1/servers/09733ccb-dd41-48bf-bf48-eafba2dfc208 => generated 1275 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:17:25.286517 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-0b1c58d6-e9b5-450d-bec5-f2a4a12683b9 tempest-VolumesSnapshotsTestJSON-1221600107 tempest-VolumesSnapshotsTestJSON-1221600107-project] Calling method '.version_select at 0x7fccf6e0faf0>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:17:25.314483 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-0b1c58d6-e9b5-450d-bec5-f2a4a12683b9 tempest-VolumesSnapshotsTestJSON-1221600107 tempest-VolumesSnapshotsTestJSON-1221600107-project] 10.222.0.47 "GET /compute/v2.1/os-snapshots/1a0a6287-0199-458b-8336-335a31620270" status: 200 len: 286 microversion: 2.1 time: 0.031435 Nov 01 01:17:25.315035 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 27/49] 10.222.0.47 () {58 vars in 1250 bytes} [Mon Nov 1 01:17:25 2021] GET /compute/v2.1/os-snapshots/1a0a6287-0199-458b-8336-335a31620270 => generated 286 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:17:25.439395 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-b9706edc-ddc7-427a-a4ae-cfcedabef57b tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:17:25.440598 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-b9706edc-ddc7-427a-a4ae-cfcedabef57b tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:17:25.452647 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b9706edc-ddc7-427a-a4ae-cfcedabef57b tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:17:25.452647 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b9706edc-ddc7-427a-a4ae-cfcedabef57b tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:17:25.452647 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b9706edc-ddc7-427a-a4ae-cfcedabef57b tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:17:25.452647 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b9706edc-ddc7-427a-a4ae-cfcedabef57b tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:17:25.515188 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-b9706edc-ddc7-427a-a4ae-cfcedabef57b tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:17:25.523230 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-b9706edc-ddc7-427a-a4ae-cfcedabef57b tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1289 microversion: 2.1 time: 0.087409 Nov 01 01:17:25.523801 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 23/50] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:17:25 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1289 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:17:26.156490 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-2e80ff49-3e93-4c8d-9c6d-e6b81139e3e8 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:17:26.157097 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-2e80ff49-3e93-4c8d-9c6d-e6b81139e3e8 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] [instance: 09733ccb-dd41-48bf-bf48-eafba2dfc208] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:17:26.164959 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2e80ff49-3e93-4c8d-9c6d-e6b81139e3e8 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:17:26.165461 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2e80ff49-3e93-4c8d-9c6d-e6b81139e3e8 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:17:26.166759 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2e80ff49-3e93-4c8d-9c6d-e6b81139e3e8 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:17:26.167424 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2e80ff49-3e93-4c8d-9c6d-e6b81139e3e8 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:17:26.229552 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-2e80ff49-3e93-4c8d-9c6d-e6b81139e3e8 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03064ba5be1410aba9c9c2331b70bd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a798dc4102c4296b56bf54cd38cde6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:17:26.238030 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-2e80ff49-3e93-4c8d-9c6d-e6b81139e3e8 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] 10.222.0.47 "GET /compute/v2.1/servers/09733ccb-dd41-48bf-bf48-eafba2dfc208" status: 200 len: 1275 microversion: 2.1 time: 0.084512 Nov 01 01:17:26.238978 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 28/51] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:17:26 2021] GET /compute/v2.1/servers/09733ccb-dd41-48bf-bf48-eafba2dfc208 => generated 1275 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:17:26.326484 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-96a95aa8-55d4-4582-b279-ab9cde001385 tempest-VolumesSnapshotsTestJSON-1221600107 tempest-VolumesSnapshotsTestJSON-1221600107-project] Calling method '.version_select at 0x7fccf65c7af0>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:17:26.355852 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-96a95aa8-55d4-4582-b279-ab9cde001385 tempest-VolumesSnapshotsTestJSON-1221600107 tempest-VolumesSnapshotsTestJSON-1221600107-project] 10.222.0.47 "GET /compute/v2.1/os-snapshots/1a0a6287-0199-458b-8336-335a31620270" status: 200 len: 286 microversion: 2.1 time: 0.033047 Nov 01 01:17:26.356406 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 24/52] 10.222.0.47 () {58 vars in 1250 bytes} [Mon Nov 1 01:17:26 2021] GET /compute/v2.1/os-snapshots/1a0a6287-0199-458b-8336-335a31620270 => generated 286 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:17:26.539724 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-71c4b6da-50a3-4b9b-aa7a-bcfb70d93898 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:17:26.540305 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-71c4b6da-50a3-4b9b-aa7a-bcfb70d93898 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:17:26.546405 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-71c4b6da-50a3-4b9b-aa7a-bcfb70d93898 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:17:26.546900 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-71c4b6da-50a3-4b9b-aa7a-bcfb70d93898 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:17:26.547683 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-71c4b6da-50a3-4b9b-aa7a-bcfb70d93898 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:17:26.548124 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-71c4b6da-50a3-4b9b-aa7a-bcfb70d93898 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:17:26.606152 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-71c4b6da-50a3-4b9b-aa7a-bcfb70d93898 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:17:26.613359 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-71c4b6da-50a3-4b9b-aa7a-bcfb70d93898 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1289 microversion: 2.1 time: 0.077385 Nov 01 01:17:26.613926 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 29/53] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:17:26 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1289 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:17:27.256020 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-e396365a-5d4e-46ec-ab2b-e81920046801 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:17:27.256634 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-e396365a-5d4e-46ec-ab2b-e81920046801 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] [instance: 09733ccb-dd41-48bf-bf48-eafba2dfc208] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:17:27.273816 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e396365a-5d4e-46ec-ab2b-e81920046801 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:17:27.276666 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e396365a-5d4e-46ec-ab2b-e81920046801 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:17:27.277460 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e396365a-5d4e-46ec-ab2b-e81920046801 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:17:27.277898 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e396365a-5d4e-46ec-ab2b-e81920046801 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:17:27.373351 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-ffd8400b-e273-4385-84f5-e05364e21f50 tempest-VolumesSnapshotsTestJSON-1221600107 tempest-VolumesSnapshotsTestJSON-1221600107-project] Calling method '.version_select at 0x7fccf7edc310>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:17:27.375981 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-e396365a-5d4e-46ec-ab2b-e81920046801 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03064ba5be1410aba9c9c2331b70bd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a798dc4102c4296b56bf54cd38cde6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:17:27.384965 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-e396365a-5d4e-46ec-ab2b-e81920046801 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] 10.222.0.47 "GET /compute/v2.1/servers/09733ccb-dd41-48bf-bf48-eafba2dfc208" status: 200 len: 1285 microversion: 2.1 time: 0.133274 Nov 01 01:17:27.385539 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 25/54] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:17:27 2021] GET /compute/v2.1/servers/09733ccb-dd41-48bf-bf48-eafba2dfc208 => generated 1285 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:17:27.412196 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-ffd8400b-e273-4385-84f5-e05364e21f50 tempest-VolumesSnapshotsTestJSON-1221600107 tempest-VolumesSnapshotsTestJSON-1221600107-project] 10.222.0.47 "GET /compute/v2.1/os-snapshots/1a0a6287-0199-458b-8336-335a31620270" status: 200 len: 286 microversion: 2.1 time: 0.043344 Nov 01 01:17:27.412836 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 30/55] 10.222.0.47 () {58 vars in 1250 bytes} [Mon Nov 1 01:17:27 2021] GET /compute/v2.1/os-snapshots/1a0a6287-0199-458b-8336-335a31620270 => generated 286 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 01 01:17:27.629794 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-6b993ba0-d0f3-4e35-a171-220968047001 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:17:27.630480 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-6b993ba0-d0f3-4e35-a171-220968047001 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:17:27.637495 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-6b993ba0-d0f3-4e35-a171-220968047001 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:17:27.637944 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-6b993ba0-d0f3-4e35-a171-220968047001 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:17:27.638749 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-6b993ba0-d0f3-4e35-a171-220968047001 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:17:27.639448 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-6b993ba0-d0f3-4e35-a171-220968047001 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:17:27.848355 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-6b993ba0-d0f3-4e35-a171-220968047001 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:17:27.864816 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-6b993ba0-d0f3-4e35-a171-220968047001 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1289 microversion: 2.1 time: 0.229707 Nov 01 01:17:27.865612 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 26/56] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:17:27 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1289 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:17:28.405009 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-38c6fad0-212b-4edb-ba1a-83a9a591af80 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:17:28.406307 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-38c6fad0-212b-4edb-ba1a-83a9a591af80 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] [instance: 09733ccb-dd41-48bf-bf48-eafba2dfc208] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:17:28.415225 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-38c6fad0-212b-4edb-ba1a-83a9a591af80 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:17:28.415996 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-38c6fad0-212b-4edb-ba1a-83a9a591af80 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:17:28.417099 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-38c6fad0-212b-4edb-ba1a-83a9a591af80 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:17:28.417731 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-38c6fad0-212b-4edb-ba1a-83a9a591af80 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:17:28.426023 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-fd1af112-0132-42bd-a377-10b8615b52d4 tempest-VolumesSnapshotsTestJSON-1221600107 tempest-VolumesSnapshotsTestJSON-1221600107-project] Calling method '.version_select at 0x7fccf6f20f70>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:17:28.460460 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-fd1af112-0132-42bd-a377-10b8615b52d4 tempest-VolumesSnapshotsTestJSON-1221600107 tempest-VolumesSnapshotsTestJSON-1221600107-project] 10.222.0.47 "GET /compute/v2.1/os-snapshots/1a0a6287-0199-458b-8336-335a31620270" status: 200 len: 286 microversion: 2.1 time: 0.039877 Nov 01 01:17:28.461137 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 27/57] 10.222.0.47 () {58 vars in 1250 bytes} [Mon Nov 1 01:17:28 2021] GET /compute/v2.1/os-snapshots/1a0a6287-0199-458b-8336-335a31620270 => generated 286 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:17:28.683082 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-38c6fad0-212b-4edb-ba1a-83a9a591af80 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03064ba5be1410aba9c9c2331b70bd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a798dc4102c4296b56bf54cd38cde6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:17:28.699105 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-38c6fad0-212b-4edb-ba1a-83a9a591af80 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] 10.222.0.47 "GET /compute/v2.1/servers/09733ccb-dd41-48bf-bf48-eafba2dfc208" status: 200 len: 1315 microversion: 2.1 time: 0.300205 Nov 01 01:17:28.710914 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 31/58] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:17:28 2021] GET /compute/v2.1/servers/09733ccb-dd41-48bf-bf48-eafba2dfc208 => generated 1315 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:17:28.882355 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-3c9592c3-ff9f-45a3-9f20-61711161dc2d tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:17:28.883478 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-3c9592c3-ff9f-45a3-9f20-61711161dc2d tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:17:28.957193 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3c9592c3-ff9f-45a3-9f20-61711161dc2d tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:17:28.967098 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3c9592c3-ff9f-45a3-9f20-61711161dc2d tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:17:28.968798 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3c9592c3-ff9f-45a3-9f20-61711161dc2d tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:17:28.970500 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3c9592c3-ff9f-45a3-9f20-61711161dc2d tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:17:29.065723 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-78aedf04-4aed-4987-aa08-59829018f0a9 tempest-VolumesTestJSON-1614519275 tempest-VolumesTestJSON-1614519275-project] Calling method '.version_select at 0x7fccf7666a60>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:17:29.129265 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-78aedf04-4aed-4987-aa08-59829018f0a9 tempest-VolumesTestJSON-1614519275 tempest-VolumesTestJSON-1614519275-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/3d685d85-b836-4ecb-b20e-adeae955057b" status: 200 len: 351 microversion: 2.1 time: 0.067693 Nov 01 01:17:29.130139 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 32/59] 10.222.0.47 () {58 vars in 1244 bytes} [Mon Nov 1 01:17:29 2021] GET /compute/v2.1/os-volumes/3d685d85-b836-4ecb-b20e-adeae955057b => generated 351 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:17:29.142033 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-446e73d7-119f-454c-8c76-f9098437cb85 tempest-VolumesTestJSON-1614519275 tempest-VolumesTestJSON-1614519275-project] Calling method '.version_select at 0x7fccf6e0ff70>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:17:29.349106 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-3c9592c3-ff9f-45a3-9f20-61711161dc2d tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:17:29.361236 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-3c9592c3-ff9f-45a3-9f20-61711161dc2d tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1295 microversion: 2.1 time: 0.482469 Nov 01 01:17:29.372248 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 28/60] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:17:28 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1295 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:17:29.475003 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-c5cb47ca-bfa1-4d25-9c32-d0ce8b3fe6b9 tempest-VolumesSnapshotsTestJSON-1221600107 tempest-VolumesSnapshotsTestJSON-1221600107-project] Calling method '.version_select at 0x7fccf665c4c0>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:17:29.686695 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-446e73d7-119f-454c-8c76-f9098437cb85 tempest-VolumesTestJSON-1614519275 tempest-VolumesTestJSON-1614519275-project] 10.222.0.47 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.548060 Nov 01 01:17:29.687911 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 33/61] 10.222.0.47 () {58 vars in 1133 bytes} [Mon Nov 1 01:17:29 2021] GET /compute/v2.1/os-volumes => generated 1036 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:17:29.708733 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-819be323-4890-464b-8b20-e7cc0a2bcbb9 tempest-VolumesTestJSON-1614519275 tempest-VolumesTestJSON-1614519275-project] Calling method '.version_select at 0x7fccf6def310>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:17:29.752303 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.wsgi [None req-c5cb47ca-bfa1-4d25-9c32-d0ce8b3fe6b9 tempest-VolumesSnapshotsTestJSON-1221600107 tempest-VolumesSnapshotsTestJSON-1221600107-project] HTTP exception thrown: Snapshot 1a0a6287-0199-458b-8336-335a31620270 could not be found. Nov 01 01:17:29.753903 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-c5cb47ca-bfa1-4d25-9c32-d0ce8b3fe6b9 tempest-VolumesSnapshotsTestJSON-1221600107 tempest-VolumesSnapshotsTestJSON-1221600107-project] Returning 404 to user: Snapshot 1a0a6287-0199-458b-8336-335a31620270 could not be found. {{(pid=116267) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 01 01:17:29.755032 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-c5cb47ca-bfa1-4d25-9c32-d0ce8b3fe6b9 tempest-VolumesSnapshotsTestJSON-1221600107 tempest-VolumesSnapshotsTestJSON-1221600107-project] 10.222.0.47 "GET /compute/v2.1/os-snapshots/1a0a6287-0199-458b-8336-335a31620270" status: 404 len: 111 microversion: 2.1 time: 0.285543 Nov 01 01:17:29.756295 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 29/62] 10.222.0.47 () {58 vars in 1250 bytes} [Mon Nov 1 01:17:29 2021] GET /compute/v2.1/os-snapshots/1a0a6287-0199-458b-8336-335a31620270 => generated 111 bytes in 287 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 01:17:29.765665 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-7b4d1927-a55d-48a3-a41a-945a2bfd00db tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:17:29.769910 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-7b4d1927-a55d-48a3-a41a-945a2bfd00db tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] [instance: 09733ccb-dd41-48bf-bf48-eafba2dfc208] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:17:29.789480 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-7b4d1927-a55d-48a3-a41a-945a2bfd00db tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:17:29.790455 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-7b4d1927-a55d-48a3-a41a-945a2bfd00db tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:17:29.791761 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-7b4d1927-a55d-48a3-a41a-945a2bfd00db tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:17:29.794383 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-7b4d1927-a55d-48a3-a41a-945a2bfd00db tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:17:29.943160 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-819be323-4890-464b-8b20-e7cc0a2bcbb9 tempest-VolumesTestJSON-1614519275 tempest-VolumesTestJSON-1614519275-project] 10.222.0.47 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.245573 Nov 01 01:17:29.943907 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 34/63] 10.222.0.47 () {58 vars in 1148 bytes} [Mon Nov 1 01:17:29 2021] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:17:29.956262 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-7ee537fa-859f-4d36-b785-e3a7ae40147e tempest-VolumesSnapshotsTestJSON-1221600107 tempest-VolumesSnapshotsTestJSON-1221600107-project] Calling method '.version_select at 0x7fccf6e1b1f0>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:17:30.154187 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-7b4d1927-a55d-48a3-a41a-945a2bfd00db tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03064ba5be1410aba9c9c2331b70bd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a798dc4102c4296b56bf54cd38cde6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:17:30.162589 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-7b4d1927-a55d-48a3-a41a-945a2bfd00db tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] 10.222.0.47 "GET /compute/v2.1/servers/09733ccb-dd41-48bf-bf48-eafba2dfc208" status: 200 len: 1315 microversion: 2.1 time: 0.404274 Nov 01 01:17:30.163494 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 30/64] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:17:29 2021] GET /compute/v2.1/servers/09733ccb-dd41-48bf-bf48-eafba2dfc208 => generated 1315 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:17:30.168408 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-606eba8d-f2fe-485c-8247-2376914fbba4 tempest-VolumesTestJSON-1614519275 tempest-VolumesTestJSON-1614519275-project] Calling method '.version_select at 0x7fccf665c820>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:17:30.264231 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-606eba8d-f2fe-485c-8247-2376914fbba4 tempest-VolumesTestJSON-1614519275 tempest-VolumesTestJSON-1614519275-project] 10.222.0.47 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.099444 Nov 01 01:17:30.264971 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 31/65] 10.222.0.47 () {58 vars in 1133 bytes} [Mon Nov 1 01:17:30 2021] GET /compute/v2.1/os-volumes => generated 1036 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:17:30.278960 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-dfd626a4-fdfd-435d-a41f-b3c55d927098 tempest-VolumesTestJSON-1614519275 tempest-VolumesTestJSON-1614519275-project] Calling method '.version_select at 0x7fccf65c75e0>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:17:30.382673 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-dfd626a4-fdfd-435d-a41f-b3c55d927098 tempest-VolumesTestJSON-1614519275 tempest-VolumesTestJSON-1614519275-project] 10.222.0.47 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.108479 Nov 01 01:17:30.391791 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 32/66] 10.222.0.47 () {58 vars in 1166 bytes} [Mon Nov 1 01:17:30 2021] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:17:30.396655 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-5aaa6c87-24c7-4210-8a91-fa5cfff61587 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:17:30.397508 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-5aaa6c87-24c7-4210-8a91-fa5cfff61587 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:17:30.404523 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-5aaa6c87-24c7-4210-8a91-fa5cfff61587 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:17:30.405190 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-5aaa6c87-24c7-4210-8a91-fa5cfff61587 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:17:30.405964 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-5aaa6c87-24c7-4210-8a91-fa5cfff61587 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:17:30.406471 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-5aaa6c87-24c7-4210-8a91-fa5cfff61587 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:17:30.558087 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-5aaa6c87-24c7-4210-8a91-fa5cfff61587 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:17:30.566153 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-5aaa6c87-24c7-4210-8a91-fa5cfff61587 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1362 microversion: 2.1 time: 0.173036 Nov 01 01:17:30.567073 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 33/67] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:17:30 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1362 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:17:30.571649 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-bc24b59f-5dc3-438a-84aa-b13239360ecc tempest-VolumesTestJSON-1614519275 tempest-VolumesTestJSON-1614519275-project] Calling method '.version_select at 0x7fccf65c7af0>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:17:30.658226 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-bc24b59f-5dc3-438a-84aa-b13239360ecc tempest-VolumesTestJSON-1614519275 tempest-VolumesTestJSON-1614519275-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.089878 Nov 01 01:17:30.659378 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 34/68] 10.222.0.47 () {58 vars in 1169 bytes} [Mon Nov 1 01:17:30 2021] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:17:30.671563 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-a33a52c2-4d2e-4863-bf87-734cdf94201b tempest-VolumesTestJSON-1614519275 tempest-VolumesTestJSON-1614519275-project] Calling method '.version_select at 0x7fccf665c670>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:17:30.756507 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-a33a52c2-4d2e-4863-bf87-734cdf94201b tempest-VolumesTestJSON-1614519275 tempest-VolumesTestJSON-1614519275-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.088972 Nov 01 01:17:30.757159 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 35/69] 10.222.0.47 () {58 vars in 1154 bytes} [Mon Nov 1 01:17:30 2021] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:17:30.767534 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-26be702d-92dc-4e5c-b650-bb53e26b7665 tempest-VolumesTestJSON-1614519275 tempest-VolumesTestJSON-1614519275-project] Calling method '.version_select at 0x7fccf65d2f70>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:17:30.947815 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-7ee537fa-859f-4d36-b785-e3a7ae40147e tempest-VolumesSnapshotsTestJSON-1221600107 tempest-VolumesSnapshotsTestJSON-1221600107-project] 10.222.0.47 "DELETE /compute/v2.1/os-volumes/4cbc2978-0dcf-4614-aa2c-b59e05783251" status: 202 len: 0 microversion: 2.1 time: 0.999708 Nov 01 01:17:30.948950 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 35/70] 10.222.0.47 () {58 vars in 1247 bytes} [Mon Nov 1 01:17:29 2021] DELETE /compute/v2.1/os-volumes/4cbc2978-0dcf-4614-aa2c-b59e05783251 => generated 0 bytes in 1002 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 01 01:17:30.959100 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-9d9dafc8-4ee5-4966-8241-0d955d8ff47d tempest-VolumesSnapshotsTestJSON-1221600107 tempest-VolumesSnapshotsTestJSON-1221600107-project] Calling method '.version_select at 0x7fccf7644dc0>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:17:31.041982 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-26be702d-92dc-4e5c-b650-bb53e26b7665 tempest-VolumesTestJSON-1614519275 tempest-VolumesTestJSON-1614519275-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.277657 Nov 01 01:17:31.042575 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 36/71] 10.222.0.47 () {58 vars in 1187 bytes} [Mon Nov 1 01:17:30 2021] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 01 01:17:31.054437 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-69947337-c5d2-45ba-b2e4-b65df7b4d618 tempest-VolumesTestJSON-1614519275 tempest-VolumesTestJSON-1614519275-project] Calling method '.version_select at 0x7fccf665c4c0>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:17:31.099466 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-9d9dafc8-4ee5-4966-8241-0d955d8ff47d tempest-VolumesSnapshotsTestJSON-1221600107 tempest-VolumesSnapshotsTestJSON-1221600107-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/4cbc2978-0dcf-4614-aa2c-b59e05783251" status: 200 len: 344 microversion: 2.1 time: 0.145836 Nov 01 01:17:31.108828 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 36/72] 10.222.0.47 () {58 vars in 1244 bytes} [Mon Nov 1 01:17:30 2021] GET /compute/v2.1/os-volumes/4cbc2978-0dcf-4614-aa2c-b59e05783251 => generated 344 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:17:31.201481 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-709eb3c1-a627-4e19-8a62-0812de16d91c tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:17:31.201481 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-709eb3c1-a627-4e19-8a62-0812de16d91c tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] [instance: 09733ccb-dd41-48bf-bf48-eafba2dfc208] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:17:31.251256 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-709eb3c1-a627-4e19-8a62-0812de16d91c tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:17:31.251256 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-709eb3c1-a627-4e19-8a62-0812de16d91c tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:17:31.251256 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-709eb3c1-a627-4e19-8a62-0812de16d91c tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:17:31.251256 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-709eb3c1-a627-4e19-8a62-0812de16d91c tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:17:31.251817 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-69947337-c5d2-45ba-b2e4-b65df7b4d618 tempest-VolumesTestJSON-1614519275 tempest-VolumesTestJSON-1614519275-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.187948 Nov 01 01:17:31.251817 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 37/73] 10.222.0.47 () {58 vars in 1154 bytes} [Mon Nov 1 01:17:31 2021] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:17:31.342709 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [req-adf7d898-0212-4470-ae31-f5760be9d478 req-75e02355-1f25-4b3f-9b9c-8f4cad42bd4d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09733ccb-dd41-48bf-bf48-eafba2dfc208", "tag": "bae81874-aed7-454c-b211-7fdd6bfa80b2"}]} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:17:31.345156 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 01 01:17:31.345156 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: warnings.warn(msg) Nov 01 01:17:31.356272 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [req-adf7d898-0212-4470-ae31-f5760be9d478 req-75e02355-1f25-4b3f-9b9c-8f4cad42bd4d service nova] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:17:31.356914 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [req-adf7d898-0212-4470-ae31-f5760be9d478 req-75e02355-1f25-4b3f-9b9c-8f4cad42bd4d service nova] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:17:31.377226 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.compute.server_external_events [req-adf7d898-0212-4470-ae31-f5760be9d478 req-75e02355-1f25-4b3f-9b9c-8f4cad42bd4d service nova] Creating event network-changed:bae81874-aed7-454c-b211-7fdd6bfa80b2 for instance 09733ccb-dd41-48bf-bf48-eafba2dfc208 on hv-cinder-81561 Nov 01 01:17:31.378460 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [req-adf7d898-0212-4470-ae31-f5760be9d478 req-75e02355-1f25-4b3f-9b9c-8f4cad42bd4d service nova] Acquired lock "compute-rpcapi-router" {{(pid=116267) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} Nov 01 01:17:31.379612 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-1c3a144e-3851-4fad-8c41-66bf751a3aaf None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:17:31.380043 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-1c3a144e-3851-4fad-8c41-66bf751a3aaf None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:17:31.380820 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-1c3a144e-3851-4fad-8c41-66bf751a3aaf None None] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:17:31.381239 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-1c3a144e-3851-4fad-8c41-66bf751a3aaf None None] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:17:31.389448 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.compute.rpcapi [None req-1c3a144e-3851-4fad-8c41-66bf751a3aaf None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Nov 01 01:17:31.390300 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-1c3a144e-3851-4fad-8c41-66bf751a3aaf None None] Releasing lock "compute-rpcapi-router" {{(pid=116267) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} Nov 01 01:17:31.401711 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-709eb3c1-a627-4e19-8a62-0812de16d91c tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03064ba5be1410aba9c9c2331b70bd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a798dc4102c4296b56bf54cd38cde6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:17:31.418012 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-1c3a144e-3851-4fad-8c41-66bf751a3aaf None None] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.173498 Nov 01 01:17:31.421738 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 38/74] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Nov 1 01:17:31 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:17:31.423264 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-709eb3c1-a627-4e19-8a62-0812de16d91c tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] 10.222.0.47 "GET /compute/v2.1/servers/09733ccb-dd41-48bf-bf48-eafba2dfc208" status: 200 len: 1315 microversion: 2.1 time: 0.242643 Nov 01 01:17:31.423841 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 37/75] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:17:31 2021] GET /compute/v2.1/servers/09733ccb-dd41-48bf-bf48-eafba2dfc208 => generated 1315 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:17:31.585397 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-04e193ea-f0f0-4d1c-8e70-dae5e317aae3 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:17:31.586139 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-04e193ea-f0f0-4d1c-8e70-dae5e317aae3 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:17:31.592396 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-04e193ea-f0f0-4d1c-8e70-dae5e317aae3 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:17:31.592846 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-04e193ea-f0f0-4d1c-8e70-dae5e317aae3 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:17:31.593749 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-04e193ea-f0f0-4d1c-8e70-dae5e317aae3 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:17:31.594183 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-04e193ea-f0f0-4d1c-8e70-dae5e317aae3 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:17:31.827882 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-04e193ea-f0f0-4d1c-8e70-dae5e317aae3 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:17:31.844589 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-04e193ea-f0f0-4d1c-8e70-dae5e317aae3 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1362 microversion: 2.1 time: 0.264829 Nov 01 01:17:31.845240 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 39/76] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:17:31 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1362 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:17:32.113360 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-8e7e1b09-f40e-4a23-ab30-3b228ae314fb tempest-VolumesSnapshotsTestJSON-1221600107 tempest-VolumesSnapshotsTestJSON-1221600107-project] Calling method '.version_select at 0x7fccf6e1bee0>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:17:32.342987 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-8e7e1b09-f40e-4a23-ab30-3b228ae314fb tempest-VolumesSnapshotsTestJSON-1221600107 tempest-VolumesSnapshotsTestJSON-1221600107-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/4cbc2978-0dcf-4614-aa2c-b59e05783251" status: 200 len: 344 microversion: 2.1 time: 0.234558 Nov 01 01:17:32.343545 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 38/77] 10.222.0.47 () {58 vars in 1244 bytes} [Mon Nov 1 01:17:32 2021] GET /compute/v2.1/os-volumes/4cbc2978-0dcf-4614-aa2c-b59e05783251 => generated 344 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:17:32.439457 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-09749883-364f-498a-81c1-edce92969940 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:17:32.440094 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-09749883-364f-498a-81c1-edce92969940 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] [instance: 09733ccb-dd41-48bf-bf48-eafba2dfc208] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:17:32.446026 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-09749883-364f-498a-81c1-edce92969940 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:17:32.446508 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-09749883-364f-498a-81c1-edce92969940 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:17:32.447273 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-09749883-364f-498a-81c1-edce92969940 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:17:32.447705 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-09749883-364f-498a-81c1-edce92969940 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:17:32.568183 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-09749883-364f-498a-81c1-edce92969940 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03064ba5be1410aba9c9c2331b70bd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a798dc4102c4296b56bf54cd38cde6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:17:32.575479 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-09749883-364f-498a-81c1-edce92969940 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] 10.222.0.47 "GET /compute/v2.1/servers/09733ccb-dd41-48bf-bf48-eafba2dfc208" status: 200 len: 1315 microversion: 2.1 time: 0.139581 Nov 01 01:17:32.576037 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 40/78] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:17:32 2021] GET /compute/v2.1/servers/09733ccb-dd41-48bf-bf48-eafba2dfc208 => generated 1315 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:17:32.860878 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-1b1c2b23-dcd5-43d4-9df4-6abde27e3895 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:17:32.861476 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-1b1c2b23-dcd5-43d4-9df4-6abde27e3895 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:17:32.868951 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1b1c2b23-dcd5-43d4-9df4-6abde27e3895 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:17:32.869295 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1b1c2b23-dcd5-43d4-9df4-6abde27e3895 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:17:32.870060 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1b1c2b23-dcd5-43d4-9df4-6abde27e3895 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:17:32.870620 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1b1c2b23-dcd5-43d4-9df4-6abde27e3895 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:17:33.242011 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-1b1c2b23-dcd5-43d4-9df4-6abde27e3895 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:17:33.242011 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-1b1c2b23-dcd5-43d4-9df4-6abde27e3895 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1362 microversion: 2.1 time: 0.176930 Nov 01 01:17:33.242011 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 39/79] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:17:32 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1362 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:17:33.355525 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-9abd9f4b-9bd4-41e6-a3c8-3ae3393d6f1e tempest-VolumesSnapshotsTestJSON-1221600107 tempest-VolumesSnapshotsTestJSON-1221600107-project] Calling method '.version_select at 0x7fccf656c940>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:17:33.414817 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-9abd9f4b-9bd4-41e6-a3c8-3ae3393d6f1e tempest-VolumesSnapshotsTestJSON-1221600107 tempest-VolumesSnapshotsTestJSON-1221600107-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/4cbc2978-0dcf-4614-aa2c-b59e05783251" status: 200 len: 344 microversion: 2.1 time: 0.062785 Nov 01 01:17:33.415395 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 41/80] 10.222.0.47 () {58 vars in 1244 bytes} [Mon Nov 1 01:17:33 2021] GET /compute/v2.1/os-volumes/4cbc2978-0dcf-4614-aa2c-b59e05783251 => generated 344 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:17:33.592808 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-dc9b8b5b-3442-4aba-9d6a-ba3bd2de9ed5 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:17:33.593474 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-dc9b8b5b-3442-4aba-9d6a-ba3bd2de9ed5 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] [instance: 09733ccb-dd41-48bf-bf48-eafba2dfc208] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:17:33.599809 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-dc9b8b5b-3442-4aba-9d6a-ba3bd2de9ed5 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:17:33.600258 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-dc9b8b5b-3442-4aba-9d6a-ba3bd2de9ed5 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:17:33.601025 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-dc9b8b5b-3442-4aba-9d6a-ba3bd2de9ed5 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:17:33.601458 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-dc9b8b5b-3442-4aba-9d6a-ba3bd2de9ed5 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:17:33.722715 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-dc9b8b5b-3442-4aba-9d6a-ba3bd2de9ed5 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03064ba5be1410aba9c9c2331b70bd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a798dc4102c4296b56bf54cd38cde6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:17:33.730403 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-dc9b8b5b-3442-4aba-9d6a-ba3bd2de9ed5 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] 10.222.0.47 "GET /compute/v2.1/servers/09733ccb-dd41-48bf-bf48-eafba2dfc208" status: 200 len: 1315 microversion: 2.1 time: 0.141497 Nov 01 01:17:33.730996 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 40/81] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:17:33 2021] GET /compute/v2.1/servers/09733ccb-dd41-48bf-bf48-eafba2dfc208 => generated 1315 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:17:34.163361 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-72634ac8-13e1-4016-8ea1-13b0b5647867 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:17:34.163974 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-72634ac8-13e1-4016-8ea1-13b0b5647867 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:17:34.170468 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-72634ac8-13e1-4016-8ea1-13b0b5647867 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:17:34.190140 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-72634ac8-13e1-4016-8ea1-13b0b5647867 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:17:34.190140 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-72634ac8-13e1-4016-8ea1-13b0b5647867 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:17:34.190140 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-72634ac8-13e1-4016-8ea1-13b0b5647867 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:17:34.305553 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-72634ac8-13e1-4016-8ea1-13b0b5647867 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:17:34.313121 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-72634ac8-13e1-4016-8ea1-13b0b5647867 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1362 microversion: 2.1 time: 0.157132 Nov 01 01:17:34.313691 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 42/82] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:17:34 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:17:34.427144 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-bfe13216-978c-493e-a27c-5d2d4f51773e tempest-VolumesSnapshotsTestJSON-1221600107 tempest-VolumesSnapshotsTestJSON-1221600107-project] Calling method '.version_select at 0x7fccf765af70>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:17:34.492411 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-bfe13216-978c-493e-a27c-5d2d4f51773e tempest-VolumesSnapshotsTestJSON-1221600107 tempest-VolumesSnapshotsTestJSON-1221600107-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/4cbc2978-0dcf-4614-aa2c-b59e05783251" status: 200 len: 344 microversion: 2.1 time: 0.068875 Nov 01 01:17:34.493116 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 41/83] 10.222.0.47 () {58 vars in 1244 bytes} [Mon Nov 1 01:17:34 2021] GET /compute/v2.1/os-volumes/4cbc2978-0dcf-4614-aa2c-b59e05783251 => generated 344 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:17:34.747958 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-b9f06bbe-3a35-4efb-8392-0cd255b3c2ed tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:17:34.748561 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-b9f06bbe-3a35-4efb-8392-0cd255b3c2ed tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] [instance: 09733ccb-dd41-48bf-bf48-eafba2dfc208] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:17:34.754171 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b9f06bbe-3a35-4efb-8392-0cd255b3c2ed tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:17:34.754727 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b9f06bbe-3a35-4efb-8392-0cd255b3c2ed tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:17:34.759848 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b9f06bbe-3a35-4efb-8392-0cd255b3c2ed tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:17:34.759848 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b9f06bbe-3a35-4efb-8392-0cd255b3c2ed tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:17:34.880612 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-b9f06bbe-3a35-4efb-8392-0cd255b3c2ed tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03064ba5be1410aba9c9c2331b70bd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a798dc4102c4296b56bf54cd38cde6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:17:34.888641 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-b9f06bbe-3a35-4efb-8392-0cd255b3c2ed tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] 10.222.0.47 "GET /compute/v2.1/servers/09733ccb-dd41-48bf-bf48-eafba2dfc208" status: 200 len: 1315 microversion: 2.1 time: 0.144382 Nov 01 01:17:34.890083 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 43/84] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:17:34 2021] GET /compute/v2.1/servers/09733ccb-dd41-48bf-bf48-eafba2dfc208 => generated 1315 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:17:35.331911 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-97c9cada-7d7b-47a2-8ea0-cbde4492b242 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:17:35.332553 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-97c9cada-7d7b-47a2-8ea0-cbde4492b242 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:17:35.340754 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-97c9cada-7d7b-47a2-8ea0-cbde4492b242 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:17:35.341934 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-97c9cada-7d7b-47a2-8ea0-cbde4492b242 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:17:35.343270 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-97c9cada-7d7b-47a2-8ea0-cbde4492b242 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:17:35.344114 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-97c9cada-7d7b-47a2-8ea0-cbde4492b242 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:17:35.485594 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-97c9cada-7d7b-47a2-8ea0-cbde4492b242 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:17:35.493931 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-97c9cada-7d7b-47a2-8ea0-cbde4492b242 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1362 microversion: 2.1 time: 0.166461 Nov 01 01:17:35.494617 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 42/85] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:17:35 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1362 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:17:35.508782 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-378eef82-342f-4d5d-a3a6-501f7628b141 tempest-VolumesSnapshotsTestJSON-1221600107 tempest-VolumesSnapshotsTestJSON-1221600107-project] Calling method '.version_select at 0x7fccf665ce50>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:17:35.572193 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-378eef82-342f-4d5d-a3a6-501f7628b141 tempest-VolumesSnapshotsTestJSON-1221600107 tempest-VolumesSnapshotsTestJSON-1221600107-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/4cbc2978-0dcf-4614-aa2c-b59e05783251" status: 200 len: 344 microversion: 2.1 time: 0.066961 Nov 01 01:17:35.572913 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 44/86] 10.222.0.47 () {58 vars in 1244 bytes} [Mon Nov 1 01:17:35 2021] GET /compute/v2.1/os-volumes/4cbc2978-0dcf-4614-aa2c-b59e05783251 => generated 344 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:17:35.907100 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-8efa2639-f630-4eeb-bfc3-c88d37ffa988 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:17:35.907809 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-8efa2639-f630-4eeb-bfc3-c88d37ffa988 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] [instance: 09733ccb-dd41-48bf-bf48-eafba2dfc208] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:17:35.914387 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8efa2639-f630-4eeb-bfc3-c88d37ffa988 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:17:35.914964 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8efa2639-f630-4eeb-bfc3-c88d37ffa988 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:17:35.915736 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8efa2639-f630-4eeb-bfc3-c88d37ffa988 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:17:35.916184 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8efa2639-f630-4eeb-bfc3-c88d37ffa988 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:17:36.032573 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-8efa2639-f630-4eeb-bfc3-c88d37ffa988 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03064ba5be1410aba9c9c2331b70bd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a798dc4102c4296b56bf54cd38cde6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:17:36.040310 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-8efa2639-f630-4eeb-bfc3-c88d37ffa988 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] 10.222.0.47 "GET /compute/v2.1/servers/09733ccb-dd41-48bf-bf48-eafba2dfc208" status: 200 len: 1315 microversion: 2.1 time: 0.136837 Nov 01 01:17:36.040906 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 43/87] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:17:35 2021] GET /compute/v2.1/servers/09733ccb-dd41-48bf-bf48-eafba2dfc208 => generated 1315 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:17:36.511465 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-1e4c4efd-6c82-4fb9-9958-89744d7adba8 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:17:36.512071 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-1e4c4efd-6c82-4fb9-9958-89744d7adba8 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:17:36.518791 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-1e4c4efd-6c82-4fb9-9958-89744d7adba8 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:17:36.519231 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-1e4c4efd-6c82-4fb9-9958-89744d7adba8 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:17:36.520025 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-1e4c4efd-6c82-4fb9-9958-89744d7adba8 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:17:36.520446 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-1e4c4efd-6c82-4fb9-9958-89744d7adba8 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:17:36.584493 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-7da691f6-cf19-456c-b23f-a24519409943 tempest-VolumesSnapshotsTestJSON-1221600107 tempest-VolumesSnapshotsTestJSON-1221600107-project] Calling method '.version_select at 0x7fccf7666430>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:17:36.645737 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-1e4c4efd-6c82-4fb9-9958-89744d7adba8 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:17:36.653255 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-1e4c4efd-6c82-4fb9-9958-89744d7adba8 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1362 microversion: 2.1 time: 0.145601 Nov 01 01:17:36.662219 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 45/88] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:17:36 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1362 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:17:36.669613 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-7da691f6-cf19-456c-b23f-a24519409943 tempest-VolumesSnapshotsTestJSON-1221600107 tempest-VolumesSnapshotsTestJSON-1221600107-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/4cbc2978-0dcf-4614-aa2c-b59e05783251" status: 200 len: 344 microversion: 2.1 time: 0.089280 Nov 01 01:17:36.670172 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 44/89] 10.222.0.47 () {58 vars in 1244 bytes} [Mon Nov 1 01:17:36 2021] GET /compute/v2.1/os-volumes/4cbc2978-0dcf-4614-aa2c-b59e05783251 => generated 344 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 01 01:17:37.057116 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-4f10671e-b61f-43b3-959c-35bc62e22f42 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:17:37.057734 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-4f10671e-b61f-43b3-959c-35bc62e22f42 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] [instance: 09733ccb-dd41-48bf-bf48-eafba2dfc208] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:17:37.063829 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4f10671e-b61f-43b3-959c-35bc62e22f42 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:17:37.064278 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4f10671e-b61f-43b3-959c-35bc62e22f42 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:17:37.065668 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4f10671e-b61f-43b3-959c-35bc62e22f42 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:17:37.066101 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4f10671e-b61f-43b3-959c-35bc62e22f42 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:17:37.188773 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-4f10671e-b61f-43b3-959c-35bc62e22f42 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03064ba5be1410aba9c9c2331b70bd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a798dc4102c4296b56bf54cd38cde6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:17:37.197221 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-4f10671e-b61f-43b3-959c-35bc62e22f42 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] 10.222.0.47 "GET /compute/v2.1/servers/09733ccb-dd41-48bf-bf48-eafba2dfc208" status: 200 len: 1315 microversion: 2.1 time: 0.143869 Nov 01 01:17:37.198291 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 46/90] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:17:37 2021] GET /compute/v2.1/servers/09733ccb-dd41-48bf-bf48-eafba2dfc208 => generated 1315 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:17:37.670075 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-bee63b8f-cbef-472a-9f60-4af4299e70e3 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:17:37.670742 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-bee63b8f-cbef-472a-9f60-4af4299e70e3 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:17:37.676762 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-bee63b8f-cbef-472a-9f60-4af4299e70e3 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:17:37.677010 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-bee63b8f-cbef-472a-9f60-4af4299e70e3 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:17:37.677829 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-bee63b8f-cbef-472a-9f60-4af4299e70e3 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:17:37.678266 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-bee63b8f-cbef-472a-9f60-4af4299e70e3 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:17:37.682106 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-2040b899-d8bc-440e-b1bc-883db9388c6f tempest-VolumesSnapshotsTestJSON-1221600107 tempest-VolumesSnapshotsTestJSON-1221600107-project] Calling method '.version_select at 0x7fccf65c7310>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:17:37.728194 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-2040b899-d8bc-440e-b1bc-883db9388c6f tempest-VolumesSnapshotsTestJSON-1221600107 tempest-VolumesSnapshotsTestJSON-1221600107-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/4cbc2978-0dcf-4614-aa2c-b59e05783251" status: 200 len: 344 microversion: 2.1 time: 0.049567 Nov 01 01:17:37.728760 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 47/91] 10.222.0.47 () {58 vars in 1244 bytes} [Mon Nov 1 01:17:37 2021] GET /compute/v2.1/os-volumes/4cbc2978-0dcf-4614-aa2c-b59e05783251 => generated 344 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:17:37.802756 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-bee63b8f-cbef-472a-9f60-4af4299e70e3 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:17:37.808113 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-bee63b8f-cbef-472a-9f60-4af4299e70e3 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1362 microversion: 2.1 time: 0.142587 Nov 01 01:17:37.808681 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 45/92] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:17:37 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1362 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:17:38.213860 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-bad4aa7c-d022-4ec8-9de9-8694a1ba64e6 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:17:38.214841 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-bad4aa7c-d022-4ec8-9de9-8694a1ba64e6 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] [instance: 09733ccb-dd41-48bf-bf48-eafba2dfc208] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:17:38.221920 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-bad4aa7c-d022-4ec8-9de9-8694a1ba64e6 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:17:38.222594 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-bad4aa7c-d022-4ec8-9de9-8694a1ba64e6 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:17:38.223554 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-bad4aa7c-d022-4ec8-9de9-8694a1ba64e6 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:17:38.224018 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-bad4aa7c-d022-4ec8-9de9-8694a1ba64e6 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:17:38.354599 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-bad4aa7c-d022-4ec8-9de9-8694a1ba64e6 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03064ba5be1410aba9c9c2331b70bd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a798dc4102c4296b56bf54cd38cde6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:17:38.369196 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-bad4aa7c-d022-4ec8-9de9-8694a1ba64e6 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] 10.222.0.47 "GET /compute/v2.1/servers/09733ccb-dd41-48bf-bf48-eafba2dfc208" status: 200 len: 1315 microversion: 2.1 time: 0.158975 Nov 01 01:17:38.369779 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 48/93] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:17:38 2021] GET /compute/v2.1/servers/09733ccb-dd41-48bf-bf48-eafba2dfc208 => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:17:38.741152 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-7a647250-5723-48ff-8b1e-2b3a915c0a7c tempest-VolumesSnapshotsTestJSON-1221600107 tempest-VolumesSnapshotsTestJSON-1221600107-project] Calling method '.version_select at 0x7fccf7666a60>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:17:38.825883 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-cfc13311-8195-4359-b2e4-6fcd97d2a66d tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:17:38.826817 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-cfc13311-8195-4359-b2e4-6fcd97d2a66d tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:17:38.835075 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-cfc13311-8195-4359-b2e4-6fcd97d2a66d tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:17:38.842234 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-cfc13311-8195-4359-b2e4-6fcd97d2a66d tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:17:38.847127 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-cfc13311-8195-4359-b2e4-6fcd97d2a66d tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:17:38.847127 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-cfc13311-8195-4359-b2e4-6fcd97d2a66d tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:17:38.954006 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-7a647250-5723-48ff-8b1e-2b3a915c0a7c tempest-VolumesSnapshotsTestJSON-1221600107 tempest-VolumesSnapshotsTestJSON-1221600107-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/4cbc2978-0dcf-4614-aa2c-b59e05783251" status: 200 len: 344 microversion: 2.1 time: 0.216231 Nov 01 01:17:38.955271 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 46/94] 10.222.0.47 () {58 vars in 1244 bytes} [Mon Nov 1 01:17:38 2021] GET /compute/v2.1/os-volumes/4cbc2978-0dcf-4614-aa2c-b59e05783251 => generated 344 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 01 01:17:38.990542 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-cfc13311-8195-4359-b2e4-6fcd97d2a66d tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:17:39.001694 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-cfc13311-8195-4359-b2e4-6fcd97d2a66d tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1362 microversion: 2.1 time: 0.177320 Nov 01 01:17:39.001694 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 49/95] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:17:38 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1362 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:17:39.401013 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-d5bed7fb-64e7-4ece-ac57-895cb442a7df tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:17:39.401013 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-d5bed7fb-64e7-4ece-ac57-895cb442a7df tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] [instance: 09733ccb-dd41-48bf-bf48-eafba2dfc208] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:17:39.401013 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d5bed7fb-64e7-4ece-ac57-895cb442a7df tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:17:39.401013 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d5bed7fb-64e7-4ece-ac57-895cb442a7df tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:17:39.401368 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d5bed7fb-64e7-4ece-ac57-895cb442a7df tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:17:39.401368 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d5bed7fb-64e7-4ece-ac57-895cb442a7df tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:17:39.528203 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-d5bed7fb-64e7-4ece-ac57-895cb442a7df tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03064ba5be1410aba9c9c2331b70bd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a798dc4102c4296b56bf54cd38cde6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:17:39.536195 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-d5bed7fb-64e7-4ece-ac57-895cb442a7df tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] 10.222.0.47 "GET /compute/v2.1/servers/09733ccb-dd41-48bf-bf48-eafba2dfc208" status: 200 len: 1315 microversion: 2.1 time: 0.153043 Nov 01 01:17:39.537377 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 47/96] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:17:39 2021] GET /compute/v2.1/servers/09733ccb-dd41-48bf-bf48-eafba2dfc208 => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:17:39.967072 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-ece676fc-1bb7-4bff-badd-d89c71375323 tempest-VolumesSnapshotsTestJSON-1221600107 tempest-VolumesSnapshotsTestJSON-1221600107-project] Calling method '.version_select at 0x7fccf665ce50>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:17:40.015756 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-ece676fc-1bb7-4bff-badd-d89c71375323 tempest-VolumesSnapshotsTestJSON-1221600107 tempest-VolumesSnapshotsTestJSON-1221600107-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/4cbc2978-0dcf-4614-aa2c-b59e05783251" status: 200 len: 344 microversion: 2.1 time: 0.052424 Nov 01 01:17:40.017091 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-fca61b14-afd3-4b8b-a352-546eb5b99e7d tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:17:40.017900 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-fca61b14-afd3-4b8b-a352-546eb5b99e7d tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:17:40.020785 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 50/97] 10.222.0.47 () {58 vars in 1244 bytes} [Mon Nov 1 01:17:39 2021] GET /compute/v2.1/os-volumes/4cbc2978-0dcf-4614-aa2c-b59e05783251 => generated 344 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:17:40.024160 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-fca61b14-afd3-4b8b-a352-546eb5b99e7d tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:17:40.024693 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-fca61b14-afd3-4b8b-a352-546eb5b99e7d tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:17:40.025532 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-fca61b14-afd3-4b8b-a352-546eb5b99e7d tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:17:40.025969 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-fca61b14-afd3-4b8b-a352-546eb5b99e7d tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:17:40.148199 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-fca61b14-afd3-4b8b-a352-546eb5b99e7d tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:17:40.155694 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-fca61b14-afd3-4b8b-a352-546eb5b99e7d tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1362 microversion: 2.1 time: 0.142259 Nov 01 01:17:40.156862 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 48/98] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:17:40 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1362 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:17:40.553648 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-7a1a29ba-3acb-4cfa-a46b-13bf24ef50dd tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:17:40.554269 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-7a1a29ba-3acb-4cfa-a46b-13bf24ef50dd tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] [instance: 09733ccb-dd41-48bf-bf48-eafba2dfc208] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:17:40.559984 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-7a1a29ba-3acb-4cfa-a46b-13bf24ef50dd tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:17:40.560429 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-7a1a29ba-3acb-4cfa-a46b-13bf24ef50dd tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:17:40.561215 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-7a1a29ba-3acb-4cfa-a46b-13bf24ef50dd tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:17:40.561620 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-7a1a29ba-3acb-4cfa-a46b-13bf24ef50dd tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:17:40.698597 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-7a1a29ba-3acb-4cfa-a46b-13bf24ef50dd tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03064ba5be1410aba9c9c2331b70bd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a798dc4102c4296b56bf54cd38cde6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:17:40.708122 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-7a1a29ba-3acb-4cfa-a46b-13bf24ef50dd tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] 10.222.0.47 "GET /compute/v2.1/servers/09733ccb-dd41-48bf-bf48-eafba2dfc208" status: 200 len: 1315 microversion: 2.1 time: 0.158072 Nov 01 01:17:40.708962 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 51/99] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:17:40 2021] GET /compute/v2.1/servers/09733ccb-dd41-48bf-bf48-eafba2dfc208 => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:17:41.027653 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-46e65ba7-3f36-413f-ad62-28a3a38cfc8e tempest-VolumesSnapshotsTestJSON-1221600107 tempest-VolumesSnapshotsTestJSON-1221600107-project] Calling method '.version_select at 0x7fccf7644e50>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:17:41.076842 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-46e65ba7-3f36-413f-ad62-28a3a38cfc8e tempest-VolumesSnapshotsTestJSON-1221600107 tempest-VolumesSnapshotsTestJSON-1221600107-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/4cbc2978-0dcf-4614-aa2c-b59e05783251" status: 200 len: 344 microversion: 2.1 time: 0.053267 Nov 01 01:17:41.077696 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 49/100] 10.222.0.47 () {58 vars in 1244 bytes} [Mon Nov 1 01:17:41 2021] GET /compute/v2.1/os-volumes/4cbc2978-0dcf-4614-aa2c-b59e05783251 => generated 344 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:17:41.176132 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-2e898150-6455-48de-aee7-9da930feca93 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:17:41.176751 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-2e898150-6455-48de-aee7-9da930feca93 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:17:41.182700 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-2e898150-6455-48de-aee7-9da930feca93 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:17:41.183143 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-2e898150-6455-48de-aee7-9da930feca93 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:17:41.183897 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-2e898150-6455-48de-aee7-9da930feca93 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:17:41.184323 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-2e898150-6455-48de-aee7-9da930feca93 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:17:41.319714 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-2e898150-6455-48de-aee7-9da930feca93 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:17:41.327081 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-2e898150-6455-48de-aee7-9da930feca93 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1362 microversion: 2.1 time: 0.157042 Nov 01 01:17:41.327646 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 52/101] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:17:41 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:17:41.725384 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-814598a1-3a85-43ee-b149-6db235b940d2 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:17:41.727230 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-814598a1-3a85-43ee-b149-6db235b940d2 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] [instance: 09733ccb-dd41-48bf-bf48-eafba2dfc208] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:17:41.733207 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-814598a1-3a85-43ee-b149-6db235b940d2 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:17:41.733659 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-814598a1-3a85-43ee-b149-6db235b940d2 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:17:41.734452 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-814598a1-3a85-43ee-b149-6db235b940d2 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:17:41.734893 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-814598a1-3a85-43ee-b149-6db235b940d2 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:17:41.855309 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-814598a1-3a85-43ee-b149-6db235b940d2 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03064ba5be1410aba9c9c2331b70bd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a798dc4102c4296b56bf54cd38cde6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:17:41.862854 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-814598a1-3a85-43ee-b149-6db235b940d2 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] 10.222.0.47 "GET /compute/v2.1/servers/09733ccb-dd41-48bf-bf48-eafba2dfc208" status: 200 len: 1315 microversion: 2.1 time: 0.141619 Nov 01 01:17:41.863642 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 50/102] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:17:41 2021] GET /compute/v2.1/servers/09733ccb-dd41-48bf-bf48-eafba2dfc208 => generated 1315 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:17:42.090881 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-3b4e4a94-6f12-4227-a05e-9a35ee03fe5e tempest-VolumesSnapshotsTestJSON-1221600107 tempest-VolumesSnapshotsTestJSON-1221600107-project] Calling method '.version_select at 0x7fccf65d2040>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:17:42.144272 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-3b4e4a94-6f12-4227-a05e-9a35ee03fe5e tempest-VolumesSnapshotsTestJSON-1221600107 tempest-VolumesSnapshotsTestJSON-1221600107-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/4cbc2978-0dcf-4614-aa2c-b59e05783251" status: 200 len: 344 microversion: 2.1 time: 0.058948 Nov 01 01:17:42.145067 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 53/103] 10.222.0.47 () {58 vars in 1244 bytes} [Mon Nov 1 01:17:42 2021] GET /compute/v2.1/os-volumes/4cbc2978-0dcf-4614-aa2c-b59e05783251 => generated 344 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:17:42.344801 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-4f5aa0e0-8dcd-4c84-a7e3-9449e044f761 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:17:42.346089 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-4f5aa0e0-8dcd-4c84-a7e3-9449e044f761 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:17:42.360069 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4f5aa0e0-8dcd-4c84-a7e3-9449e044f761 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:17:42.360518 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4f5aa0e0-8dcd-4c84-a7e3-9449e044f761 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:17:42.361784 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4f5aa0e0-8dcd-4c84-a7e3-9449e044f761 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:17:42.371118 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4f5aa0e0-8dcd-4c84-a7e3-9449e044f761 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:17:42.524985 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-4f5aa0e0-8dcd-4c84-a7e3-9449e044f761 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:17:42.532915 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-4f5aa0e0-8dcd-4c84-a7e3-9449e044f761 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1362 microversion: 2.1 time: 0.192480 Nov 01 01:17:42.533917 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 51/104] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:17:42 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1362 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:17:42.880593 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-f9374cec-39bd-4d7d-9f72-b65ab2fc96ba tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:17:42.881187 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-f9374cec-39bd-4d7d-9f72-b65ab2fc96ba tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] [instance: 09733ccb-dd41-48bf-bf48-eafba2dfc208] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:17:42.887073 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f9374cec-39bd-4d7d-9f72-b65ab2fc96ba tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:17:42.887511 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f9374cec-39bd-4d7d-9f72-b65ab2fc96ba tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:17:42.888256 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f9374cec-39bd-4d7d-9f72-b65ab2fc96ba tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:17:42.888678 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f9374cec-39bd-4d7d-9f72-b65ab2fc96ba tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:17:43.020717 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-f9374cec-39bd-4d7d-9f72-b65ab2fc96ba tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03064ba5be1410aba9c9c2331b70bd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a798dc4102c4296b56bf54cd38cde6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:17:43.028227 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-f9374cec-39bd-4d7d-9f72-b65ab2fc96ba tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] 10.222.0.47 "GET /compute/v2.1/servers/09733ccb-dd41-48bf-bf48-eafba2dfc208" status: 200 len: 1315 microversion: 2.1 time: 0.151877 Nov 01 01:17:43.029992 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 54/105] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:17:42 2021] GET /compute/v2.1/servers/09733ccb-dd41-48bf-bf48-eafba2dfc208 => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:17:43.156500 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-a36289b9-e596-4865-a5bd-2f4432854985 tempest-VolumesSnapshotsTestJSON-1221600107 tempest-VolumesSnapshotsTestJSON-1221600107-project] Calling method '.version_select at 0x7fccf805b4c0>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:17:43.206283 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-a36289b9-e596-4865-a5bd-2f4432854985 tempest-VolumesSnapshotsTestJSON-1221600107 tempest-VolumesSnapshotsTestJSON-1221600107-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/4cbc2978-0dcf-4614-aa2c-b59e05783251" status: 200 len: 344 microversion: 2.1 time: 0.053348 Nov 01 01:17:43.219895 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 52/106] 10.222.0.47 () {58 vars in 1244 bytes} [Mon Nov 1 01:17:43 2021] GET /compute/v2.1/os-volumes/4cbc2978-0dcf-4614-aa2c-b59e05783251 => generated 344 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 01 01:17:43.549499 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-3a505f9c-9c61-4e56-b93a-288645663b9f tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:17:43.550399 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-3a505f9c-9c61-4e56-b93a-288645663b9f tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:17:43.556257 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3a505f9c-9c61-4e56-b93a-288645663b9f tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:17:43.556691 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3a505f9c-9c61-4e56-b93a-288645663b9f tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:17:43.557468 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3a505f9c-9c61-4e56-b93a-288645663b9f tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:17:43.557888 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3a505f9c-9c61-4e56-b93a-288645663b9f tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:17:43.691075 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-3a505f9c-9c61-4e56-b93a-288645663b9f tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:17:43.702555 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-3a505f9c-9c61-4e56-b93a-288645663b9f tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1362 microversion: 2.1 time: 0.154086 Nov 01 01:17:43.702555 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 55/107] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:17:43 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:17:44.045061 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-d0102f9a-605b-4a9c-9a13-212e8ce5e9c7 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:17:44.045673 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-d0102f9a-605b-4a9c-9a13-212e8ce5e9c7 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] [instance: 09733ccb-dd41-48bf-bf48-eafba2dfc208] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:17:44.051518 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d0102f9a-605b-4a9c-9a13-212e8ce5e9c7 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:17:44.051969 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d0102f9a-605b-4a9c-9a13-212e8ce5e9c7 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:17:44.052729 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d0102f9a-605b-4a9c-9a13-212e8ce5e9c7 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:17:44.053162 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d0102f9a-605b-4a9c-9a13-212e8ce5e9c7 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:17:44.175132 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-d0102f9a-605b-4a9c-9a13-212e8ce5e9c7 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03064ba5be1410aba9c9c2331b70bd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a798dc4102c4296b56bf54cd38cde6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:17:44.183613 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-d0102f9a-605b-4a9c-9a13-212e8ce5e9c7 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] 10.222.0.47 "GET /compute/v2.1/servers/09733ccb-dd41-48bf-bf48-eafba2dfc208" status: 200 len: 1315 microversion: 2.1 time: 0.142219 Nov 01 01:17:44.184167 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 53/108] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:17:44 2021] GET /compute/v2.1/servers/09733ccb-dd41-48bf-bf48-eafba2dfc208 => generated 1315 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:17:44.230253 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-afd5d848-5aa5-4116-9a0f-2ea7aef4a316 tempest-VolumesSnapshotsTestJSON-1221600107 tempest-VolumesSnapshotsTestJSON-1221600107-project] Calling method '.version_select at 0x7fccf65fb940>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:17:44.276372 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-afd5d848-5aa5-4116-9a0f-2ea7aef4a316 tempest-VolumesSnapshotsTestJSON-1221600107 tempest-VolumesSnapshotsTestJSON-1221600107-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/4cbc2978-0dcf-4614-aa2c-b59e05783251" status: 200 len: 344 microversion: 2.1 time: 0.049767 Nov 01 01:17:44.276975 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 56/109] 10.222.0.47 () {58 vars in 1244 bytes} [Mon Nov 1 01:17:44 2021] GET /compute/v2.1/os-volumes/4cbc2978-0dcf-4614-aa2c-b59e05783251 => generated 344 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:17:44.716322 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-38e6da0d-9866-46cd-b8b9-eddcd5313f4d tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:17:44.716955 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-38e6da0d-9866-46cd-b8b9-eddcd5313f4d tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:17:44.723290 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-38e6da0d-9866-46cd-b8b9-eddcd5313f4d tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:17:44.723930 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-38e6da0d-9866-46cd-b8b9-eddcd5313f4d tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:17:44.724561 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-38e6da0d-9866-46cd-b8b9-eddcd5313f4d tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:17:44.725072 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-38e6da0d-9866-46cd-b8b9-eddcd5313f4d tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:17:44.854803 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-38e6da0d-9866-46cd-b8b9-eddcd5313f4d tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:17:44.862079 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-38e6da0d-9866-46cd-b8b9-eddcd5313f4d tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1362 microversion: 2.1 time: 0.149436 Nov 01 01:17:44.862663 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 54/110] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:17:44 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1362 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:17:45.202295 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-bf963986-abbe-47b9-a781-41accc6e438e tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:17:45.203459 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-bf963986-abbe-47b9-a781-41accc6e438e tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] [instance: 09733ccb-dd41-48bf-bf48-eafba2dfc208] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:17:45.215652 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-bf963986-abbe-47b9-a781-41accc6e438e tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:17:45.216100 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-bf963986-abbe-47b9-a781-41accc6e438e tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:17:45.217423 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-bf963986-abbe-47b9-a781-41accc6e438e tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:17:45.217854 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-bf963986-abbe-47b9-a781-41accc6e438e tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:17:45.290862 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-9906969a-df8d-4c59-bc0b-e746af11b1a8 tempest-VolumesSnapshotsTestJSON-1221600107 tempest-VolumesSnapshotsTestJSON-1221600107-project] Calling method '.version_select at 0x7fccf76668b0>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:17:45.345026 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-9906969a-df8d-4c59-bc0b-e746af11b1a8 tempest-VolumesSnapshotsTestJSON-1221600107 tempest-VolumesSnapshotsTestJSON-1221600107-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/4cbc2978-0dcf-4614-aa2c-b59e05783251" status: 200 len: 344 microversion: 2.1 time: 0.057833 Nov 01 01:17:45.345825 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 55/111] 10.222.0.47 () {58 vars in 1244 bytes} [Mon Nov 1 01:17:45 2021] GET /compute/v2.1/os-volumes/4cbc2978-0dcf-4614-aa2c-b59e05783251 => generated 344 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:17:45.501998 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-bf963986-abbe-47b9-a781-41accc6e438e tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03064ba5be1410aba9c9c2331b70bd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a798dc4102c4296b56bf54cd38cde6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:17:45.514272 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-bf963986-abbe-47b9-a781-41accc6e438e tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] 10.222.0.47 "GET /compute/v2.1/servers/09733ccb-dd41-48bf-bf48-eafba2dfc208" status: 200 len: 1315 microversion: 2.1 time: 0.316769 Nov 01 01:17:45.515773 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 57/112] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:17:45 2021] GET /compute/v2.1/servers/09733ccb-dd41-48bf-bf48-eafba2dfc208 => generated 1315 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:17:45.878673 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-22ccfbb0-2f62-4678-87e2-e71807aa8f48 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:17:45.879539 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-22ccfbb0-2f62-4678-87e2-e71807aa8f48 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:17:45.886340 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-22ccfbb0-2f62-4678-87e2-e71807aa8f48 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:17:45.886883 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-22ccfbb0-2f62-4678-87e2-e71807aa8f48 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:17:45.887776 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-22ccfbb0-2f62-4678-87e2-e71807aa8f48 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:17:45.888083 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-22ccfbb0-2f62-4678-87e2-e71807aa8f48 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:17:46.340891 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-22ccfbb0-2f62-4678-87e2-e71807aa8f48 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:17:46.354218 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-22ccfbb0-2f62-4678-87e2-e71807aa8f48 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1362 microversion: 2.1 time: 0.479115 Nov 01 01:17:46.355390 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 56/113] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:17:45 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1362 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:17:46.376359 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-37f3dc6b-314c-4620-9220-a9a17b0e3168 tempest-VolumesSnapshotsTestJSON-1221600107 tempest-VolumesSnapshotsTestJSON-1221600107-project] Calling method '.version_select at 0x7fccf656caf0>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:17:46.414817 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.wsgi [None req-37f3dc6b-314c-4620-9220-a9a17b0e3168 tempest-VolumesSnapshotsTestJSON-1221600107 tempest-VolumesSnapshotsTestJSON-1221600107-project] HTTP exception thrown: Volume 4cbc2978-0dcf-4614-aa2c-b59e05783251 could not be found. Nov 01 01:17:46.415468 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-37f3dc6b-314c-4620-9220-a9a17b0e3168 tempest-VolumesSnapshotsTestJSON-1221600107 tempest-VolumesSnapshotsTestJSON-1221600107-project] Returning 404 to user: Volume 4cbc2978-0dcf-4614-aa2c-b59e05783251 could not be found. {{(pid=116267) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 01 01:17:46.416348 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-37f3dc6b-314c-4620-9220-a9a17b0e3168 tempest-VolumesSnapshotsTestJSON-1221600107 tempest-VolumesSnapshotsTestJSON-1221600107-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/4cbc2978-0dcf-4614-aa2c-b59e05783251" status: 404 len: 109 microversion: 2.1 time: 0.063083 Nov 01 01:17:46.417152 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 58/114] 10.222.0.47 () {58 vars in 1244 bytes} [Mon Nov 1 01:17:46 2021] GET /compute/v2.1/os-volumes/4cbc2978-0dcf-4614-aa2c-b59e05783251 => generated 109 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 01 01:17:46.438679 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-0e889ca2-b9be-49eb-8be1-ab72a696acfa tempest-VolumesSnapshotsTestJSON-1221600107 tempest-VolumesSnapshotsTestJSON-1221600107-project] Calling method '.version_select at 0x7fccf7666550>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:17:46.498011 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.wsgi [None req-0e889ca2-b9be-49eb-8be1-ab72a696acfa tempest-VolumesSnapshotsTestJSON-1221600107 tempest-VolumesSnapshotsTestJSON-1221600107-project] HTTP exception thrown: Volume 4cbc2978-0dcf-4614-aa2c-b59e05783251 could not be found. Nov 01 01:17:46.498907 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-0e889ca2-b9be-49eb-8be1-ab72a696acfa tempest-VolumesSnapshotsTestJSON-1221600107 tempest-VolumesSnapshotsTestJSON-1221600107-project] Returning 404 to user: Volume 4cbc2978-0dcf-4614-aa2c-b59e05783251 could not be found. {{(pid=116266) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 01 01:17:46.499879 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-0e889ca2-b9be-49eb-8be1-ab72a696acfa tempest-VolumesSnapshotsTestJSON-1221600107 tempest-VolumesSnapshotsTestJSON-1221600107-project] 10.222.0.47 "DELETE /compute/v2.1/os-volumes/4cbc2978-0dcf-4614-aa2c-b59e05783251" status: 404 len: 109 microversion: 2.1 time: 0.068013 Nov 01 01:17:46.500783 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 57/115] 10.222.0.47 () {58 vars in 1247 bytes} [Mon Nov 1 01:17:46 2021] DELETE /compute/v2.1/os-volumes/4cbc2978-0dcf-4614-aa2c-b59e05783251 => generated 109 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 01:17:46.509564 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-6e457147-4435-4ed1-bb36-9c2f777fb092 tempest-VolumesSnapshotsTestJSON-1221600107 tempest-VolumesSnapshotsTestJSON-1221600107-project] Calling method '.version_select at 0x7fccf65d2b80>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:17:46.531797 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-182ed610-f772-4ee4-a8cb-e2c45b078a2a tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:17:46.532450 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-182ed610-f772-4ee4-a8cb-e2c45b078a2a tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] [instance: 09733ccb-dd41-48bf-bf48-eafba2dfc208] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:17:46.542532 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-182ed610-f772-4ee4-a8cb-e2c45b078a2a tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:17:46.542532 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-182ed610-f772-4ee4-a8cb-e2c45b078a2a tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:17:46.542532 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-182ed610-f772-4ee4-a8cb-e2c45b078a2a tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:17:46.542532 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-182ed610-f772-4ee4-a8cb-e2c45b078a2a tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:17:46.555953 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.wsgi [None req-6e457147-4435-4ed1-bb36-9c2f777fb092 tempest-VolumesSnapshotsTestJSON-1221600107 tempest-VolumesSnapshotsTestJSON-1221600107-project] HTTP exception thrown: Volume 4cbc2978-0dcf-4614-aa2c-b59e05783251 could not be found. Nov 01 01:17:46.556549 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-6e457147-4435-4ed1-bb36-9c2f777fb092 tempest-VolumesSnapshotsTestJSON-1221600107 tempest-VolumesSnapshotsTestJSON-1221600107-project] Returning 404 to user: Volume 4cbc2978-0dcf-4614-aa2c-b59e05783251 could not be found. {{(pid=116267) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 01 01:17:46.557472 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-6e457147-4435-4ed1-bb36-9c2f777fb092 tempest-VolumesSnapshotsTestJSON-1221600107 tempest-VolumesSnapshotsTestJSON-1221600107-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/4cbc2978-0dcf-4614-aa2c-b59e05783251" status: 404 len: 109 microversion: 2.1 time: 0.052015 Nov 01 01:17:46.557965 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 59/116] 10.222.0.47 () {58 vars in 1244 bytes} [Mon Nov 1 01:17:46 2021] GET /compute/v2.1/os-volumes/4cbc2978-0dcf-4614-aa2c-b59e05783251 => generated 109 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 01:17:46.784775 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-182ed610-f772-4ee4-a8cb-e2c45b078a2a tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03064ba5be1410aba9c9c2331b70bd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a798dc4102c4296b56bf54cd38cde6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:17:46.792641 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-182ed610-f772-4ee4-a8cb-e2c45b078a2a tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] 10.222.0.47 "GET /compute/v2.1/servers/09733ccb-dd41-48bf-bf48-eafba2dfc208" status: 200 len: 1315 microversion: 2.1 time: 0.264837 Nov 01 01:17:46.803654 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 58/117] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:17:46 2021] GET /compute/v2.1/servers/09733ccb-dd41-48bf-bf48-eafba2dfc208 => generated 1315 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:17:46.991390 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [req-687929bc-42dd-4217-959b-319299916e99 req-074faef0-effb-4dcf-ae74-ca675a793497 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8", "tag": "19f68242-dd43-4db0-a30f-928bbd241951"}]} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:17:47.000105 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 01 01:17:47.000105 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: warnings.warn(msg) Nov 01 01:17:47.005284 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [req-687929bc-42dd-4217-959b-319299916e99 req-074faef0-effb-4dcf-ae74-ca675a793497 service nova] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:17:47.006096 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [req-687929bc-42dd-4217-959b-319299916e99 req-074faef0-effb-4dcf-ae74-ca675a793497 service nova] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:17:47.016962 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.compute.server_external_events [req-687929bc-42dd-4217-959b-319299916e99 req-074faef0-effb-4dcf-ae74-ca675a793497 service nova] Creating event network-changed:19f68242-dd43-4db0-a30f-928bbd241951 for instance a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 on hv-cinder-81561 Nov 01 01:17:47.022821 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [req-687929bc-42dd-4217-959b-319299916e99 req-074faef0-effb-4dcf-ae74-ca675a793497 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100910 Nov 01 01:17:47.023396 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 60/118] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Nov 1 01:17:46 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:17:47.375229 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-34ba1b49-673a-4468-a7fb-bb1c94b6c1c1 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:17:47.375971 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-34ba1b49-673a-4468-a7fb-bb1c94b6c1c1 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:17:47.385253 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-34ba1b49-673a-4468-a7fb-bb1c94b6c1c1 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:17:47.385806 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-34ba1b49-673a-4468-a7fb-bb1c94b6c1c1 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:17:47.387629 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-34ba1b49-673a-4468-a7fb-bb1c94b6c1c1 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:17:47.389062 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-34ba1b49-673a-4468-a7fb-bb1c94b6c1c1 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:17:47.575687 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-34ba1b49-673a-4468-a7fb-bb1c94b6c1c1 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:17:47.587826 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-34ba1b49-673a-4468-a7fb-bb1c94b6c1c1 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1362 microversion: 2.1 time: 0.219603 Nov 01 01:17:47.589908 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 59/119] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:17:47 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1362 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:17:47.811062 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-2ff54091-6e12-455f-ab04-a89055ce8e93 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:17:47.811825 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-2ff54091-6e12-455f-ab04-a89055ce8e93 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] [instance: 09733ccb-dd41-48bf-bf48-eafba2dfc208] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:17:47.818462 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-2ff54091-6e12-455f-ab04-a89055ce8e93 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:17:47.819092 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-2ff54091-6e12-455f-ab04-a89055ce8e93 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:17:47.819859 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-2ff54091-6e12-455f-ab04-a89055ce8e93 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:17:47.820290 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-2ff54091-6e12-455f-ab04-a89055ce8e93 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:17:47.989304 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-2ff54091-6e12-455f-ab04-a89055ce8e93 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03064ba5be1410aba9c9c2331b70bd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a798dc4102c4296b56bf54cd38cde6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:17:47.997204 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-2ff54091-6e12-455f-ab04-a89055ce8e93 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] 10.222.0.47 "GET /compute/v2.1/servers/09733ccb-dd41-48bf-bf48-eafba2dfc208" status: 200 len: 1315 microversion: 2.1 time: 0.190308 Nov 01 01:17:47.997777 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 61/120] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:17:47 2021] GET /compute/v2.1/servers/09733ccb-dd41-48bf-bf48-eafba2dfc208 => generated 1315 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:17:48.614443 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-0857e867-32f8-475e-88c5-9d59d978bad0 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:17:48.615091 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-0857e867-32f8-475e-88c5-9d59d978bad0 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:17:48.624884 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0857e867-32f8-475e-88c5-9d59d978bad0 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:17:48.638601 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0857e867-32f8-475e-88c5-9d59d978bad0 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:17:48.643607 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0857e867-32f8-475e-88c5-9d59d978bad0 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:17:48.643607 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0857e867-32f8-475e-88c5-9d59d978bad0 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:17:48.775763 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-0857e867-32f8-475e-88c5-9d59d978bad0 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:17:48.784861 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-0857e867-32f8-475e-88c5-9d59d978bad0 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1362 microversion: 2.1 time: 0.177613 Nov 01 01:17:48.785831 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 60/121] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:17:48 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1362 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:17:49.019286 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-f0ee6648-cdf3-41d0-b2f9-1df4ef0f7606 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:17:49.028984 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-f0ee6648-cdf3-41d0-b2f9-1df4ef0f7606 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] [instance: 09733ccb-dd41-48bf-bf48-eafba2dfc208] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:17:49.028984 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f0ee6648-cdf3-41d0-b2f9-1df4ef0f7606 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:17:49.028984 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f0ee6648-cdf3-41d0-b2f9-1df4ef0f7606 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:17:49.028984 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f0ee6648-cdf3-41d0-b2f9-1df4ef0f7606 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:17:49.029731 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f0ee6648-cdf3-41d0-b2f9-1df4ef0f7606 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:17:49.150600 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-f0ee6648-cdf3-41d0-b2f9-1df4ef0f7606 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03064ba5be1410aba9c9c2331b70bd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a798dc4102c4296b56bf54cd38cde6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:17:49.158502 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-f0ee6648-cdf3-41d0-b2f9-1df4ef0f7606 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] 10.222.0.47 "GET /compute/v2.1/servers/09733ccb-dd41-48bf-bf48-eafba2dfc208" status: 200 len: 1315 microversion: 2.1 time: 0.143879 Nov 01 01:17:49.159075 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 62/122] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:17:49 2021] GET /compute/v2.1/servers/09733ccb-dd41-48bf-bf48-eafba2dfc208 => generated 1315 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:17:49.801259 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-cd34d834-700c-4e94-91b8-9c3a37af4aba tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:17:49.801911 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-cd34d834-700c-4e94-91b8-9c3a37af4aba tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:17:49.808270 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-cd34d834-700c-4e94-91b8-9c3a37af4aba tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:17:49.808719 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-cd34d834-700c-4e94-91b8-9c3a37af4aba tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:17:49.809488 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-cd34d834-700c-4e94-91b8-9c3a37af4aba tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:17:49.809919 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-cd34d834-700c-4e94-91b8-9c3a37af4aba tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:17:49.941508 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-cd34d834-700c-4e94-91b8-9c3a37af4aba tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:17:49.951422 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-cd34d834-700c-4e94-91b8-9c3a37af4aba tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1362 microversion: 2.1 time: 0.152196 Nov 01 01:17:49.951422 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 61/123] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:17:49 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:17:50.180188 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-f5431344-01d0-4d95-be29-d7f9666c0cd7 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:17:50.181105 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-f5431344-01d0-4d95-be29-d7f9666c0cd7 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] [instance: 09733ccb-dd41-48bf-bf48-eafba2dfc208] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:17:50.186908 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f5431344-01d0-4d95-be29-d7f9666c0cd7 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:17:50.187346 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f5431344-01d0-4d95-be29-d7f9666c0cd7 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:17:50.188100 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f5431344-01d0-4d95-be29-d7f9666c0cd7 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:17:50.188525 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f5431344-01d0-4d95-be29-d7f9666c0cd7 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:17:50.326613 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-f5431344-01d0-4d95-be29-d7f9666c0cd7 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03064ba5be1410aba9c9c2331b70bd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a798dc4102c4296b56bf54cd38cde6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:17:50.334629 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-f5431344-01d0-4d95-be29-d7f9666c0cd7 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] 10.222.0.47 "GET /compute/v2.1/servers/09733ccb-dd41-48bf-bf48-eafba2dfc208" status: 200 len: 1315 microversion: 2.1 time: 0.162908 Nov 01 01:17:50.335906 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 63/124] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:17:50 2021] GET /compute/v2.1/servers/09733ccb-dd41-48bf-bf48-eafba2dfc208 => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:17:50.966316 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-b3f579a7-f857-4cd2-981a-80311a03cefb tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:17:50.967233 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-b3f579a7-f857-4cd2-981a-80311a03cefb tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:17:50.974082 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b3f579a7-f857-4cd2-981a-80311a03cefb tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:17:50.974851 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b3f579a7-f857-4cd2-981a-80311a03cefb tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:17:50.975625 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b3f579a7-f857-4cd2-981a-80311a03cefb tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:17:50.976054 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b3f579a7-f857-4cd2-981a-80311a03cefb tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:17:51.106952 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-b3f579a7-f857-4cd2-981a-80311a03cefb tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:17:51.125171 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-b3f579a7-f857-4cd2-981a-80311a03cefb tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1362 microversion: 2.1 time: 0.154910 Nov 01 01:17:51.136042 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 62/125] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:17:50 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1362 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:17:51.355879 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-2c00a95d-3a23-4d57-b005-14eb01d1d85a tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:17:51.356644 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-2c00a95d-3a23-4d57-b005-14eb01d1d85a tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] [instance: 09733ccb-dd41-48bf-bf48-eafba2dfc208] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:17:51.363712 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-2c00a95d-3a23-4d57-b005-14eb01d1d85a tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:17:51.364151 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-2c00a95d-3a23-4d57-b005-14eb01d1d85a tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:17:51.364916 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-2c00a95d-3a23-4d57-b005-14eb01d1d85a tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:17:51.365337 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-2c00a95d-3a23-4d57-b005-14eb01d1d85a tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:17:51.487907 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-2c00a95d-3a23-4d57-b005-14eb01d1d85a tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03064ba5be1410aba9c9c2331b70bd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a798dc4102c4296b56bf54cd38cde6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:17:51.495353 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-2c00a95d-3a23-4d57-b005-14eb01d1d85a tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] 10.222.0.47 "GET /compute/v2.1/servers/09733ccb-dd41-48bf-bf48-eafba2dfc208" status: 200 len: 1315 microversion: 2.1 time: 0.147088 Nov 01 01:17:51.496472 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 64/126] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:17:51 2021] GET /compute/v2.1/servers/09733ccb-dd41-48bf-bf48-eafba2dfc208 => generated 1315 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:17:52.143120 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-06b8a616-f174-4f13-adb2-6d5f9e35b1d0 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:17:52.143805 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-06b8a616-f174-4f13-adb2-6d5f9e35b1d0 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:17:52.150120 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-06b8a616-f174-4f13-adb2-6d5f9e35b1d0 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:17:52.150671 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-06b8a616-f174-4f13-adb2-6d5f9e35b1d0 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:17:52.151508 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-06b8a616-f174-4f13-adb2-6d5f9e35b1d0 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:17:52.151930 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-06b8a616-f174-4f13-adb2-6d5f9e35b1d0 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:17:52.300807 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-06b8a616-f174-4f13-adb2-6d5f9e35b1d0 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:17:52.315967 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-06b8a616-f174-4f13-adb2-6d5f9e35b1d0 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1362 microversion: 2.1 time: 0.177172 Nov 01 01:17:52.316568 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 63/127] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:17:52 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1362 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:17:52.513641 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-c3ab5d65-1e68-4f5e-9c0d-fbeacb8c2dc0 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:17:52.515018 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-c3ab5d65-1e68-4f5e-9c0d-fbeacb8c2dc0 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] [instance: 09733ccb-dd41-48bf-bf48-eafba2dfc208] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:17:52.522591 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c3ab5d65-1e68-4f5e-9c0d-fbeacb8c2dc0 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:17:52.526123 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c3ab5d65-1e68-4f5e-9c0d-fbeacb8c2dc0 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:17:52.526123 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c3ab5d65-1e68-4f5e-9c0d-fbeacb8c2dc0 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:17:52.526123 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c3ab5d65-1e68-4f5e-9c0d-fbeacb8c2dc0 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:17:52.672138 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-c3ab5d65-1e68-4f5e-9c0d-fbeacb8c2dc0 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03064ba5be1410aba9c9c2331b70bd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a798dc4102c4296b56bf54cd38cde6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:17:52.680617 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-c3ab5d65-1e68-4f5e-9c0d-fbeacb8c2dc0 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] 10.222.0.47 "GET /compute/v2.1/servers/09733ccb-dd41-48bf-bf48-eafba2dfc208" status: 200 len: 1315 microversion: 2.1 time: 0.171263 Nov 01 01:17:52.690327 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 65/128] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:17:52 2021] GET /compute/v2.1/servers/09733ccb-dd41-48bf-bf48-eafba2dfc208 => generated 1315 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:17:53.335710 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-808ca3c1-edac-4570-8dd1-7c26e283e6e4 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:17:53.336504 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-808ca3c1-edac-4570-8dd1-7c26e283e6e4 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:17:53.343196 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-808ca3c1-edac-4570-8dd1-7c26e283e6e4 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:17:53.343992 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-808ca3c1-edac-4570-8dd1-7c26e283e6e4 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:17:53.345350 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-808ca3c1-edac-4570-8dd1-7c26e283e6e4 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:17:53.345931 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-808ca3c1-edac-4570-8dd1-7c26e283e6e4 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:17:53.511374 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-808ca3c1-edac-4570-8dd1-7c26e283e6e4 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:17:53.520646 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-808ca3c1-edac-4570-8dd1-7c26e283e6e4 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1362 microversion: 2.1 time: 0.190974 Nov 01 01:17:53.521212 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 64/129] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:17:53 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1362 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:17:53.696958 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-cbef23f0-5e5e-4bc9-93f3-be4337e16204 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:17:53.697649 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-cbef23f0-5e5e-4bc9-93f3-be4337e16204 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] [instance: 09733ccb-dd41-48bf-bf48-eafba2dfc208] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:17:53.703492 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-cbef23f0-5e5e-4bc9-93f3-be4337e16204 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:17:53.704002 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-cbef23f0-5e5e-4bc9-93f3-be4337e16204 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:17:53.705405 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-cbef23f0-5e5e-4bc9-93f3-be4337e16204 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:17:53.705837 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-cbef23f0-5e5e-4bc9-93f3-be4337e16204 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:17:53.851954 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-cbef23f0-5e5e-4bc9-93f3-be4337e16204 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03064ba5be1410aba9c9c2331b70bd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a798dc4102c4296b56bf54cd38cde6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:17:53.859431 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-cbef23f0-5e5e-4bc9-93f3-be4337e16204 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] 10.222.0.47 "GET /compute/v2.1/servers/09733ccb-dd41-48bf-bf48-eafba2dfc208" status: 200 len: 1315 microversion: 2.1 time: 0.166323 Nov 01 01:17:53.860212 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 66/130] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:17:53 2021] GET /compute/v2.1/servers/09733ccb-dd41-48bf-bf48-eafba2dfc208 => generated 1315 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:17:54.537451 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-fede9bbd-fb7b-4b8b-82b6-44b34c5c9ed7 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:17:54.538653 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-fede9bbd-fb7b-4b8b-82b6-44b34c5c9ed7 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:17:54.544568 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-fede9bbd-fb7b-4b8b-82b6-44b34c5c9ed7 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:17:54.545248 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-fede9bbd-fb7b-4b8b-82b6-44b34c5c9ed7 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:17:54.546203 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-fede9bbd-fb7b-4b8b-82b6-44b34c5c9ed7 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:17:54.547065 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-fede9bbd-fb7b-4b8b-82b6-44b34c5c9ed7 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:17:54.782085 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-fede9bbd-fb7b-4b8b-82b6-44b34c5c9ed7 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:17:54.788530 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-fede9bbd-fb7b-4b8b-82b6-44b34c5c9ed7 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1362 microversion: 2.1 time: 0.254825 Nov 01 01:17:54.792331 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 65/131] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:17:54 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1362 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:17:54.876310 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-470498eb-3f0c-4203-b302-b8f6bb611a76 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:17:54.876979 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-470498eb-3f0c-4203-b302-b8f6bb611a76 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] [instance: 09733ccb-dd41-48bf-bf48-eafba2dfc208] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:17:54.889898 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-470498eb-3f0c-4203-b302-b8f6bb611a76 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:17:54.890333 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-470498eb-3f0c-4203-b302-b8f6bb611a76 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:17:54.891132 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-470498eb-3f0c-4203-b302-b8f6bb611a76 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:17:54.891559 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-470498eb-3f0c-4203-b302-b8f6bb611a76 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:17:55.127010 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-470498eb-3f0c-4203-b302-b8f6bb611a76 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03064ba5be1410aba9c9c2331b70bd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a798dc4102c4296b56bf54cd38cde6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:17:55.132481 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-470498eb-3f0c-4203-b302-b8f6bb611a76 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] 10.222.0.47 "GET /compute/v2.1/servers/09733ccb-dd41-48bf-bf48-eafba2dfc208" status: 200 len: 1315 microversion: 2.1 time: 0.259830 Nov 01 01:17:55.142592 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 67/132] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:17:54 2021] GET /compute/v2.1/servers/09733ccb-dd41-48bf-bf48-eafba2dfc208 => generated 1315 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:17:55.806780 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-371f43ca-a006-48bc-9c33-4ac3eefe0a7f tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:17:55.807469 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-371f43ca-a006-48bc-9c33-4ac3eefe0a7f tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:17:55.813734 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-371f43ca-a006-48bc-9c33-4ac3eefe0a7f tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:17:55.814811 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-371f43ca-a006-48bc-9c33-4ac3eefe0a7f tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:17:55.816898 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-371f43ca-a006-48bc-9c33-4ac3eefe0a7f tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:17:55.816898 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-371f43ca-a006-48bc-9c33-4ac3eefe0a7f tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:17:55.949317 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-371f43ca-a006-48bc-9c33-4ac3eefe0a7f tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:17:55.957578 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-371f43ca-a006-48bc-9c33-4ac3eefe0a7f tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1362 microversion: 2.1 time: 0.154404 Nov 01 01:17:55.958650 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 66/133] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:17:55 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:17:56.150678 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-dbcc2d15-0a3c-4f00-a133-0c349b93f465 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:17:56.151867 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-dbcc2d15-0a3c-4f00-a133-0c349b93f465 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] [instance: 09733ccb-dd41-48bf-bf48-eafba2dfc208] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:17:56.160494 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-dbcc2d15-0a3c-4f00-a133-0c349b93f465 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:17:56.161120 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-dbcc2d15-0a3c-4f00-a133-0c349b93f465 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:17:56.163106 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-dbcc2d15-0a3c-4f00-a133-0c349b93f465 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:17:56.163106 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-dbcc2d15-0a3c-4f00-a133-0c349b93f465 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:17:56.373204 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-dbcc2d15-0a3c-4f00-a133-0c349b93f465 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03064ba5be1410aba9c9c2331b70bd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a798dc4102c4296b56bf54cd38cde6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:17:56.386190 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-dbcc2d15-0a3c-4f00-a133-0c349b93f465 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] 10.222.0.47 "GET /compute/v2.1/servers/09733ccb-dd41-48bf-bf48-eafba2dfc208" status: 200 len: 1315 microversion: 2.1 time: 0.234704 Nov 01 01:17:56.386190 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 68/134] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:17:56 2021] GET /compute/v2.1/servers/09733ccb-dd41-48bf-bf48-eafba2dfc208 => generated 1315 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:17:56.974232 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-0611f101-1ce1-4bda-8520-00aad802eb36 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:17:56.974861 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-0611f101-1ce1-4bda-8520-00aad802eb36 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:17:56.984346 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0611f101-1ce1-4bda-8520-00aad802eb36 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:17:56.984795 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0611f101-1ce1-4bda-8520-00aad802eb36 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:17:56.985809 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0611f101-1ce1-4bda-8520-00aad802eb36 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:17:56.986442 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0611f101-1ce1-4bda-8520-00aad802eb36 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:17:57.167620 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-0611f101-1ce1-4bda-8520-00aad802eb36 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:17:57.175301 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-0611f101-1ce1-4bda-8520-00aad802eb36 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1362 microversion: 2.1 time: 0.204646 Nov 01 01:17:57.176072 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 67/135] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:17:56 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1362 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:17:57.398248 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-77be8396-dafc-4377-b7c1-7c95586ab6ab tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:17:57.398894 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-77be8396-dafc-4377-b7c1-7c95586ab6ab tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] [instance: 09733ccb-dd41-48bf-bf48-eafba2dfc208] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:17:57.416588 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-77be8396-dafc-4377-b7c1-7c95586ab6ab tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:17:57.417047 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-77be8396-dafc-4377-b7c1-7c95586ab6ab tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:17:57.417839 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-77be8396-dafc-4377-b7c1-7c95586ab6ab tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:17:57.418276 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-77be8396-dafc-4377-b7c1-7c95586ab6ab tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:17:57.575114 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-77be8396-dafc-4377-b7c1-7c95586ab6ab tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03064ba5be1410aba9c9c2331b70bd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a798dc4102c4296b56bf54cd38cde6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:17:57.583325 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-77be8396-dafc-4377-b7c1-7c95586ab6ab tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] 10.222.0.47 "GET /compute/v2.1/servers/09733ccb-dd41-48bf-bf48-eafba2dfc208" status: 200 len: 1315 microversion: 2.1 time: 0.188594 Nov 01 01:17:57.583859 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 69/136] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:17:57 2021] GET /compute/v2.1/servers/09733ccb-dd41-48bf-bf48-eafba2dfc208 => generated 1315 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:17:58.192943 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-8bf63881-f745-4a88-aaf0-13fd96040118 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:17:58.195094 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-8bf63881-f745-4a88-aaf0-13fd96040118 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:17:58.203768 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8bf63881-f745-4a88-aaf0-13fd96040118 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:17:58.204500 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8bf63881-f745-4a88-aaf0-13fd96040118 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:17:58.205287 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8bf63881-f745-4a88-aaf0-13fd96040118 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:17:58.207920 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8bf63881-f745-4a88-aaf0-13fd96040118 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:17:58.343657 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-8bf63881-f745-4a88-aaf0-13fd96040118 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:17:58.353927 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-8bf63881-f745-4a88-aaf0-13fd96040118 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1362 microversion: 2.1 time: 0.165287 Nov 01 01:17:58.355108 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 68/137] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:17:58 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1362 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:17:58.601073 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-9c2570f8-ca4d-459b-bef9-53dc632acf31 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:17:58.601900 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-9c2570f8-ca4d-459b-bef9-53dc632acf31 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] [instance: 09733ccb-dd41-48bf-bf48-eafba2dfc208] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:17:58.608681 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9c2570f8-ca4d-459b-bef9-53dc632acf31 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:17:58.609336 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9c2570f8-ca4d-459b-bef9-53dc632acf31 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:17:58.610294 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9c2570f8-ca4d-459b-bef9-53dc632acf31 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:17:58.611498 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9c2570f8-ca4d-459b-bef9-53dc632acf31 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:17:58.756728 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-9c2570f8-ca4d-459b-bef9-53dc632acf31 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03064ba5be1410aba9c9c2331b70bd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a798dc4102c4296b56bf54cd38cde6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:17:58.764098 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-9c2570f8-ca4d-459b-bef9-53dc632acf31 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] 10.222.0.47 "GET /compute/v2.1/servers/09733ccb-dd41-48bf-bf48-eafba2dfc208" status: 200 len: 1315 microversion: 2.1 time: 0.166677 Nov 01 01:17:58.764753 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 70/138] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:17:58 2021] GET /compute/v2.1/servers/09733ccb-dd41-48bf-bf48-eafba2dfc208 => generated 1315 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:17:59.371959 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-f7ef54f8-b488-46e0-a88f-e54ad8478d51 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:17:59.376352 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-f7ef54f8-b488-46e0-a88f-e54ad8478d51 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:17:59.379010 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f7ef54f8-b488-46e0-a88f-e54ad8478d51 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:17:59.379516 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f7ef54f8-b488-46e0-a88f-e54ad8478d51 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:17:59.380502 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f7ef54f8-b488-46e0-a88f-e54ad8478d51 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:17:59.381159 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f7ef54f8-b488-46e0-a88f-e54ad8478d51 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:17:59.512870 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-f7ef54f8-b488-46e0-a88f-e54ad8478d51 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:17:59.521043 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-f7ef54f8-b488-46e0-a88f-e54ad8478d51 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1362 microversion: 2.1 time: 0.153052 Nov 01 01:17:59.521653 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 69/139] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:17:59 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:17:59.780806 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-8085cd9a-3480-4846-9d55-c36a78ba027d tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:17:59.781498 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-8085cd9a-3480-4846-9d55-c36a78ba027d tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] [instance: 09733ccb-dd41-48bf-bf48-eafba2dfc208] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:17:59.787907 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8085cd9a-3480-4846-9d55-c36a78ba027d tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:17:59.792183 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8085cd9a-3480-4846-9d55-c36a78ba027d tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:17:59.792183 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8085cd9a-3480-4846-9d55-c36a78ba027d tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:17:59.792183 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8085cd9a-3480-4846-9d55-c36a78ba027d tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:17:59.921219 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-8085cd9a-3480-4846-9d55-c36a78ba027d tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03064ba5be1410aba9c9c2331b70bd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a798dc4102c4296b56bf54cd38cde6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:17:59.932737 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-8085cd9a-3480-4846-9d55-c36a78ba027d tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] 10.222.0.47 "GET /compute/v2.1/servers/09733ccb-dd41-48bf-bf48-eafba2dfc208" status: 200 len: 1315 microversion: 2.1 time: 0.155422 Nov 01 01:17:59.934122 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 71/140] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:17:59 2021] GET /compute/v2.1/servers/09733ccb-dd41-48bf-bf48-eafba2dfc208 => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:18:00.537475 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-a13ae899-8bf9-4a0f-b467-053fd0fb442d tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:18:00.538078 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-a13ae899-8bf9-4a0f-b467-053fd0fb442d tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:18:00.543929 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a13ae899-8bf9-4a0f-b467-053fd0fb442d tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:18:00.544398 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a13ae899-8bf9-4a0f-b467-053fd0fb442d tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:18:00.545156 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a13ae899-8bf9-4a0f-b467-053fd0fb442d tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:18:00.545580 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a13ae899-8bf9-4a0f-b467-053fd0fb442d tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:18:00.670983 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-a13ae899-8bf9-4a0f-b467-053fd0fb442d tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:18:00.678204 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-a13ae899-8bf9-4a0f-b467-053fd0fb442d tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1362 microversion: 2.1 time: 0.144461 Nov 01 01:18:00.678808 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 70/141] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:18:00 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1362 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:18:00.950668 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-a551d65b-078c-484c-a5f6-3e1cff386ed8 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:18:00.951274 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-a551d65b-078c-484c-a5f6-3e1cff386ed8 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] [instance: 09733ccb-dd41-48bf-bf48-eafba2dfc208] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:18:00.957106 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a551d65b-078c-484c-a5f6-3e1cff386ed8 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:18:00.957541 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a551d65b-078c-484c-a5f6-3e1cff386ed8 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:18:00.958295 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a551d65b-078c-484c-a5f6-3e1cff386ed8 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:18:00.958743 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a551d65b-078c-484c-a5f6-3e1cff386ed8 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:18:01.077742 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-a551d65b-078c-484c-a5f6-3e1cff386ed8 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03064ba5be1410aba9c9c2331b70bd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a798dc4102c4296b56bf54cd38cde6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:18:01.085168 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-a551d65b-078c-484c-a5f6-3e1cff386ed8 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] 10.222.0.47 "GET /compute/v2.1/servers/09733ccb-dd41-48bf-bf48-eafba2dfc208" status: 200 len: 1315 microversion: 2.1 time: 0.138172 Nov 01 01:18:01.085727 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 72/142] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:18:00 2021] GET /compute/v2.1/servers/09733ccb-dd41-48bf-bf48-eafba2dfc208 => generated 1315 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:18:01.696200 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-2af68dee-425c-4fdc-b4b5-49136da90647 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:18:01.696809 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-2af68dee-425c-4fdc-b4b5-49136da90647 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:18:01.702655 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2af68dee-425c-4fdc-b4b5-49136da90647 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:18:01.703101 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2af68dee-425c-4fdc-b4b5-49136da90647 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:18:01.703893 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2af68dee-425c-4fdc-b4b5-49136da90647 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:18:01.704318 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2af68dee-425c-4fdc-b4b5-49136da90647 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:18:01.825132 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-2af68dee-425c-4fdc-b4b5-49136da90647 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:18:01.832581 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-2af68dee-425c-4fdc-b4b5-49136da90647 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1362 microversion: 2.1 time: 0.140179 Nov 01 01:18:01.833144 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 71/143] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:18:01 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1362 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:18:02.101815 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-b6b79a45-5fb2-4cd6-a855-f3479717aacf tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:18:02.102464 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-b6b79a45-5fb2-4cd6-a855-f3479717aacf tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] [instance: 09733ccb-dd41-48bf-bf48-eafba2dfc208] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:18:02.109078 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b6b79a45-5fb2-4cd6-a855-f3479717aacf tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:18:02.109562 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b6b79a45-5fb2-4cd6-a855-f3479717aacf tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:18:02.110351 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b6b79a45-5fb2-4cd6-a855-f3479717aacf tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:18:02.110805 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b6b79a45-5fb2-4cd6-a855-f3479717aacf tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:18:02.248698 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-b6b79a45-5fb2-4cd6-a855-f3479717aacf tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03064ba5be1410aba9c9c2331b70bd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a798dc4102c4296b56bf54cd38cde6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:18:02.256800 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-b6b79a45-5fb2-4cd6-a855-f3479717aacf tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] 10.222.0.47 "GET /compute/v2.1/servers/09733ccb-dd41-48bf-bf48-eafba2dfc208" status: 200 len: 1315 microversion: 2.1 time: 0.158957 Nov 01 01:18:02.263197 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 73/144] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:18:02 2021] GET /compute/v2.1/servers/09733ccb-dd41-48bf-bf48-eafba2dfc208 => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:18:02.849618 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-bef09daa-fb85-4ac8-b6fb-4c9fce22101d tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:18:02.850218 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-bef09daa-fb85-4ac8-b6fb-4c9fce22101d tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:18:02.856233 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-bef09daa-fb85-4ac8-b6fb-4c9fce22101d tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:18:02.856698 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-bef09daa-fb85-4ac8-b6fb-4c9fce22101d tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:18:02.857457 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-bef09daa-fb85-4ac8-b6fb-4c9fce22101d tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:18:02.857886 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-bef09daa-fb85-4ac8-b6fb-4c9fce22101d tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:18:02.987894 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-bef09daa-fb85-4ac8-b6fb-4c9fce22101d tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:18:02.995155 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-bef09daa-fb85-4ac8-b6fb-4c9fce22101d tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1362 microversion: 2.1 time: 0.149086 Nov 01 01:18:02.995987 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 72/145] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:18:02 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1362 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:18:03.274855 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-9bb2210f-43b4-4ed2-b0a7-3916d7814c5a tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:18:03.275459 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-9bb2210f-43b4-4ed2-b0a7-3916d7814c5a tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] [instance: 09733ccb-dd41-48bf-bf48-eafba2dfc208] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:18:03.281072 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9bb2210f-43b4-4ed2-b0a7-3916d7814c5a tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:18:03.281505 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9bb2210f-43b4-4ed2-b0a7-3916d7814c5a tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:18:03.282901 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9bb2210f-43b4-4ed2-b0a7-3916d7814c5a tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:18:03.283336 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9bb2210f-43b4-4ed2-b0a7-3916d7814c5a tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:18:03.405016 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-9bb2210f-43b4-4ed2-b0a7-3916d7814c5a tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03064ba5be1410aba9c9c2331b70bd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a798dc4102c4296b56bf54cd38cde6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:18:03.414484 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-9bb2210f-43b4-4ed2-b0a7-3916d7814c5a tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] 10.222.0.47 "GET /compute/v2.1/servers/09733ccb-dd41-48bf-bf48-eafba2dfc208" status: 200 len: 1315 microversion: 2.1 time: 0.141765 Nov 01 01:18:03.414484 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 74/146] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:18:03 2021] GET /compute/v2.1/servers/09733ccb-dd41-48bf-bf48-eafba2dfc208 => generated 1315 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:18:04.012445 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-dfd25e0a-2393-4249-ba09-cc5cc8cdd9ab tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:18:04.012979 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-dfd25e0a-2393-4249-ba09-cc5cc8cdd9ab tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:18:04.018737 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-dfd25e0a-2393-4249-ba09-cc5cc8cdd9ab tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:18:04.019184 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-dfd25e0a-2393-4249-ba09-cc5cc8cdd9ab tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:18:04.019943 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-dfd25e0a-2393-4249-ba09-cc5cc8cdd9ab tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:18:04.020374 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-dfd25e0a-2393-4249-ba09-cc5cc8cdd9ab tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:18:04.143137 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-dfd25e0a-2393-4249-ba09-cc5cc8cdd9ab tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:18:04.151128 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-dfd25e0a-2393-4249-ba09-cc5cc8cdd9ab tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1362 microversion: 2.1 time: 0.142061 Nov 01 01:18:04.151902 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 73/147] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:18:04 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1362 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:18:04.429584 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-f71e8ed4-324f-4646-94e5-9737c7843c41 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:18:04.430382 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-f71e8ed4-324f-4646-94e5-9737c7843c41 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] [instance: 09733ccb-dd41-48bf-bf48-eafba2dfc208] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:18:04.436201 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f71e8ed4-324f-4646-94e5-9737c7843c41 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:18:04.436638 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f71e8ed4-324f-4646-94e5-9737c7843c41 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:18:04.437394 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f71e8ed4-324f-4646-94e5-9737c7843c41 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:18:04.437825 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f71e8ed4-324f-4646-94e5-9737c7843c41 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:18:04.558041 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-f71e8ed4-324f-4646-94e5-9737c7843c41 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03064ba5be1410aba9c9c2331b70bd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a798dc4102c4296b56bf54cd38cde6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:18:04.565341 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-f71e8ed4-324f-4646-94e5-9737c7843c41 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] 10.222.0.47 "GET /compute/v2.1/servers/09733ccb-dd41-48bf-bf48-eafba2dfc208" status: 200 len: 1315 microversion: 2.1 time: 0.139528 Nov 01 01:18:04.565900 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 75/148] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:18:04 2021] GET /compute/v2.1/servers/09733ccb-dd41-48bf-bf48-eafba2dfc208 => generated 1315 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:18:05.072170 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [req-b19caeb2-032f-4ff0-a9a5-d9d06c6c0b75 req-37c60018-f5f9-49a8-a19a-ba5f3bd6e437 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09733ccb-dd41-48bf-bf48-eafba2dfc208", "name": "network-vif-plugged", "status": "completed", "tag": "bae81874-aed7-454c-b211-7fdd6bfa80b2"}]} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:18:05.074465 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 01 01:18:05.074465 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: warnings.warn(msg) Nov 01 01:18:05.084601 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [req-b19caeb2-032f-4ff0-a9a5-d9d06c6c0b75 req-37c60018-f5f9-49a8-a19a-ba5f3bd6e437 service nova] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:18:05.087620 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [req-b19caeb2-032f-4ff0-a9a5-d9d06c6c0b75 req-37c60018-f5f9-49a8-a19a-ba5f3bd6e437 service nova] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:18:05.106169 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.compute.server_external_events [req-b19caeb2-032f-4ff0-a9a5-d9d06c6c0b75 req-37c60018-f5f9-49a8-a19a-ba5f3bd6e437 service nova] Creating event network-vif-plugged:bae81874-aed7-454c-b211-7fdd6bfa80b2 for instance 09733ccb-dd41-48bf-bf48-eafba2dfc208 on hv-cinder-81561 Nov 01 01:18:05.106868 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [req-b19caeb2-032f-4ff0-a9a5-d9d06c6c0b75 req-37c60018-f5f9-49a8-a19a-ba5f3bd6e437 service nova] Acquired lock "compute-rpcapi-router" {{(pid=116266) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} Nov 01 01:18:05.120359 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-df45cfa1-162f-4258-b55c-31cafd7bd11d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:18:05.120359 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-df45cfa1-162f-4258-b55c-31cafd7bd11d None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:18:05.120359 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-df45cfa1-162f-4258-b55c-31cafd7bd11d None None] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:18:05.120359 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-df45cfa1-162f-4258-b55c-31cafd7bd11d None None] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:18:05.120359 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.compute.rpcapi [None req-df45cfa1-162f-4258-b55c-31cafd7bd11d None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Nov 01 01:18:05.121799 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-df45cfa1-162f-4258-b55c-31cafd7bd11d None None] Releasing lock "compute-rpcapi-router" {{(pid=116266) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} Nov 01 01:18:05.148774 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-df45cfa1-162f-4258-b55c-31cafd7bd11d None None] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.143208 Nov 01 01:18:05.149680 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 74/149] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Nov 1 01:18:05 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:18:05.167643 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-319fd7d9-f8d6-45fa-b995-a76d912c68b7 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:18:05.168254 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-319fd7d9-f8d6-45fa-b995-a76d912c68b7 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:18:05.174372 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-319fd7d9-f8d6-45fa-b995-a76d912c68b7 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:18:05.174965 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-319fd7d9-f8d6-45fa-b995-a76d912c68b7 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:18:05.175800 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-319fd7d9-f8d6-45fa-b995-a76d912c68b7 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:18:05.176303 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-319fd7d9-f8d6-45fa-b995-a76d912c68b7 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:18:05.296303 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-319fd7d9-f8d6-45fa-b995-a76d912c68b7 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:18:05.303546 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-319fd7d9-f8d6-45fa-b995-a76d912c68b7 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1362 microversion: 2.1 time: 0.139530 Nov 01 01:18:05.304100 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 76/150] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:18:05 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1362 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:18:05.581963 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-1b4efa6a-5b0c-4a6d-83de-20b9177331ea tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:18:05.582635 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-1b4efa6a-5b0c-4a6d-83de-20b9177331ea tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] [instance: 09733ccb-dd41-48bf-bf48-eafba2dfc208] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:18:05.588687 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1b4efa6a-5b0c-4a6d-83de-20b9177331ea tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:18:05.589131 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1b4efa6a-5b0c-4a6d-83de-20b9177331ea tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:18:05.589881 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1b4efa6a-5b0c-4a6d-83de-20b9177331ea tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:18:05.590312 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1b4efa6a-5b0c-4a6d-83de-20b9177331ea tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:18:05.721382 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-1b4efa6a-5b0c-4a6d-83de-20b9177331ea tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03064ba5be1410aba9c9c2331b70bd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a798dc4102c4296b56bf54cd38cde6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:18:05.728859 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-1b4efa6a-5b0c-4a6d-83de-20b9177331ea tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] 10.222.0.47 "GET /compute/v2.1/servers/09733ccb-dd41-48bf-bf48-eafba2dfc208" status: 200 len: 1315 microversion: 2.1 time: 0.150987 Nov 01 01:18:05.729400 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 75/151] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:18:05 2021] GET /compute/v2.1/servers/09733ccb-dd41-48bf-bf48-eafba2dfc208 => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:18:06.320237 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-244b6d9b-71c5-4d57-896a-a32e27199167 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:18:06.320878 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-244b6d9b-71c5-4d57-896a-a32e27199167 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:18:06.326766 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-244b6d9b-71c5-4d57-896a-a32e27199167 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:18:06.327204 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-244b6d9b-71c5-4d57-896a-a32e27199167 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:18:06.327956 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-244b6d9b-71c5-4d57-896a-a32e27199167 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:18:06.328382 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-244b6d9b-71c5-4d57-896a-a32e27199167 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:18:06.453283 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-244b6d9b-71c5-4d57-896a-a32e27199167 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:18:06.460512 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-244b6d9b-71c5-4d57-896a-a32e27199167 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1362 microversion: 2.1 time: 0.143886 Nov 01 01:18:06.461090 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 77/152] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:18:06 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1362 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:18:06.746304 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-10fb45b9-aee7-4201-8575-efcc6e35cd42 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:18:06.746968 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-10fb45b9-aee7-4201-8575-efcc6e35cd42 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] [instance: 09733ccb-dd41-48bf-bf48-eafba2dfc208] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:18:06.753216 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-10fb45b9-aee7-4201-8575-efcc6e35cd42 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:18:06.753652 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-10fb45b9-aee7-4201-8575-efcc6e35cd42 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:18:06.754408 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-10fb45b9-aee7-4201-8575-efcc6e35cd42 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:18:06.754852 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-10fb45b9-aee7-4201-8575-efcc6e35cd42 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:18:06.875927 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-10fb45b9-aee7-4201-8575-efcc6e35cd42 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03064ba5be1410aba9c9c2331b70bd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a798dc4102c4296b56bf54cd38cde6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:18:06.883073 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-10fb45b9-aee7-4201-8575-efcc6e35cd42 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] 10.222.0.47 "GET /compute/v2.1/servers/09733ccb-dd41-48bf-bf48-eafba2dfc208" status: 200 len: 1315 microversion: 2.1 time: 0.140602 Nov 01 01:18:06.883636 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 76/153] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:18:06 2021] GET /compute/v2.1/servers/09733ccb-dd41-48bf-bf48-eafba2dfc208 => generated 1315 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:18:07.184458 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [req-930a567b-cc32-4350-a2ff-80563d5dee82 req-1b412beb-e9e1-4924-8079-3d40c0be09b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8", "name": "network-vif-plugged", "status": "completed", "tag": "19f68242-dd43-4db0-a30f-928bbd241951"}]} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:18:07.186850 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 01 01:18:07.186850 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: warnings.warn(msg) Nov 01 01:18:07.192922 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [req-930a567b-cc32-4350-a2ff-80563d5dee82 req-1b412beb-e9e1-4924-8079-3d40c0be09b6 service nova] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:18:07.193316 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [req-930a567b-cc32-4350-a2ff-80563d5dee82 req-1b412beb-e9e1-4924-8079-3d40c0be09b6 service nova] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:18:07.204412 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.compute.server_external_events [req-930a567b-cc32-4350-a2ff-80563d5dee82 req-1b412beb-e9e1-4924-8079-3d40c0be09b6 service nova] Creating event network-vif-plugged:19f68242-dd43-4db0-a30f-928bbd241951 for instance a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 on hv-cinder-81561 Nov 01 01:18:07.209468 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [req-930a567b-cc32-4350-a2ff-80563d5dee82 req-1b412beb-e9e1-4924-8079-3d40c0be09b6 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028653 Nov 01 01:18:07.210098 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 78/154] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Nov 1 01:18:07 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:18:07.477011 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-56d82a7e-1143-45e7-abf9-6939b1cf8978 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:18:07.477615 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-56d82a7e-1143-45e7-abf9-6939b1cf8978 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:18:07.483431 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-56d82a7e-1143-45e7-abf9-6939b1cf8978 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:18:07.483879 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-56d82a7e-1143-45e7-abf9-6939b1cf8978 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:18:07.484639 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-56d82a7e-1143-45e7-abf9-6939b1cf8978 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:18:07.485067 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-56d82a7e-1143-45e7-abf9-6939b1cf8978 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:18:07.668893 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-56d82a7e-1143-45e7-abf9-6939b1cf8978 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:18:07.678399 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-56d82a7e-1143-45e7-abf9-6939b1cf8978 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1362 microversion: 2.1 time: 0.205100 Nov 01 01:18:07.679076 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 77/155] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:18:07 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1362 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:18:07.901046 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-6296b454-fb57-4be7-aa3b-5eee4ea5020c tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:18:07.903642 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-6296b454-fb57-4be7-aa3b-5eee4ea5020c tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] [instance: 09733ccb-dd41-48bf-bf48-eafba2dfc208] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:18:07.910468 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-6296b454-fb57-4be7-aa3b-5eee4ea5020c tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:18:07.911290 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-6296b454-fb57-4be7-aa3b-5eee4ea5020c tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:18:07.913471 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-6296b454-fb57-4be7-aa3b-5eee4ea5020c tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:18:07.914098 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-6296b454-fb57-4be7-aa3b-5eee4ea5020c tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:18:08.051040 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-6296b454-fb57-4be7-aa3b-5eee4ea5020c tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03064ba5be1410aba9c9c2331b70bd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a798dc4102c4296b56bf54cd38cde6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:18:08.058398 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-6296b454-fb57-4be7-aa3b-5eee4ea5020c tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] 10.222.0.47 "GET /compute/v2.1/servers/09733ccb-dd41-48bf-bf48-eafba2dfc208" status: 200 len: 1315 microversion: 2.1 time: 0.161374 Nov 01 01:18:08.065302 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 79/156] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:18:07 2021] GET /compute/v2.1/servers/09733ccb-dd41-48bf-bf48-eafba2dfc208 => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:18:08.695278 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-1e461e50-104f-49f3-bccc-263ef49cae89 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:18:08.695875 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-1e461e50-104f-49f3-bccc-263ef49cae89 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:18:08.701621 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1e461e50-104f-49f3-bccc-263ef49cae89 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:18:08.702064 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1e461e50-104f-49f3-bccc-263ef49cae89 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:18:08.702844 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1e461e50-104f-49f3-bccc-263ef49cae89 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:18:08.703275 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1e461e50-104f-49f3-bccc-263ef49cae89 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:18:08.823264 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-1e461e50-104f-49f3-bccc-263ef49cae89 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:18:08.830519 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-1e461e50-104f-49f3-bccc-263ef49cae89 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1362 microversion: 2.1 time: 0.138839 Nov 01 01:18:08.831078 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 78/157] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:18:08 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1362 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:18:09.075267 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-c4f992f2-beb3-48ef-b8c8-5c149dd21f7f tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:18:09.075861 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-c4f992f2-beb3-48ef-b8c8-5c149dd21f7f tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] [instance: 09733ccb-dd41-48bf-bf48-eafba2dfc208] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:18:09.081610 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c4f992f2-beb3-48ef-b8c8-5c149dd21f7f tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:18:09.082122 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c4f992f2-beb3-48ef-b8c8-5c149dd21f7f tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:18:09.083053 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c4f992f2-beb3-48ef-b8c8-5c149dd21f7f tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:18:09.083554 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c4f992f2-beb3-48ef-b8c8-5c149dd21f7f tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:18:09.205488 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-c4f992f2-beb3-48ef-b8c8-5c149dd21f7f tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03064ba5be1410aba9c9c2331b70bd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a798dc4102c4296b56bf54cd38cde6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:18:09.212911 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-c4f992f2-beb3-48ef-b8c8-5c149dd21f7f tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] 10.222.0.47 "GET /compute/v2.1/servers/09733ccb-dd41-48bf-bf48-eafba2dfc208" status: 200 len: 1315 microversion: 2.1 time: 0.141303 Nov 01 01:18:09.213476 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 80/158] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:18:09 2021] GET /compute/v2.1/servers/09733ccb-dd41-48bf-bf48-eafba2dfc208 => generated 1315 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:18:09.847187 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-902f298a-e926-427e-92ae-fc1c547fc1f1 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:18:09.847787 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-902f298a-e926-427e-92ae-fc1c547fc1f1 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:18:09.853640 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-902f298a-e926-427e-92ae-fc1c547fc1f1 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:18:09.854081 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-902f298a-e926-427e-92ae-fc1c547fc1f1 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:18:09.854881 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-902f298a-e926-427e-92ae-fc1c547fc1f1 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:18:09.855353 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-902f298a-e926-427e-92ae-fc1c547fc1f1 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:18:09.977207 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-902f298a-e926-427e-92ae-fc1c547fc1f1 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:18:09.984588 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-902f298a-e926-427e-92ae-fc1c547fc1f1 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1362 microversion: 2.1 time: 0.140946 Nov 01 01:18:09.985945 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 79/159] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:18:09 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1362 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:18:10.230285 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-41bb408b-d975-4062-ab0b-5bbfd1e9d4e5 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:18:10.231010 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-41bb408b-d975-4062-ab0b-5bbfd1e9d4e5 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] [instance: 09733ccb-dd41-48bf-bf48-eafba2dfc208] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:18:10.237487 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-41bb408b-d975-4062-ab0b-5bbfd1e9d4e5 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:18:10.237930 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-41bb408b-d975-4062-ab0b-5bbfd1e9d4e5 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:18:10.239074 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-41bb408b-d975-4062-ab0b-5bbfd1e9d4e5 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:18:10.239736 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-41bb408b-d975-4062-ab0b-5bbfd1e9d4e5 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:18:10.384739 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-41bb408b-d975-4062-ab0b-5bbfd1e9d4e5 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03064ba5be1410aba9c9c2331b70bd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a798dc4102c4296b56bf54cd38cde6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:18:10.394808 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-41bb408b-d975-4062-ab0b-5bbfd1e9d4e5 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] 10.222.0.47 "GET /compute/v2.1/servers/09733ccb-dd41-48bf-bf48-eafba2dfc208" status: 200 len: 1315 microversion: 2.1 time: 0.168133 Nov 01 01:18:10.395842 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 81/160] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:18:10 2021] GET /compute/v2.1/servers/09733ccb-dd41-48bf-bf48-eafba2dfc208 => generated 1315 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:18:11.003196 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-3da4f747-c6a4-4899-936b-06b9d2dd7cbf tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:18:11.015647 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-3da4f747-c6a4-4899-936b-06b9d2dd7cbf tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:18:11.015647 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3da4f747-c6a4-4899-936b-06b9d2dd7cbf tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:18:11.015647 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3da4f747-c6a4-4899-936b-06b9d2dd7cbf tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:18:11.015647 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3da4f747-c6a4-4899-936b-06b9d2dd7cbf tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:18:11.016068 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3da4f747-c6a4-4899-936b-06b9d2dd7cbf tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:18:11.137605 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-3da4f747-c6a4-4899-936b-06b9d2dd7cbf tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:18:11.144838 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-3da4f747-c6a4-4899-936b-06b9d2dd7cbf tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1362 microversion: 2.1 time: 0.146299 Nov 01 01:18:11.145435 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 80/161] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:18:10 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1362 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:18:11.411888 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-3d7fb425-c38e-4c7c-8c39-1efed422d256 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:18:11.412487 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-3d7fb425-c38e-4c7c-8c39-1efed422d256 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] [instance: 09733ccb-dd41-48bf-bf48-eafba2dfc208] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:18:11.418332 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3d7fb425-c38e-4c7c-8c39-1efed422d256 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:18:11.418809 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3d7fb425-c38e-4c7c-8c39-1efed422d256 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:18:11.419565 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3d7fb425-c38e-4c7c-8c39-1efed422d256 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:18:11.419987 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3d7fb425-c38e-4c7c-8c39-1efed422d256 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:18:11.537656 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-3d7fb425-c38e-4c7c-8c39-1efed422d256 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03064ba5be1410aba9c9c2331b70bd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a798dc4102c4296b56bf54cd38cde6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:18:11.544831 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-3d7fb425-c38e-4c7c-8c39-1efed422d256 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] 10.222.0.47 "GET /compute/v2.1/servers/09733ccb-dd41-48bf-bf48-eafba2dfc208" status: 200 len: 1502 microversion: 2.1 time: 0.136844 Nov 01 01:18:11.545387 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 82/162] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:18:11 2021] GET /compute/v2.1/servers/09733ccb-dd41-48bf-bf48-eafba2dfc208 => generated 1502 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:18:12.162652 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-40511977-76f9-45a2-a7ee-2db54db93822 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:18:12.163260 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-40511977-76f9-45a2-a7ee-2db54db93822 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:18:12.169505 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-40511977-76f9-45a2-a7ee-2db54db93822 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:18:12.169949 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-40511977-76f9-45a2-a7ee-2db54db93822 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:18:12.170766 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-40511977-76f9-45a2-a7ee-2db54db93822 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:18:12.171194 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-40511977-76f9-45a2-a7ee-2db54db93822 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:18:12.294289 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-40511977-76f9-45a2-a7ee-2db54db93822 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:18:12.301502 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-40511977-76f9-45a2-a7ee-2db54db93822 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1547 microversion: 2.1 time: 0.142519 Nov 01 01:18:12.302179 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 81/163] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:18:12 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1547 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:18:12.318637 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-6e3f64d3-9517-45e1-9293-a3485e64badc tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:18:12.319216 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-6e3f64d3-9517-45e1-9293-a3485e64badc tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:18:12.325414 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-6e3f64d3-9517-45e1-9293-a3485e64badc tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:18:12.325851 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-6e3f64d3-9517-45e1-9293-a3485e64badc tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:18:12.326663 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-6e3f64d3-9517-45e1-9293-a3485e64badc tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:18:12.327083 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-6e3f64d3-9517-45e1-9293-a3485e64badc tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:18:12.448954 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-6e3f64d3-9517-45e1-9293-a3485e64badc tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.133992 Nov 01 01:18:12.449615 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 83/164] 10.222.0.47 () {58 vars in 1274 bytes} [Mon Nov 1 01:18:12 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/os-interface => generated 284 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:18:13.929532 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-042ba1f4-b292-4d42-95e0-2ad74f183d69 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:18:13.930619 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-042ba1f4-b292-4d42-95e0-2ad74f183d69 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:18:13.930778 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [req-bed021cb-3bba-4b1e-b6d5-b9d795c7dd4a req-f7614392-e901-4866-b8a4-c68ce7c0ef71 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8", "tag": "19f68242-dd43-4db0-a30f-928bbd241951"}]} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:18:13.942575 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 01 01:18:13.942575 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: warnings.warn(msg) Nov 01 01:18:13.942767 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-042ba1f4-b292-4d42-95e0-2ad74f183d69 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:18:13.942767 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-042ba1f4-b292-4d42-95e0-2ad74f183d69 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:18:13.942910 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [req-bed021cb-3bba-4b1e-b6d5-b9d795c7dd4a req-f7614392-e901-4866-b8a4-c68ce7c0ef71 service nova] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:18:13.942992 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-042ba1f4-b292-4d42-95e0-2ad74f183d69 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:18:13.943060 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [req-bed021cb-3bba-4b1e-b6d5-b9d795c7dd4a req-f7614392-e901-4866-b8a4-c68ce7c0ef71 service nova] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:18:13.943133 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-042ba1f4-b292-4d42-95e0-2ad74f183d69 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:18:13.953084 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.compute.server_external_events [req-bed021cb-3bba-4b1e-b6d5-b9d795c7dd4a req-f7614392-e901-4866-b8a4-c68ce7c0ef71 service nova] Creating event network-changed:19f68242-dd43-4db0-a30f-928bbd241951 for instance a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 on hv-cinder-81561 Nov 01 01:18:13.958803 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [req-bed021cb-3bba-4b1e-b6d5-b9d795c7dd4a req-f7614392-e901-4866-b8a4-c68ce7c0ef71 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031795 Nov 01 01:18:13.959564 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 84/165] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Nov 1 01:18:13 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 01 01:18:16.014749 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-042ba1f4-b292-4d42-95e0-2ad74f183d69 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "POST /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/action" status: 200 len: 14 microversion: 2.1 time: 2.089905 Nov 01 01:18:16.015450 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 82/166] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Nov 1 01:18:13 2021] POST /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/action => generated 14 bytes in 2092 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 01 01:18:17.026946 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-4ce4b8bc-0339-431c-984b-9194d2142d66 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:18:17.027931 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-4ce4b8bc-0339-431c-984b-9194d2142d66 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:18:17.033986 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4ce4b8bc-0339-431c-984b-9194d2142d66 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:18:17.034455 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4ce4b8bc-0339-431c-984b-9194d2142d66 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:18:17.035350 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4ce4b8bc-0339-431c-984b-9194d2142d66 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:18:17.035762 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4ce4b8bc-0339-431c-984b-9194d2142d66 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:18:17.150833 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-4ce4b8bc-0339-431c-984b-9194d2142d66 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "POST /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/action" status: 200 len: 14 microversion: 2.1 time: 0.127743 Nov 01 01:18:17.151441 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 85/167] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Nov 1 01:18:17 2021] POST /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/action => generated 14 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 01 01:18:18.161527 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-ec64984e-30e7-46a8-8eb2-c7690b11b7cd tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:18:18.162548 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-ec64984e-30e7-46a8-8eb2-c7690b11b7cd tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:18:18.171665 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ec64984e-30e7-46a8-8eb2-c7690b11b7cd tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:18:18.181261 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ec64984e-30e7-46a8-8eb2-c7690b11b7cd tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:18:18.181261 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ec64984e-30e7-46a8-8eb2-c7690b11b7cd tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:18:18.181261 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ec64984e-30e7-46a8-8eb2-c7690b11b7cd tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:18:18.267265 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-ec64984e-30e7-46a8-8eb2-c7690b11b7cd tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "POST /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/action" status: 200 len: 14 microversion: 2.1 time: 0.109545 Nov 01 01:18:18.267889 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 83/168] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Nov 1 01:18:18 2021] POST /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/action => generated 14 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 01 01:18:18.299993 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-d522b861-9c2a-4ed3-bd56-32053229a111 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "63710426-26d3-4545-a0cd-6bd99c70a716"}} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:18:18.301067 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-d522b861-9c2a-4ed3-bd56-32053229a111 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] [instance: 09733ccb-dd41-48bf-bf48-eafba2dfc208] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:18:18.308199 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d522b861-9c2a-4ed3-bd56-32053229a111 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:18:18.308641 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d522b861-9c2a-4ed3-bd56-32053229a111 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:18:18.309425 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d522b861-9c2a-4ed3-bd56-32053229a111 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:18:18.309851 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d522b861-9c2a-4ed3-bd56-32053229a111 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:18:19.278025 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-5161be04-3479-47f4-a1c2-786449f3fb70 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:18:19.279065 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-5161be04-3479-47f4-a1c2-786449f3fb70 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:18:19.285777 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5161be04-3479-47f4-a1c2-786449f3fb70 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:18:19.289648 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5161be04-3479-47f4-a1c2-786449f3fb70 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:18:19.289648 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5161be04-3479-47f4-a1c2-786449f3fb70 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:18:19.289648 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5161be04-3479-47f4-a1c2-786449f3fb70 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:18:19.367307 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-5161be04-3479-47f4-a1c2-786449f3fb70 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "POST /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/action" status: 200 len: 14 microversion: 2.1 time: 0.093035 Nov 01 01:18:19.367960 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 84/169] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Nov 1 01:18:19 2021] POST /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/action => generated 14 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 01 01:18:19.864118 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-d522b861-9c2a-4ed3-bd56-32053229a111 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] 10.222.0.47 "POST /compute/v2.1/servers/09733ccb-dd41-48bf-bf48-eafba2dfc208/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.569883 Nov 01 01:18:19.864762 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 86/170] 10.222.0.47 () {60 vars in 1322 bytes} [Mon Nov 1 01:18:18 2021] POST /compute/v2.1/servers/09733ccb-dd41-48bf-bf48-eafba2dfc208/os-volume_attachments => generated 194 bytes in 1572 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:18:20.378981 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-c7f48e53-ea95-418e-a42c-791fee61c25a tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:18:20.379978 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-c7f48e53-ea95-418e-a42c-791fee61c25a tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:18:20.387186 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c7f48e53-ea95-418e-a42c-791fee61c25a tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:18:20.392374 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c7f48e53-ea95-418e-a42c-791fee61c25a tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:18:20.392374 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c7f48e53-ea95-418e-a42c-791fee61c25a tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:18:20.392374 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c7f48e53-ea95-418e-a42c-791fee61c25a tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:18:20.485412 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-c7f48e53-ea95-418e-a42c-791fee61c25a tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "POST /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/action" status: 200 len: 14 microversion: 2.1 time: 0.110364 Nov 01 01:18:20.488762 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 85/171] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Nov 1 01:18:20 2021] POST /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/action => generated 14 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 01 01:18:21.497078 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-48ed657d-fe25-470e-bb31-8f42f428f82a tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:18:21.499152 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-48ed657d-fe25-470e-bb31-8f42f428f82a tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:18:21.505789 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-48ed657d-fe25-470e-bb31-8f42f428f82a tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:18:21.506336 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-48ed657d-fe25-470e-bb31-8f42f428f82a tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:18:21.507507 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-48ed657d-fe25-470e-bb31-8f42f428f82a tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:18:21.507939 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-48ed657d-fe25-470e-bb31-8f42f428f82a tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:18:21.650907 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-48ed657d-fe25-470e-bb31-8f42f428f82a tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "POST /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/action" status: 200 len: 14 microversion: 2.1 time: 0.158266 Nov 01 01:18:21.651570 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 87/172] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Nov 1 01:18:21 2021] POST /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/action => generated 14 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 01 01:18:22.663603 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-09817d80-583a-4d2c-9563-39482e2ebb52 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:18:22.664585 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-09817d80-583a-4d2c-9563-39482e2ebb52 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:18:22.677218 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-09817d80-583a-4d2c-9563-39482e2ebb52 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:18:22.677218 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-09817d80-583a-4d2c-9563-39482e2ebb52 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:18:22.677965 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-09817d80-583a-4d2c-9563-39482e2ebb52 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:18:22.678403 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-09817d80-583a-4d2c-9563-39482e2ebb52 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:18:22.785542 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-09817d80-583a-4d2c-9563-39482e2ebb52 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "POST /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/action" status: 200 len: 14 microversion: 2.1 time: 0.127697 Nov 01 01:18:22.789573 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 86/173] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Nov 1 01:18:22 2021] POST /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/action => generated 14 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 01 01:18:23.801300 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-576d84f1-d179-44fa-a97d-6a5cc3a704e4 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:18:23.801300 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-576d84f1-d179-44fa-a97d-6a5cc3a704e4 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:18:23.820369 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-576d84f1-d179-44fa-a97d-6a5cc3a704e4 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:18:23.820820 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-576d84f1-d179-44fa-a97d-6a5cc3a704e4 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:18:23.821744 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-576d84f1-d179-44fa-a97d-6a5cc3a704e4 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:18:23.822038 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-576d84f1-d179-44fa-a97d-6a5cc3a704e4 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:18:23.964143 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-576d84f1-d179-44fa-a97d-6a5cc3a704e4 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "POST /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/action" status: 200 len: 4008 microversion: 2.1 time: 0.170928 Nov 01 01:18:23.965055 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 88/174] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Nov 1 01:18:23 2021] POST /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/action => generated 4008 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:18:24.977860 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-0efbddd2-4053-42f8-8fff-3dfe26f946b7 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:18:24.977860 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-0efbddd2-4053-42f8-8fff-3dfe26f946b7 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:18:24.984330 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0efbddd2-4053-42f8-8fff-3dfe26f946b7 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:18:24.984954 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0efbddd2-4053-42f8-8fff-3dfe26f946b7 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:18:24.987244 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0efbddd2-4053-42f8-8fff-3dfe26f946b7 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:18:24.987244 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0efbddd2-4053-42f8-8fff-3dfe26f946b7 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:18:25.091774 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-0efbddd2-4053-42f8-8fff-3dfe26f946b7 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "POST /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/action" status: 200 len: 10367 microversion: 2.1 time: 0.119354 Nov 01 01:18:25.093109 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 87/175] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Nov 1 01:18:24 2021] POST /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/action => generated 10367 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 01 01:18:26.104699 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-133dd6cf-23bf-4f41-aadd-1658134f2dd8 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:18:26.105713 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-133dd6cf-23bf-4f41-aadd-1658134f2dd8 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:18:26.112724 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-133dd6cf-23bf-4f41-aadd-1658134f2dd8 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:18:26.114286 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-133dd6cf-23bf-4f41-aadd-1658134f2dd8 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:18:26.114286 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-133dd6cf-23bf-4f41-aadd-1658134f2dd8 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:18:26.114493 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-133dd6cf-23bf-4f41-aadd-1658134f2dd8 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:18:26.235515 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-133dd6cf-23bf-4f41-aadd-1658134f2dd8 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "POST /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/action" status: 200 len: 15827 microversion: 2.1 time: 0.134434 Nov 01 01:18:26.237193 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 89/176] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Nov 1 01:18:26 2021] POST /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/action => generated 15827 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 01 01:18:27.256191 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-cc319566-4974-4ce1-897a-95176e8fa8e6 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:18:27.264688 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-cc319566-4974-4ce1-897a-95176e8fa8e6 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:18:27.283341 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-cc319566-4974-4ce1-897a-95176e8fa8e6 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:18:27.283944 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-cc319566-4974-4ce1-897a-95176e8fa8e6 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:18:27.284739 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-cc319566-4974-4ce1-897a-95176e8fa8e6 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:18:27.285173 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-cc319566-4974-4ce1-897a-95176e8fa8e6 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:18:27.401144 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-cc319566-4974-4ce1-897a-95176e8fa8e6 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "POST /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/action" status: 200 len: 17861 microversion: 2.1 time: 0.153815 Nov 01 01:18:27.401973 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 88/177] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Nov 1 01:18:27 2021] POST /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/action => generated 17861 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 01 01:18:28.413844 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-d899582c-efcf-4683-a692-3e89aeeb736f tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:18:28.415067 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-d899582c-efcf-4683-a692-3e89aeeb736f tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:18:28.427141 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d899582c-efcf-4683-a692-3e89aeeb736f tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:18:28.427629 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d899582c-efcf-4683-a692-3e89aeeb736f tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:18:28.428427 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d899582c-efcf-4683-a692-3e89aeeb736f tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:18:28.428860 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d899582c-efcf-4683-a692-3e89aeeb736f tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:18:28.537734 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-d899582c-efcf-4683-a692-3e89aeeb736f tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "POST /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/action" status: 200 len: 19342 microversion: 2.1 time: 0.127746 Nov 01 01:18:28.538933 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 90/178] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Nov 1 01:18:28 2021] POST /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/action => generated 19342 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 01 01:18:29.550625 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-5a958e2f-3969-407e-8713-fd81a1575320 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:18:29.551638 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-5a958e2f-3969-407e-8713-fd81a1575320 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:18:29.559112 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5a958e2f-3969-407e-8713-fd81a1575320 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:18:29.559570 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5a958e2f-3969-407e-8713-fd81a1575320 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:18:29.560421 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5a958e2f-3969-407e-8713-fd81a1575320 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:18:29.561029 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5a958e2f-3969-407e-8713-fd81a1575320 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:18:29.689791 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-5a958e2f-3969-407e-8713-fd81a1575320 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "POST /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/action" status: 200 len: 21563 microversion: 2.1 time: 0.144187 Nov 01 01:18:29.693403 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 89/179] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Nov 1 01:18:29 2021] POST /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/action => generated 21563 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 01 01:18:30.700741 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-91fc2b13-9209-4dea-9fab-ad0b4b07bf9e tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:18:30.702351 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-91fc2b13-9209-4dea-9fab-ad0b4b07bf9e tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:18:30.720633 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-91fc2b13-9209-4dea-9fab-ad0b4b07bf9e tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:18:30.720633 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-91fc2b13-9209-4dea-9fab-ad0b4b07bf9e tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:18:30.722792 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-91fc2b13-9209-4dea-9fab-ad0b4b07bf9e tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:18:30.723239 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-91fc2b13-9209-4dea-9fab-ad0b4b07bf9e tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:18:30.865269 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-91fc2b13-9209-4dea-9fab-ad0b4b07bf9e tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "POST /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/action" status: 200 len: 22981 microversion: 2.1 time: 0.167509 Nov 01 01:18:30.866370 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 91/180] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Nov 1 01:18:30 2021] POST /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/action => generated 22981 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 01 01:18:31.877289 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-e2af0d4d-a193-4ab9-8297-8b47ac269f40 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:18:31.878409 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-e2af0d4d-a193-4ab9-8297-8b47ac269f40 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:18:31.885140 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e2af0d4d-a193-4ab9-8297-8b47ac269f40 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:18:31.885585 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e2af0d4d-a193-4ab9-8297-8b47ac269f40 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:18:31.886350 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e2af0d4d-a193-4ab9-8297-8b47ac269f40 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:18:31.886812 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e2af0d4d-a193-4ab9-8297-8b47ac269f40 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:18:31.992484 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-e2af0d4d-a193-4ab9-8297-8b47ac269f40 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "POST /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/action" status: 200 len: 23920 microversion: 2.1 time: 0.119094 Nov 01 01:18:31.996617 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 90/181] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Nov 1 01:18:31 2021] POST /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/action => generated 23920 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 01 01:18:32.242192 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-bd7f270c-5457-4971-a0e4-f228f56ad6d8 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:18:32.242881 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-bd7f270c-5457-4971-a0e4-f228f56ad6d8 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] [instance: 09733ccb-dd41-48bf-bf48-eafba2dfc208] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:18:32.249659 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-bd7f270c-5457-4971-a0e4-f228f56ad6d8 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:18:32.250622 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-bd7f270c-5457-4971-a0e4-f228f56ad6d8 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:18:32.251369 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-bd7f270c-5457-4971-a0e4-f228f56ad6d8 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:18:32.251787 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-bd7f270c-5457-4971-a0e4-f228f56ad6d8 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:18:32.276508 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-bd7f270c-5457-4971-a0e4-f228f56ad6d8 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] [instance: 09733ccb-dd41-48bf-bf48-eafba2dfc208] Going to try to terminate instance {{(pid=116267) delete /opt/stack/nova/nova/compute/api.py:2612}} Nov 01 01:18:32.698753 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-bd7f270c-5457-4971-a0e4-f228f56ad6d8 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] 10.222.0.47 "DELETE /compute/v2.1/servers/09733ccb-dd41-48bf-bf48-eafba2dfc208" status: 204 len: 0 microversion: 2.1 time: 0.459997 Nov 01 01:18:32.699383 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 92/182] 10.222.0.47 () {58 vars in 1238 bytes} [Mon Nov 1 01:18:32 2021] DELETE /compute/v2.1/servers/09733ccb-dd41-48bf-bf48-eafba2dfc208 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 01 01:18:32.707916 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-9c87f3df-a05d-4426-8400-8cca917860df tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:18:32.708614 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-9c87f3df-a05d-4426-8400-8cca917860df tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] [instance: 09733ccb-dd41-48bf-bf48-eafba2dfc208] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:18:32.715716 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9c87f3df-a05d-4426-8400-8cca917860df tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:18:32.716132 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9c87f3df-a05d-4426-8400-8cca917860df tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:18:32.716898 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9c87f3df-a05d-4426-8400-8cca917860df tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:18:32.717322 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9c87f3df-a05d-4426-8400-8cca917860df tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:18:32.836954 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-9c87f3df-a05d-4426-8400-8cca917860df tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03064ba5be1410aba9c9c2331b70bd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a798dc4102c4296b56bf54cd38cde6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:18:32.845135 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-9c87f3df-a05d-4426-8400-8cca917860df tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] 10.222.0.47 "GET /compute/v2.1/servers/09733ccb-dd41-48bf-bf48-eafba2dfc208" status: 200 len: 1554 microversion: 2.1 time: 0.141349 Nov 01 01:18:32.845684 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 91/183] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:18:32 2021] GET /compute/v2.1/servers/09733ccb-dd41-48bf-bf48-eafba2dfc208 => generated 1554 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:18:33.004650 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-474b7180-f3ce-4466-9f7a-8f8ef1d42d52 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:18:33.005648 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-474b7180-f3ce-4466-9f7a-8f8ef1d42d52 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:18:33.011888 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-474b7180-f3ce-4466-9f7a-8f8ef1d42d52 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:18:33.012340 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-474b7180-f3ce-4466-9f7a-8f8ef1d42d52 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:18:33.013084 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-474b7180-f3ce-4466-9f7a-8f8ef1d42d52 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:18:33.013511 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-474b7180-f3ce-4466-9f7a-8f8ef1d42d52 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:18:33.120158 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-474b7180-f3ce-4466-9f7a-8f8ef1d42d52 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "POST /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/action" status: 200 len: 25199 microversion: 2.1 time: 0.119144 Nov 01 01:18:33.120826 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 93/184] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Nov 1 01:18:32 2021] POST /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/action => generated 25199 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 01 01:18:33.385903 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-d3f85f9f-ae17-4f6e-8ab3-0d2feaa21f41 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1923303006", "imageRef": "b9068d8d-b02d-4043-9f0c-3d774cb372b3", "flavorRef": "452", "networks": [{"uuid": "f0dd56fe-eb79-4250-ac89-da394c190ab1"}]}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:18:33.439226 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.network.neutron [None req-d3f85f9f-ae17-4f6e-8ab3-0d2feaa21f41 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] validate_networks() for [('f0dd56fe-eb79-4250-ac89-da394c190ab1', None, None, None, None, None)] {{(pid=116266) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Nov 01 01:18:33.792537 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.virt.hardware [None req-d3f85f9f-ae17-4f6e-8ab3-0d2feaa21f41 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Flavor limits 0:0:0 {{(pid=116266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 01 01:18:33.792945 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.virt.hardware [None req-d3f85f9f-ae17-4f6e-8ab3-0d2feaa21f41 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Image limits 0:0:0 {{(pid=116266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 01 01:18:33.793666 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.virt.hardware [None req-d3f85f9f-ae17-4f6e-8ab3-0d2feaa21f41 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Flavor pref 0:0:0 {{(pid=116266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 01 01:18:33.794181 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.virt.hardware [None req-d3f85f9f-ae17-4f6e-8ab3-0d2feaa21f41 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Image pref 0:0:0 {{(pid=116266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 01 01:18:33.794876 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.virt.hardware [None req-d3f85f9f-ae17-4f6e-8ab3-0d2feaa21f41 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 01 01:18:33.804062 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d3f85f9f-ae17-4f6e-8ab3-0d2feaa21f41 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:18:33.804563 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d3f85f9f-ae17-4f6e-8ab3-0d2feaa21f41 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:18:33.805485 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d3f85f9f-ae17-4f6e-8ab3-0d2feaa21f41 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:18:33.806069 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d3f85f9f-ae17-4f6e-8ab3-0d2feaa21f41 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:18:33.823256 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.quota [None req-d3f85f9f-ae17-4f6e-8ab3-0d2feaa21f41 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Getting quotas for project 7a22541a330f4071a6c2100f2dc47e39. Resources: {'instances', 'cores', 'ram'} {{(pid=116266) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 01 01:18:33.827206 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.quota [None req-d3f85f9f-ae17-4f6e-8ab3-0d2feaa21f41 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Getting quotas for user 887cfd0993f448faafa95b4543bf5085 and project 7a22541a330f4071a6c2100f2dc47e39. Resources: {'instances', 'cores', 'ram'} {{(pid=116266) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 01 01:18:33.838508 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-d3f85f9f-ae17-4f6e-8ab3-0d2feaa21f41 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Going to run 1 instances... {{(pid=116266) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 01 01:18:33.841157 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-d3f85f9f-ae17-4f6e-8ab3-0d2feaa21f41 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] [instance: 908ea23f-8ec7-4bd2-83d4-676d4e252830] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b9068d8d-b02d-4043-9f0c-3d774cb372b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116266) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 01 01:18:33.862223 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-8b42cec3-00c7-4386-9065-fee2a15eaf89 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:18:33.863039 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-8b42cec3-00c7-4386-9065-fee2a15eaf89 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] [instance: 09733ccb-dd41-48bf-bf48-eafba2dfc208] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:18:33.870333 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8b42cec3-00c7-4386-9065-fee2a15eaf89 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:18:33.870807 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8b42cec3-00c7-4386-9065-fee2a15eaf89 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:18:33.871570 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8b42cec3-00c7-4386-9065-fee2a15eaf89 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:18:33.872033 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8b42cec3-00c7-4386-9065-fee2a15eaf89 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:18:33.993605 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-d3f85f9f-ae17-4f6e-8ab3-0d2feaa21f41 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.611327 Nov 01 01:18:33.994252 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 92/185] 10.222.0.47 () {60 vars in 1146 bytes} [Mon Nov 1 01:18:33 2021] POST /compute/v2.1/servers => generated 380 bytes in 613 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 01 01:18:34.004919 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-3b742bcb-37ba-4dff-b547-9896996cb660 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:18:34.005525 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-3b742bcb-37ba-4dff-b547-9896996cb660 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] [instance: 908ea23f-8ec7-4bd2-83d4-676d4e252830] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:18:34.007715 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-8b42cec3-00c7-4386-9065-fee2a15eaf89 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03064ba5be1410aba9c9c2331b70bd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a798dc4102c4296b56bf54cd38cde6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:18:34.018067 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-8b42cec3-00c7-4386-9065-fee2a15eaf89 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] 10.222.0.47 "GET /compute/v2.1/servers/09733ccb-dd41-48bf-bf48-eafba2dfc208" status: 200 len: 1554 microversion: 2.1 time: 0.160236 Nov 01 01:18:34.027706 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 94/186] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:18:33 2021] GET /compute/v2.1/servers/09733ccb-dd41-48bf-bf48-eafba2dfc208 => generated 1554 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:18:34.059083 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-3b742bcb-37ba-4dff-b547-9896996cb660 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887cfd0993f448faafa95b4543bf5085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a22541a330f4071a6c2100f2dc47e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:18:34.067280 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-3b742bcb-37ba-4dff-b547-9896996cb660 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] 10.222.0.47 "GET /compute/v2.1/servers/908ea23f-8ec7-4bd2-83d4-676d4e252830" status: 200 len: 1214 microversion: 2.1 time: 0.065888 Nov 01 01:18:34.068088 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 93/187] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:18:33 2021] GET /compute/v2.1/servers/908ea23f-8ec7-4bd2-83d4-676d4e252830 => generated 1214 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:18:34.131577 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-95701f51-82f3-4845-8809-9d6fc9be619b tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:18:34.132563 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-95701f51-82f3-4845-8809-9d6fc9be619b tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:18:34.138849 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-95701f51-82f3-4845-8809-9d6fc9be619b tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:18:34.139346 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-95701f51-82f3-4845-8809-9d6fc9be619b tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:18:34.140026 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-95701f51-82f3-4845-8809-9d6fc9be619b tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:18:34.140562 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-95701f51-82f3-4845-8809-9d6fc9be619b tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:18:34.262415 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-95701f51-82f3-4845-8809-9d6fc9be619b tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "POST /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/action" status: 200 len: 26022 microversion: 2.1 time: 0.134470 Nov 01 01:18:34.263288 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 95/188] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Nov 1 01:18:34 2021] POST /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/action => generated 26022 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 01 01:18:35.036103 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-f8d7db3f-ceed-4b84-9380-0e7f5842f914 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:18:35.036746 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-f8d7db3f-ceed-4b84-9380-0e7f5842f914 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] [instance: 09733ccb-dd41-48bf-bf48-eafba2dfc208] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:18:35.043214 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f8d7db3f-ceed-4b84-9380-0e7f5842f914 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:18:35.043920 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f8d7db3f-ceed-4b84-9380-0e7f5842f914 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:18:35.044844 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f8d7db3f-ceed-4b84-9380-0e7f5842f914 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:18:35.045425 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f8d7db3f-ceed-4b84-9380-0e7f5842f914 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:18:35.085255 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-f51b6fe4-81b0-4d7f-a756-1df341b6eb9e tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:18:35.086593 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-f51b6fe4-81b0-4d7f-a756-1df341b6eb9e tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] [instance: 908ea23f-8ec7-4bd2-83d4-676d4e252830] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:18:35.178066 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-f51b6fe4-81b0-4d7f-a756-1df341b6eb9e tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887cfd0993f448faafa95b4543bf5085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a22541a330f4071a6c2100f2dc47e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:18:35.203623 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-f51b6fe4-81b0-4d7f-a756-1df341b6eb9e tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] 10.222.0.47 "GET /compute/v2.1/servers/908ea23f-8ec7-4bd2-83d4-676d4e252830" status: 200 len: 1214 microversion: 2.1 time: 0.122257 Nov 01 01:18:35.204838 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 96/189] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:18:35 2021] GET /compute/v2.1/servers/908ea23f-8ec7-4bd2-83d4-676d4e252830 => generated 1214 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:18:35.273481 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-66e28b64-a147-4cdd-9d49-5727f23c5d2a tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:18:35.274473 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-66e28b64-a147-4cdd-9d49-5727f23c5d2a tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:18:35.282632 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-66e28b64-a147-4cdd-9d49-5727f23c5d2a tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:18:35.283255 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-66e28b64-a147-4cdd-9d49-5727f23c5d2a tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:18:35.284174 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-66e28b64-a147-4cdd-9d49-5727f23c5d2a tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:18:35.284816 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-66e28b64-a147-4cdd-9d49-5727f23c5d2a tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:18:35.336254 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-f8d7db3f-ceed-4b84-9380-0e7f5842f914 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03064ba5be1410aba9c9c2331b70bd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a798dc4102c4296b56bf54cd38cde6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:18:35.352048 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-f8d7db3f-ceed-4b84-9380-0e7f5842f914 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] 10.222.0.47 "GET /compute/v2.1/servers/09733ccb-dd41-48bf-bf48-eafba2dfc208" status: 200 len: 1554 microversion: 2.1 time: 0.318704 Nov 01 01:18:35.354186 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 94/190] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:18:35 2021] GET /compute/v2.1/servers/09733ccb-dd41-48bf-bf48-eafba2dfc208 => generated 1554 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:18:35.421445 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-66e28b64-a147-4cdd-9d49-5727f23c5d2a tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "POST /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/action" status: 200 len: 27106 microversion: 2.1 time: 0.151235 Nov 01 01:18:35.424289 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 97/191] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Nov 1 01:18:35 2021] POST /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/action => generated 27106 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 01 01:18:36.019044 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [req-ed879457-c09e-4fa8-b202-c248c64c7014 req-f940a70d-72e7-490f-b2cb-cf55acdd9120 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09733ccb-dd41-48bf-bf48-eafba2dfc208", "name": "network-vif-deleted", "tag": "bae81874-aed7-454c-b211-7fdd6bfa80b2"}]} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:18:36.020715 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 01 01:18:36.020715 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: warnings.warn(msg) Nov 01 01:18:36.027885 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [req-ed879457-c09e-4fa8-b202-c248c64c7014 req-f940a70d-72e7-490f-b2cb-cf55acdd9120 service nova] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:18:36.028454 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [req-ed879457-c09e-4fa8-b202-c248c64c7014 req-f940a70d-72e7-490f-b2cb-cf55acdd9120 service nova] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:18:36.039847 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.compute.server_external_events [req-ed879457-c09e-4fa8-b202-c248c64c7014 req-f940a70d-72e7-490f-b2cb-cf55acdd9120 service nova] Creating event network-vif-deleted:bae81874-aed7-454c-b211-7fdd6bfa80b2 for instance 09733ccb-dd41-48bf-bf48-eafba2dfc208 on hv-cinder-81561 Nov 01 01:18:36.045596 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [req-ed879457-c09e-4fa8-b202-c248c64c7014 req-f940a70d-72e7-490f-b2cb-cf55acdd9120 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030236 Nov 01 01:18:36.047253 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 95/192] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Nov 1 01:18:36 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 01 01:18:36.221340 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-adb2c9f9-d494-4977-a737-31b7a2dc7a9f tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:18:36.222050 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-adb2c9f9-d494-4977-a737-31b7a2dc7a9f tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] [instance: 908ea23f-8ec7-4bd2-83d4-676d4e252830] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:18:36.228734 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-adb2c9f9-d494-4977-a737-31b7a2dc7a9f tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:18:36.229172 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-adb2c9f9-d494-4977-a737-31b7a2dc7a9f tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:18:36.229918 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-adb2c9f9-d494-4977-a737-31b7a2dc7a9f tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:18:36.230336 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-adb2c9f9-d494-4977-a737-31b7a2dc7a9f tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:18:36.301311 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-adb2c9f9-d494-4977-a737-31b7a2dc7a9f tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887cfd0993f448faafa95b4543bf5085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a22541a330f4071a6c2100f2dc47e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:18:36.314861 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-adb2c9f9-d494-4977-a737-31b7a2dc7a9f tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] 10.222.0.47 "GET /compute/v2.1/servers/908ea23f-8ec7-4bd2-83d4-676d4e252830" status: 200 len: 1210 microversion: 2.1 time: 0.097860 Nov 01 01:18:36.318445 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 98/193] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:18:36 2021] GET /compute/v2.1/servers/908ea23f-8ec7-4bd2-83d4-676d4e252830 => generated 1210 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:18:36.371565 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-a4201f9f-5045-4b28-aef1-9a78466ed61e tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:18:36.372265 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-a4201f9f-5045-4b28-aef1-9a78466ed61e tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] [instance: 09733ccb-dd41-48bf-bf48-eafba2dfc208] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:18:36.378332 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a4201f9f-5045-4b28-aef1-9a78466ed61e tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:18:36.378870 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a4201f9f-5045-4b28-aef1-9a78466ed61e tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:18:36.379791 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a4201f9f-5045-4b28-aef1-9a78466ed61e tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:18:36.380221 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a4201f9f-5045-4b28-aef1-9a78466ed61e tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:18:36.433088 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-1f693128-8234-4562-9003-febd46bfc8e7 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:18:36.434004 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-1f693128-8234-4562-9003-febd46bfc8e7 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:18:36.440426 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-1f693128-8234-4562-9003-febd46bfc8e7 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:18:36.440871 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-1f693128-8234-4562-9003-febd46bfc8e7 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:18:36.441630 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-1f693128-8234-4562-9003-febd46bfc8e7 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:18:36.442063 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-1f693128-8234-4562-9003-febd46bfc8e7 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:18:36.444973 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-a4201f9f-5045-4b28-aef1-9a78466ed61e tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03064ba5be1410aba9c9c2331b70bd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a798dc4102c4296b56bf54cd38cde6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:18:36.453460 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-a4201f9f-5045-4b28-aef1-9a78466ed61e tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] 10.222.0.47 "GET /compute/v2.1/servers/09733ccb-dd41-48bf-bf48-eafba2dfc208" status: 200 len: 1346 microversion: 2.1 time: 0.085421 Nov 01 01:18:36.454400 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 96/194] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:18:36 2021] GET /compute/v2.1/servers/09733ccb-dd41-48bf-bf48-eafba2dfc208 => generated 1346 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:18:36.538272 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-1f693128-8234-4562-9003-febd46bfc8e7 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "POST /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/action" status: 200 len: 27745 microversion: 2.1 time: 0.108678 Nov 01 01:18:36.539011 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 99/195] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Nov 1 01:18:36 2021] POST /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/action => generated 27745 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 01 01:18:37.333235 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-1e96effe-5247-401d-9e3a-4fec52d38234 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:18:37.334489 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-1e96effe-5247-401d-9e3a-4fec52d38234 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] [instance: 908ea23f-8ec7-4bd2-83d4-676d4e252830] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:18:37.340966 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1e96effe-5247-401d-9e3a-4fec52d38234 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:18:37.341568 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1e96effe-5247-401d-9e3a-4fec52d38234 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:18:37.342362 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1e96effe-5247-401d-9e3a-4fec52d38234 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:18:37.342805 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1e96effe-5247-401d-9e3a-4fec52d38234 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:18:37.452708 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-1e96effe-5247-401d-9e3a-4fec52d38234 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887cfd0993f448faafa95b4543bf5085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a22541a330f4071a6c2100f2dc47e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:18:37.460819 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-1e96effe-5247-401d-9e3a-4fec52d38234 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] 10.222.0.47 "GET /compute/v2.1/servers/908ea23f-8ec7-4bd2-83d4-676d4e252830" status: 200 len: 1274 microversion: 2.1 time: 0.131052 Nov 01 01:18:37.461651 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 97/196] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:18:37 2021] GET /compute/v2.1/servers/908ea23f-8ec7-4bd2-83d4-676d4e252830 => generated 1274 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:18:37.474522 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-3a812903-704b-48e8-ba4b-c903ae883b62 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:18:37.475916 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-3a812903-704b-48e8-ba4b-c903ae883b62 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] [instance: 09733ccb-dd41-48bf-bf48-eafba2dfc208] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:18:37.494339 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3a812903-704b-48e8-ba4b-c903ae883b62 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:18:37.495949 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3a812903-704b-48e8-ba4b-c903ae883b62 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:18:37.497130 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3a812903-704b-48e8-ba4b-c903ae883b62 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:18:37.500738 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3a812903-704b-48e8-ba4b-c903ae883b62 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:18:37.555366 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-bf17a8fd-aaa6-42dc-ae92-3368cbfa2253 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:18:37.556243 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-bf17a8fd-aaa6-42dc-ae92-3368cbfa2253 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:18:37.564261 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-bf17a8fd-aaa6-42dc-ae92-3368cbfa2253 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:18:37.564929 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-bf17a8fd-aaa6-42dc-ae92-3368cbfa2253 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:18:37.565859 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-bf17a8fd-aaa6-42dc-ae92-3368cbfa2253 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:18:37.566458 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-bf17a8fd-aaa6-42dc-ae92-3368cbfa2253 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:18:37.603587 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-3a812903-704b-48e8-ba4b-c903ae883b62 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03064ba5be1410aba9c9c2331b70bd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a798dc4102c4296b56bf54cd38cde6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:18:37.615789 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-3a812903-704b-48e8-ba4b-c903ae883b62 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] 10.222.0.47 "GET /compute/v2.1/servers/09733ccb-dd41-48bf-bf48-eafba2dfc208" status: 200 len: 1346 microversion: 2.1 time: 0.147172 Nov 01 01:18:37.631916 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 100/197] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:18:37 2021] GET /compute/v2.1/servers/09733ccb-dd41-48bf-bf48-eafba2dfc208 => generated 1346 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:18:37.687809 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-bf17a8fd-aaa6-42dc-ae92-3368cbfa2253 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "POST /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/action" status: 200 len: 28224 microversion: 2.1 time: 0.140708 Nov 01 01:18:37.688623 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 98/198] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Nov 1 01:18:37 2021] POST /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/action => generated 28224 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 01 01:18:38.491258 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-1c571e6d-4539-4cc9-a1ab-f15d1b315cab tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:18:38.492460 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-1c571e6d-4539-4cc9-a1ab-f15d1b315cab tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] [instance: 908ea23f-8ec7-4bd2-83d4-676d4e252830] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:18:38.501683 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-1c571e6d-4539-4cc9-a1ab-f15d1b315cab tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:18:38.502145 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-1c571e6d-4539-4cc9-a1ab-f15d1b315cab tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:18:38.503067 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-1c571e6d-4539-4cc9-a1ab-f15d1b315cab tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:18:38.503494 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-1c571e6d-4539-4cc9-a1ab-f15d1b315cab tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:18:38.639651 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-07e70522-95ca-4e60-bf4f-02b933b4accc tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:18:38.641386 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-07e70522-95ca-4e60-bf4f-02b933b4accc tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] [instance: 09733ccb-dd41-48bf-bf48-eafba2dfc208] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:18:38.655103 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-07e70522-95ca-4e60-bf4f-02b933b4accc tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:18:38.655845 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-07e70522-95ca-4e60-bf4f-02b933b4accc tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:18:38.656818 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-07e70522-95ca-4e60-bf4f-02b933b4accc tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:18:38.657323 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-07e70522-95ca-4e60-bf4f-02b933b4accc tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:18:38.709095 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-07e70522-95ca-4e60-bf4f-02b933b4accc tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:18:38.709540 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-07e70522-95ca-4e60-bf4f-02b933b4accc tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:18:38.710169 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.objects.instance [None req-07e70522-95ca-4e60-bf4f-02b933b4accc tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lazy-loading 'fault' on Instance uuid 09733ccb-dd41-48bf-bf48-eafba2dfc208 {{(pid=116266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 01 01:18:38.803474 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-07e70522-95ca-4e60-bf4f-02b933b4accc tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03064ba5be1410aba9c9c2331b70bd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a798dc4102c4296b56bf54cd38cde6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:18:38.817652 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-07e70522-95ca-4e60-bf4f-02b933b4accc tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] 10.222.0.47 "GET /compute/v2.1/servers/09733ccb-dd41-48bf-bf48-eafba2dfc208" status: 200 len: 1351 microversion: 2.1 time: 0.183330 Nov 01 01:18:38.819765 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 99/199] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:18:38 2021] GET /compute/v2.1/servers/09733ccb-dd41-48bf-bf48-eafba2dfc208 => generated 1351 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:18:38.831895 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-9451a5c6-1818-4a06-84cd-cecf18095345 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:18:38.832988 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-9451a5c6-1818-4a06-84cd-cecf18095345 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:18:38.848965 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9451a5c6-1818-4a06-84cd-cecf18095345 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:18:38.849657 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9451a5c6-1818-4a06-84cd-cecf18095345 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:18:38.850758 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9451a5c6-1818-4a06-84cd-cecf18095345 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:18:38.851595 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9451a5c6-1818-4a06-84cd-cecf18095345 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:18:38.920689 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-1c571e6d-4539-4cc9-a1ab-f15d1b315cab tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887cfd0993f448faafa95b4543bf5085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a22541a330f4071a6c2100f2dc47e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:18:38.929211 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-1c571e6d-4539-4cc9-a1ab-f15d1b315cab tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] 10.222.0.47 "GET /compute/v2.1/servers/908ea23f-8ec7-4bd2-83d4-676d4e252830" status: 200 len: 1314 microversion: 2.1 time: 0.441842 Nov 01 01:18:38.936239 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 101/200] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:18:38 2021] GET /compute/v2.1/servers/908ea23f-8ec7-4bd2-83d4-676d4e252830 => generated 1314 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:18:38.943355 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-9451a5c6-1818-4a06-84cd-cecf18095345 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "POST /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/action" status: 200 len: 28224 microversion: 2.1 time: 0.118978 Nov 01 01:18:38.944626 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 100/201] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Nov 1 01:18:38 2021] POST /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/action => generated 28224 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 01 01:18:39.659860 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [req-a0046a49-bfaa-4ef8-98eb-447d310977a6 req-3aba3c99-c734-4517-b297-339cfb8984e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "908ea23f-8ec7-4bd2-83d4-676d4e252830", "tag": "ecf12606-0353-4c44-bde9-6c1bfed6b6ca"}]} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:18:39.662402 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 01 01:18:39.662402 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: warnings.warn(msg) Nov 01 01:18:39.670466 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [req-a0046a49-bfaa-4ef8-98eb-447d310977a6 req-3aba3c99-c734-4517-b297-339cfb8984e0 service nova] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:18:39.671344 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [req-a0046a49-bfaa-4ef8-98eb-447d310977a6 req-3aba3c99-c734-4517-b297-339cfb8984e0 service nova] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:18:39.684941 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.compute.server_external_events [req-a0046a49-bfaa-4ef8-98eb-447d310977a6 req-3aba3c99-c734-4517-b297-339cfb8984e0 service nova] Creating event network-changed:ecf12606-0353-4c44-bde9-6c1bfed6b6ca for instance 908ea23f-8ec7-4bd2-83d4-676d4e252830 on hv-cinder-81561 Nov 01 01:18:39.691945 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [req-a0046a49-bfaa-4ef8-98eb-447d310977a6 req-3aba3c99-c734-4517-b297-339cfb8984e0 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034605 Nov 01 01:18:39.694075 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 102/202] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Nov 1 01:18:39 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:18:39.836258 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-1af73902-d15e-4427-95c8-688a5e1c5cec tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:18:39.837525 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-1af73902-d15e-4427-95c8-688a5e1c5cec tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] [instance: 09733ccb-dd41-48bf-bf48-eafba2dfc208] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:18:39.845583 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1af73902-d15e-4427-95c8-688a5e1c5cec tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:18:39.846240 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1af73902-d15e-4427-95c8-688a5e1c5cec tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:18:39.847247 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1af73902-d15e-4427-95c8-688a5e1c5cec tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:18:39.847874 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1af73902-d15e-4427-95c8-688a5e1c5cec tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:18:39.866048 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.wsgi [None req-1af73902-d15e-4427-95c8-688a5e1c5cec tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] HTTP exception thrown: Instance 09733ccb-dd41-48bf-bf48-eafba2dfc208 could not be found. Nov 01 01:18:39.866048 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-1af73902-d15e-4427-95c8-688a5e1c5cec tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Returning 404 to user: Instance 09733ccb-dd41-48bf-bf48-eafba2dfc208 could not be found. {{(pid=116266) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 01 01:18:39.866048 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-1af73902-d15e-4427-95c8-688a5e1c5cec tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] 10.222.0.47 "GET /compute/v2.1/servers/09733ccb-dd41-48bf-bf48-eafba2dfc208" status: 404 len: 111 microversion: 2.1 time: 0.033238 Nov 01 01:18:39.870724 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 101/203] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:18:39 2021] GET /compute/v2.1/servers/09733ccb-dd41-48bf-bf48-eafba2dfc208 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 01:18:39.946734 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-524cb61b-d3fe-49db-b553-38f609b60cbd tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:18:39.947476 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-524cb61b-d3fe-49db-b553-38f609b60cbd tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] [instance: 908ea23f-8ec7-4bd2-83d4-676d4e252830] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:18:39.954371 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-524cb61b-d3fe-49db-b553-38f609b60cbd tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:18:39.954830 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-524cb61b-d3fe-49db-b553-38f609b60cbd tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:18:39.955578 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-524cb61b-d3fe-49db-b553-38f609b60cbd tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:18:39.955996 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-524cb61b-d3fe-49db-b553-38f609b60cbd tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:18:39.956378 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-746630cb-8878-4f31-8ff1-d12b5e9918ed tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:18:39.957449 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-746630cb-8878-4f31-8ff1-d12b5e9918ed tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:18:39.964636 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-746630cb-8878-4f31-8ff1-d12b5e9918ed tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:18:39.965169 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-746630cb-8878-4f31-8ff1-d12b5e9918ed tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:18:39.966016 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-746630cb-8878-4f31-8ff1-d12b5e9918ed tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:18:39.966589 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-746630cb-8878-4f31-8ff1-d12b5e9918ed tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:18:40.052650 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-746630cb-8878-4f31-8ff1-d12b5e9918ed tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "POST /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/action" status: 200 len: 28224 microversion: 2.1 time: 0.100808 Nov 01 01:18:40.053314 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 102/204] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Nov 1 01:18:39 2021] POST /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/action => generated 28224 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 01 01:18:40.108335 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-524cb61b-d3fe-49db-b553-38f609b60cbd tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887cfd0993f448faafa95b4543bf5085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a22541a330f4071a6c2100f2dc47e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:18:40.116034 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-524cb61b-d3fe-49db-b553-38f609b60cbd tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] 10.222.0.47 "GET /compute/v2.1/servers/908ea23f-8ec7-4bd2-83d4-676d4e252830" status: 200 len: 1314 microversion: 2.1 time: 0.173211 Nov 01 01:18:40.116540 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 103/205] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:18:39 2021] GET /compute/v2.1/servers/908ea23f-8ec7-4bd2-83d4-676d4e252830 => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:18:40.326336 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-d0e23002-bbd0-4000-96c1-03a2b783eeae tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:18:40.328976 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-d0e23002-bbd0-4000-96c1-03a2b783eeae tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] [instance: 09733ccb-dd41-48bf-bf48-eafba2dfc208] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:18:40.336251 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d0e23002-bbd0-4000-96c1-03a2b783eeae tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:18:40.336950 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d0e23002-bbd0-4000-96c1-03a2b783eeae tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:18:40.337904 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d0e23002-bbd0-4000-96c1-03a2b783eeae tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:18:40.339052 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d0e23002-bbd0-4000-96c1-03a2b783eeae tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:18:40.354288 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.wsgi [None req-d0e23002-bbd0-4000-96c1-03a2b783eeae tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] HTTP exception thrown: Instance 09733ccb-dd41-48bf-bf48-eafba2dfc208 could not be found. Nov 01 01:18:40.355202 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-d0e23002-bbd0-4000-96c1-03a2b783eeae tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Returning 404 to user: Instance 09733ccb-dd41-48bf-bf48-eafba2dfc208 could not be found. {{(pid=116266) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 01 01:18:40.356460 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-d0e23002-bbd0-4000-96c1-03a2b783eeae tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] 10.222.0.47 "GET /compute/v2.1/servers/09733ccb-dd41-48bf-bf48-eafba2dfc208/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.033965 Nov 01 01:18:40.357226 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 103/206] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:18:40 2021] GET /compute/v2.1/servers/09733ccb-dd41-48bf-bf48-eafba2dfc208/os-volume_attachments => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 01:18:41.064598 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-13f9a0f9-d2fc-4552-ae74-0c8c6540ccca tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:18:41.065516 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-13f9a0f9-d2fc-4552-ae74-0c8c6540ccca tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:18:41.071789 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-13f9a0f9-d2fc-4552-ae74-0c8c6540ccca tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:18:41.072240 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-13f9a0f9-d2fc-4552-ae74-0c8c6540ccca tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:18:41.073035 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-13f9a0f9-d2fc-4552-ae74-0c8c6540ccca tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:18:41.073467 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-13f9a0f9-d2fc-4552-ae74-0c8c6540ccca tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:18:41.133002 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-244fa566-f87f-4727-ad56-42fc8f7359b9 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:18:41.134143 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-244fa566-f87f-4727-ad56-42fc8f7359b9 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] [instance: 908ea23f-8ec7-4bd2-83d4-676d4e252830] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:18:41.140777 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-244fa566-f87f-4727-ad56-42fc8f7359b9 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:18:41.141224 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-244fa566-f87f-4727-ad56-42fc8f7359b9 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:18:41.141982 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-244fa566-f87f-4727-ad56-42fc8f7359b9 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:18:41.142875 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-244fa566-f87f-4727-ad56-42fc8f7359b9 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:18:41.159966 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-13f9a0f9-d2fc-4552-ae74-0c8c6540ccca tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "POST /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/action" status: 200 len: 28224 microversion: 2.1 time: 0.099504 Nov 01 01:18:41.161591 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 104/207] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Nov 1 01:18:41 2021] POST /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/action => generated 28224 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 01 01:18:41.281693 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-244fa566-f87f-4727-ad56-42fc8f7359b9 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887cfd0993f448faafa95b4543bf5085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a22541a330f4071a6c2100f2dc47e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:18:41.290071 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-244fa566-f87f-4727-ad56-42fc8f7359b9 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] 10.222.0.47 "GET /compute/v2.1/servers/908ea23f-8ec7-4bd2-83d4-676d4e252830" status: 200 len: 1314 microversion: 2.1 time: 0.160757 Nov 01 01:18:41.291221 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 104/208] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:18:41 2021] GET /compute/v2.1/servers/908ea23f-8ec7-4bd2-83d4-676d4e252830 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:18:42.172907 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-7c151899-21cf-4fcd-9d70-92bf05645f8a tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:18:42.173890 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-7c151899-21cf-4fcd-9d70-92bf05645f8a tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:18:42.180582 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-7c151899-21cf-4fcd-9d70-92bf05645f8a tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:18:42.181014 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-7c151899-21cf-4fcd-9d70-92bf05645f8a tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:18:42.181806 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-7c151899-21cf-4fcd-9d70-92bf05645f8a tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:18:42.182228 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-7c151899-21cf-4fcd-9d70-92bf05645f8a tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:18:42.268857 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-7c151899-21cf-4fcd-9d70-92bf05645f8a tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "POST /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/action" status: 200 len: 28224 microversion: 2.1 time: 0.100218 Nov 01 01:18:42.273100 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 105/209] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Nov 1 01:18:42 2021] POST /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/action => generated 28224 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 01 01:18:42.316246 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-4c6fba75-be1b-4ee7-bbf4-dbca0e68229f tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:18:42.316836 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-4c6fba75-be1b-4ee7-bbf4-dbca0e68229f tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] [instance: 908ea23f-8ec7-4bd2-83d4-676d4e252830] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:18:42.333809 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4c6fba75-be1b-4ee7-bbf4-dbca0e68229f tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:18:42.334457 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4c6fba75-be1b-4ee7-bbf4-dbca0e68229f tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:18:42.335409 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4c6fba75-be1b-4ee7-bbf4-dbca0e68229f tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:18:42.335989 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4c6fba75-be1b-4ee7-bbf4-dbca0e68229f tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:18:42.624983 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-4c6fba75-be1b-4ee7-bbf4-dbca0e68229f tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887cfd0993f448faafa95b4543bf5085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a22541a330f4071a6c2100f2dc47e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:18:42.631341 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-4c6fba75-be1b-4ee7-bbf4-dbca0e68229f tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] 10.222.0.47 "GET /compute/v2.1/servers/908ea23f-8ec7-4bd2-83d4-676d4e252830" status: 200 len: 1314 microversion: 2.1 time: 0.319253 Nov 01 01:18:42.631918 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 105/210] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:18:42 2021] GET /compute/v2.1/servers/908ea23f-8ec7-4bd2-83d4-676d4e252830 => generated 1314 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:18:43.281609 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-e8a713e9-f58c-4658-83b4-2fd40606dfb1 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:18:43.283456 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-e8a713e9-f58c-4658-83b4-2fd40606dfb1 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:18:43.290557 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e8a713e9-f58c-4658-83b4-2fd40606dfb1 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:18:43.291001 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e8a713e9-f58c-4658-83b4-2fd40606dfb1 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:18:43.291860 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e8a713e9-f58c-4658-83b4-2fd40606dfb1 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:18:43.292192 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e8a713e9-f58c-4658-83b4-2fd40606dfb1 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:18:43.382849 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-e8a713e9-f58c-4658-83b4-2fd40606dfb1 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "POST /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/action" status: 200 len: 28224 microversion: 2.1 time: 0.105188 Nov 01 01:18:43.384201 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 106/211] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Nov 1 01:18:43 2021] POST /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/action => generated 28224 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 01 01:18:43.647836 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-b3c3b489-56eb-4fef-a426-5f1cbc420e4f tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:18:43.649055 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-b3c3b489-56eb-4fef-a426-5f1cbc420e4f tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] [instance: 908ea23f-8ec7-4bd2-83d4-676d4e252830] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:18:43.661255 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b3c3b489-56eb-4fef-a426-5f1cbc420e4f tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:18:43.661673 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b3c3b489-56eb-4fef-a426-5f1cbc420e4f tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:18:43.665304 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b3c3b489-56eb-4fef-a426-5f1cbc420e4f tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:18:43.670752 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b3c3b489-56eb-4fef-a426-5f1cbc420e4f tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:18:43.839171 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-b3c3b489-56eb-4fef-a426-5f1cbc420e4f tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887cfd0993f448faafa95b4543bf5085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a22541a330f4071a6c2100f2dc47e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:18:43.847005 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-b3c3b489-56eb-4fef-a426-5f1cbc420e4f tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] 10.222.0.47 "GET /compute/v2.1/servers/908ea23f-8ec7-4bd2-83d4-676d4e252830" status: 200 len: 1314 microversion: 2.1 time: 0.203262 Nov 01 01:18:43.847559 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 106/212] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:18:43 2021] GET /compute/v2.1/servers/908ea23f-8ec7-4bd2-83d4-676d4e252830 => generated 1314 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:18:44.408758 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-380c75c2-1917-401e-93c6-2d635ea27ce8 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:18:44.417491 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-380c75c2-1917-401e-93c6-2d635ea27ce8 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:18:44.424856 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-380c75c2-1917-401e-93c6-2d635ea27ce8 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:18:44.425884 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-1fd486b5-f93c-44b5-8389-c0d5f3559134 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:18:44.426019 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-380c75c2-1917-401e-93c6-2d635ea27ce8 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:18:44.426800 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-1fd486b5-f93c-44b5-8389-c0d5f3559134 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] [instance: 09733ccb-dd41-48bf-bf48-eafba2dfc208] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:18:44.426944 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-380c75c2-1917-401e-93c6-2d635ea27ce8 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:18:44.427323 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-380c75c2-1917-401e-93c6-2d635ea27ce8 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:18:44.434255 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1fd486b5-f93c-44b5-8389-c0d5f3559134 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:18:44.434928 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1fd486b5-f93c-44b5-8389-c0d5f3559134 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:18:44.435721 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1fd486b5-f93c-44b5-8389-c0d5f3559134 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:18:44.436140 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1fd486b5-f93c-44b5-8389-c0d5f3559134 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:18:44.449633 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.wsgi [None req-1fd486b5-f93c-44b5-8389-c0d5f3559134 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] HTTP exception thrown: Instance 09733ccb-dd41-48bf-bf48-eafba2dfc208 could not be found. Nov 01 01:18:44.450217 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-1fd486b5-f93c-44b5-8389-c0d5f3559134 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Returning 404 to user: Instance 09733ccb-dd41-48bf-bf48-eafba2dfc208 could not be found. {{(pid=116266) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 01 01:18:44.451054 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-1fd486b5-f93c-44b5-8389-c0d5f3559134 tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] 10.222.0.47 "DELETE /compute/v2.1/servers/09733ccb-dd41-48bf-bf48-eafba2dfc208" status: 404 len: 111 microversion: 2.1 time: 0.032413 Nov 01 01:18:44.451594 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 107/213] 10.222.0.47 () {58 vars in 1238 bytes} [Mon Nov 1 01:18:44 2021] DELETE /compute/v2.1/servers/09733ccb-dd41-48bf-bf48-eafba2dfc208 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 01:18:44.462194 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-7ed630a2-4c43-432c-b35a-cf0e24136dde tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:18:44.462820 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-7ed630a2-4c43-432c-b35a-cf0e24136dde tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] [instance: 09733ccb-dd41-48bf-bf48-eafba2dfc208] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:18:44.469282 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7ed630a2-4c43-432c-b35a-cf0e24136dde tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:18:44.469720 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7ed630a2-4c43-432c-b35a-cf0e24136dde tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:18:44.470515 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7ed630a2-4c43-432c-b35a-cf0e24136dde tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:18:44.470933 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7ed630a2-4c43-432c-b35a-cf0e24136dde tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:18:44.483531 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.wsgi [None req-7ed630a2-4c43-432c-b35a-cf0e24136dde tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] HTTP exception thrown: Instance 09733ccb-dd41-48bf-bf48-eafba2dfc208 could not be found. Nov 01 01:18:44.484219 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-7ed630a2-4c43-432c-b35a-cf0e24136dde tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] Returning 404 to user: Instance 09733ccb-dd41-48bf-bf48-eafba2dfc208 could not be found. {{(pid=116266) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 01 01:18:44.485012 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-7ed630a2-4c43-432c-b35a-cf0e24136dde tempest-DeleteServersTestJSON-554714651 tempest-DeleteServersTestJSON-554714651-project] 10.222.0.47 "GET /compute/v2.1/servers/09733ccb-dd41-48bf-bf48-eafba2dfc208" status: 404 len: 111 microversion: 2.1 time: 0.026622 Nov 01 01:18:44.485508 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 108/214] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:18:44 2021] GET /compute/v2.1/servers/09733ccb-dd41-48bf-bf48-eafba2dfc208 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 01:18:44.517668 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-380c75c2-1917-401e-93c6-2d635ea27ce8 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "POST /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/action" status: 200 len: 28224 microversion: 2.1 time: 0.125059 Nov 01 01:18:44.521513 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 107/215] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Nov 1 01:18:44 2021] POST /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/action => generated 28224 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 01 01:18:44.863757 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-457d6cea-a3ea-42cf-93aa-4714ef38da20 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:18:44.865982 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-457d6cea-a3ea-42cf-93aa-4714ef38da20 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] [instance: 908ea23f-8ec7-4bd2-83d4-676d4e252830] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:18:44.872108 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-457d6cea-a3ea-42cf-93aa-4714ef38da20 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:18:44.872473 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-457d6cea-a3ea-42cf-93aa-4714ef38da20 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:18:44.875311 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-457d6cea-a3ea-42cf-93aa-4714ef38da20 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:18:44.875748 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-457d6cea-a3ea-42cf-93aa-4714ef38da20 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:18:45.013416 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-457d6cea-a3ea-42cf-93aa-4714ef38da20 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887cfd0993f448faafa95b4543bf5085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a22541a330f4071a6c2100f2dc47e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:18:45.023083 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-457d6cea-a3ea-42cf-93aa-4714ef38da20 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] 10.222.0.47 "GET /compute/v2.1/servers/908ea23f-8ec7-4bd2-83d4-676d4e252830" status: 200 len: 1314 microversion: 2.1 time: 0.162817 Nov 01 01:18:45.026604 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 109/216] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:18:44 2021] GET /compute/v2.1/servers/908ea23f-8ec7-4bd2-83d4-676d4e252830 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:18:45.529776 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-05afeca5-f686-4c95-a123-7f21844e3fe2 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:18:45.531449 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-05afeca5-f686-4c95-a123-7f21844e3fe2 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:18:45.538733 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-05afeca5-f686-4c95-a123-7f21844e3fe2 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:18:45.539318 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-05afeca5-f686-4c95-a123-7f21844e3fe2 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:18:45.540051 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-05afeca5-f686-4c95-a123-7f21844e3fe2 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:18:45.540476 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-05afeca5-f686-4c95-a123-7f21844e3fe2 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:18:46.041392 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-d550073c-9002-4dd7-9ec9-092645bf5081 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:18:46.041987 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-d550073c-9002-4dd7-9ec9-092645bf5081 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] [instance: 908ea23f-8ec7-4bd2-83d4-676d4e252830] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:18:46.048478 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d550073c-9002-4dd7-9ec9-092645bf5081 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:18:46.048946 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d550073c-9002-4dd7-9ec9-092645bf5081 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:18:46.049758 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d550073c-9002-4dd7-9ec9-092645bf5081 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:18:46.050184 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d550073c-9002-4dd7-9ec9-092645bf5081 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:18:46.179253 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-d550073c-9002-4dd7-9ec9-092645bf5081 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887cfd0993f448faafa95b4543bf5085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a22541a330f4071a6c2100f2dc47e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:18:46.186359 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-d550073c-9002-4dd7-9ec9-092645bf5081 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] 10.222.0.47 "GET /compute/v2.1/servers/908ea23f-8ec7-4bd2-83d4-676d4e252830" status: 200 len: 1314 microversion: 2.1 time: 0.148554 Nov 01 01:18:46.186947 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 110/217] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:18:46 2021] GET /compute/v2.1/servers/908ea23f-8ec7-4bd2-83d4-676d4e252830 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:18:47.202560 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-8d54d074-ec8b-45aa-97db-dd589699f88d tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:18:47.203269 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-8d54d074-ec8b-45aa-97db-dd589699f88d tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] [instance: 908ea23f-8ec7-4bd2-83d4-676d4e252830] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:18:47.209380 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8d54d074-ec8b-45aa-97db-dd589699f88d tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:18:47.209823 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8d54d074-ec8b-45aa-97db-dd589699f88d tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:18:47.210607 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8d54d074-ec8b-45aa-97db-dd589699f88d tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:18:47.211203 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8d54d074-ec8b-45aa-97db-dd589699f88d tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:18:47.337706 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-8d54d074-ec8b-45aa-97db-dd589699f88d tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887cfd0993f448faafa95b4543bf5085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a22541a330f4071a6c2100f2dc47e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:18:47.370145 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-8d54d074-ec8b-45aa-97db-dd589699f88d tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] 10.222.0.47 "GET /compute/v2.1/servers/908ea23f-8ec7-4bd2-83d4-676d4e252830" status: 200 len: 1314 microversion: 2.1 time: 0.170903 Nov 01 01:18:47.371394 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 111/218] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:18:47 2021] GET /compute/v2.1/servers/908ea23f-8ec7-4bd2-83d4-676d4e252830 => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:18:48.388304 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-261833af-c8e8-4560-8434-dbccc73f3e9c tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:18:48.392019 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-261833af-c8e8-4560-8434-dbccc73f3e9c tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] [instance: 908ea23f-8ec7-4bd2-83d4-676d4e252830] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:18:48.394897 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-261833af-c8e8-4560-8434-dbccc73f3e9c tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:18:48.395333 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-261833af-c8e8-4560-8434-dbccc73f3e9c tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:18:48.396087 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-261833af-c8e8-4560-8434-dbccc73f3e9c tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:18:48.396509 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-261833af-c8e8-4560-8434-dbccc73f3e9c tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:18:48.599015 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-261833af-c8e8-4560-8434-dbccc73f3e9c tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887cfd0993f448faafa95b4543bf5085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a22541a330f4071a6c2100f2dc47e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:18:48.606987 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-261833af-c8e8-4560-8434-dbccc73f3e9c tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] 10.222.0.47 "GET /compute/v2.1/servers/908ea23f-8ec7-4bd2-83d4-676d4e252830" status: 200 len: 1314 microversion: 2.1 time: 0.222388 Nov 01 01:18:48.611744 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 112/219] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:18:48 2021] GET /compute/v2.1/servers/908ea23f-8ec7-4bd2-83d4-676d4e252830 => generated 1314 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:18:48.941886 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-05afeca5-f686-4c95-a123-7f21844e3fe2 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "POST /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/action" status: 200 len: 28224 microversion: 2.1 time: 3.416019 Nov 01 01:18:48.942544 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 108/220] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Nov 1 01:18:45 2021] POST /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/action => generated 28224 bytes in 3418 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 01 01:18:49.626217 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-cc54d279-fdd5-467b-a54d-6d78eaa4ac28 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:18:49.626978 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-cc54d279-fdd5-467b-a54d-6d78eaa4ac28 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] [instance: 908ea23f-8ec7-4bd2-83d4-676d4e252830] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:18:49.633737 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-cc54d279-fdd5-467b-a54d-6d78eaa4ac28 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:18:49.634627 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-cc54d279-fdd5-467b-a54d-6d78eaa4ac28 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:18:49.635533 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-cc54d279-fdd5-467b-a54d-6d78eaa4ac28 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:18:49.636208 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-cc54d279-fdd5-467b-a54d-6d78eaa4ac28 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:18:49.777489 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-cc54d279-fdd5-467b-a54d-6d78eaa4ac28 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887cfd0993f448faafa95b4543bf5085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a22541a330f4071a6c2100f2dc47e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:18:49.785447 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-cc54d279-fdd5-467b-a54d-6d78eaa4ac28 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] 10.222.0.47 "GET /compute/v2.1/servers/908ea23f-8ec7-4bd2-83d4-676d4e252830" status: 200 len: 1314 microversion: 2.1 time: 0.163296 Nov 01 01:18:49.786013 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 113/221] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:18:49 2021] GET /compute/v2.1/servers/908ea23f-8ec7-4bd2-83d4-676d4e252830 => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:18:49.956316 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-be360d82-bafe-4814-a9ff-472124b395b3 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:18:49.958443 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-be360d82-bafe-4814-a9ff-472124b395b3 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:18:49.966772 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-be360d82-bafe-4814-a9ff-472124b395b3 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:18:49.967220 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-be360d82-bafe-4814-a9ff-472124b395b3 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:18:49.968591 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-be360d82-bafe-4814-a9ff-472124b395b3 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:18:49.969027 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-be360d82-bafe-4814-a9ff-472124b395b3 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:18:50.805732 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-115da9ec-7cfc-4ada-8684-fb46eee218ef tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:18:50.805732 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-115da9ec-7cfc-4ada-8684-fb46eee218ef tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] [instance: 908ea23f-8ec7-4bd2-83d4-676d4e252830] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:18:50.812227 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-115da9ec-7cfc-4ada-8684-fb46eee218ef tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:18:50.812782 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-115da9ec-7cfc-4ada-8684-fb46eee218ef tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:18:50.813562 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-115da9ec-7cfc-4ada-8684-fb46eee218ef tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:18:50.813985 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-115da9ec-7cfc-4ada-8684-fb46eee218ef tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:18:51.258166 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-115da9ec-7cfc-4ada-8684-fb46eee218ef tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887cfd0993f448faafa95b4543bf5085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a22541a330f4071a6c2100f2dc47e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:18:51.265612 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-115da9ec-7cfc-4ada-8684-fb46eee218ef tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] 10.222.0.47 "GET /compute/v2.1/servers/908ea23f-8ec7-4bd2-83d4-676d4e252830" status: 200 len: 1314 microversion: 2.1 time: 0.466594 Nov 01 01:18:51.266269 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 114/222] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:18:50 2021] GET /compute/v2.1/servers/908ea23f-8ec7-4bd2-83d4-676d4e252830 => generated 1314 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:18:52.281792 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-e65586de-23cd-4ef6-b77d-9b129a5a3743 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:18:52.282481 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-e65586de-23cd-4ef6-b77d-9b129a5a3743 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] [instance: 908ea23f-8ec7-4bd2-83d4-676d4e252830] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:18:52.288838 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e65586de-23cd-4ef6-b77d-9b129a5a3743 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:18:52.289276 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e65586de-23cd-4ef6-b77d-9b129a5a3743 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:18:52.290149 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e65586de-23cd-4ef6-b77d-9b129a5a3743 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:18:52.290621 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e65586de-23cd-4ef6-b77d-9b129a5a3743 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:18:52.437048 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-e65586de-23cd-4ef6-b77d-9b129a5a3743 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887cfd0993f448faafa95b4543bf5085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a22541a330f4071a6c2100f2dc47e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:18:52.444109 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-e65586de-23cd-4ef6-b77d-9b129a5a3743 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] 10.222.0.47 "GET /compute/v2.1/servers/908ea23f-8ec7-4bd2-83d4-676d4e252830" status: 200 len: 1314 microversion: 2.1 time: 0.166045 Nov 01 01:18:52.444660 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 115/223] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:18:52 2021] GET /compute/v2.1/servers/908ea23f-8ec7-4bd2-83d4-676d4e252830 => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:18:53.460786 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-28db92fa-78b0-4400-9a08-5a2c1f6d8827 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:18:53.461379 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-28db92fa-78b0-4400-9a08-5a2c1f6d8827 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] [instance: 908ea23f-8ec7-4bd2-83d4-676d4e252830] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:18:53.467418 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-28db92fa-78b0-4400-9a08-5a2c1f6d8827 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:18:53.468822 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-28db92fa-78b0-4400-9a08-5a2c1f6d8827 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:18:53.469571 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-28db92fa-78b0-4400-9a08-5a2c1f6d8827 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:18:53.469962 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-28db92fa-78b0-4400-9a08-5a2c1f6d8827 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:18:53.582550 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-be360d82-bafe-4814-a9ff-472124b395b3 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "POST /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/action" status: 200 len: 28224 microversion: 2.1 time: 3.632500 Nov 01 01:18:53.585741 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 109/224] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Nov 1 01:18:49 2021] POST /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/action => generated 28224 bytes in 3635 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 01 01:18:53.671438 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-28db92fa-78b0-4400-9a08-5a2c1f6d8827 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887cfd0993f448faafa95b4543bf5085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a22541a330f4071a6c2100f2dc47e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:18:53.679175 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-28db92fa-78b0-4400-9a08-5a2c1f6d8827 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] 10.222.0.47 "GET /compute/v2.1/servers/908ea23f-8ec7-4bd2-83d4-676d4e252830" status: 200 len: 1314 microversion: 2.1 time: 0.221915 Nov 01 01:18:53.679953 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 116/225] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:18:53 2021] GET /compute/v2.1/servers/908ea23f-8ec7-4bd2-83d4-676d4e252830 => generated 1314 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:18:54.444074 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [req-f0c8537b-b1f2-4766-a0a5-1359ed0a8cfd req-cc2ecd9a-ce09-4b42-b566-6f4dd3dfefd3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "908ea23f-8ec7-4bd2-83d4-676d4e252830", "name": "network-vif-plugged", "status": "completed", "tag": "ecf12606-0353-4c44-bde9-6c1bfed6b6ca"}]} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:18:54.447226 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 01 01:18:54.447226 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: warnings.warn(msg) Nov 01 01:18:54.458267 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [req-f0c8537b-b1f2-4766-a0a5-1359ed0a8cfd req-cc2ecd9a-ce09-4b42-b566-6f4dd3dfefd3 service nova] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:18:54.458777 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [req-f0c8537b-b1f2-4766-a0a5-1359ed0a8cfd req-cc2ecd9a-ce09-4b42-b566-6f4dd3dfefd3 service nova] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:18:54.477535 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.compute.server_external_events [req-f0c8537b-b1f2-4766-a0a5-1359ed0a8cfd req-cc2ecd9a-ce09-4b42-b566-6f4dd3dfefd3 service nova] Creating event network-vif-plugged:ecf12606-0353-4c44-bde9-6c1bfed6b6ca for instance 908ea23f-8ec7-4bd2-83d4-676d4e252830 on hv-cinder-81561 Nov 01 01:18:54.482632 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [req-f0c8537b-b1f2-4766-a0a5-1359ed0a8cfd req-cc2ecd9a-ce09-4b42-b566-6f4dd3dfefd3 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043283 Nov 01 01:18:54.484088 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 110/226] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Nov 1 01:18:54 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:18:54.597295 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-beaf4592-9f01-4177-acc7-5536c259a6b3 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:18:54.598285 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-beaf4592-9f01-4177-acc7-5536c259a6b3 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:18:54.609655 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-beaf4592-9f01-4177-acc7-5536c259a6b3 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:18:54.610095 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-beaf4592-9f01-4177-acc7-5536c259a6b3 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:18:54.611290 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-beaf4592-9f01-4177-acc7-5536c259a6b3 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:18:54.611869 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-beaf4592-9f01-4177-acc7-5536c259a6b3 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:18:54.700984 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-7874e98e-5997-48f4-a024-285c5232d10e tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:18:54.700984 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-7874e98e-5997-48f4-a024-285c5232d10e tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] [instance: 908ea23f-8ec7-4bd2-83d4-676d4e252830] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:18:54.709022 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-7874e98e-5997-48f4-a024-285c5232d10e tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:18:54.709853 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-7874e98e-5997-48f4-a024-285c5232d10e tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:18:54.710817 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-7874e98e-5997-48f4-a024-285c5232d10e tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:18:54.711396 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-7874e98e-5997-48f4-a024-285c5232d10e tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:18:54.711897 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-beaf4592-9f01-4177-acc7-5536c259a6b3 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "POST /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/action" status: 200 len: 28224 microversion: 2.1 time: 0.119129 Nov 01 01:18:54.717031 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 117/227] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Nov 1 01:18:54 2021] POST /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/action => generated 28224 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 01 01:18:55.022106 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-7874e98e-5997-48f4-a024-285c5232d10e tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887cfd0993f448faafa95b4543bf5085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a22541a330f4071a6c2100f2dc47e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:18:55.052729 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-7874e98e-5997-48f4-a024-285c5232d10e tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] 10.222.0.47 "GET /compute/v2.1/servers/908ea23f-8ec7-4bd2-83d4-676d4e252830" status: 200 len: 1314 microversion: 2.1 time: 0.359664 Nov 01 01:18:55.067488 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 111/228] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:18:54 2021] GET /compute/v2.1/servers/908ea23f-8ec7-4bd2-83d4-676d4e252830 => generated 1314 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:18:55.630590 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-f72d07fe-4d06-409c-b3cb-fbca5e9835c3 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1152059756", "imageRef": "b9068d8d-b02d-4043-9f0c-3d774cb372b3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "cf9038d3-b8b5-4db0-bd72-c2eb66e7ce19"}]}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:18:55.683398 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.network.neutron [None req-f72d07fe-4d06-409c-b3cb-fbca5e9835c3 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] validate_networks() for [('cf9038d3-b8b5-4db0-bd72-c2eb66e7ce19', None, None, None, None, None)] {{(pid=116266) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Nov 01 01:18:55.724410 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-ffd96238-4d07-41b1-a141-e98135710117 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:18:55.725435 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-ffd96238-4d07-41b1-a141-e98135710117 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:18:55.732687 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ffd96238-4d07-41b1-a141-e98135710117 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:18:55.733272 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ffd96238-4d07-41b1-a141-e98135710117 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:18:55.734136 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ffd96238-4d07-41b1-a141-e98135710117 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:18:55.734802 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ffd96238-4d07-41b1-a141-e98135710117 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:18:55.865652 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-ffd96238-4d07-41b1-a141-e98135710117 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "POST /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/action" status: 200 len: 28224 microversion: 2.1 time: 0.144090 Nov 01 01:18:55.871579 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 112/229] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Nov 1 01:18:55 2021] POST /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/action => generated 28224 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 01 01:18:56.070118 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-aeeed534-9e5c-41c6-a522-0a9849442268 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:18:56.071055 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-aeeed534-9e5c-41c6-a522-0a9849442268 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] [instance: 908ea23f-8ec7-4bd2-83d4-676d4e252830] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:18:56.093289 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-aeeed534-9e5c-41c6-a522-0a9849442268 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:18:56.095013 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-aeeed534-9e5c-41c6-a522-0a9849442268 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:18:56.100984 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-aeeed534-9e5c-41c6-a522-0a9849442268 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:18:56.101781 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-aeeed534-9e5c-41c6-a522-0a9849442268 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:18:56.132905 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.virt.hardware [None req-f72d07fe-4d06-409c-b3cb-fbca5e9835c3 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Flavor limits 0:0:0 {{(pid=116266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 01 01:18:56.133853 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.virt.hardware [None req-f72d07fe-4d06-409c-b3cb-fbca5e9835c3 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Image limits 0:0:0 {{(pid=116266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 01 01:18:56.134457 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.virt.hardware [None req-f72d07fe-4d06-409c-b3cb-fbca5e9835c3 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Flavor pref 0:0:0 {{(pid=116266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 01 01:18:56.135002 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.virt.hardware [None req-f72d07fe-4d06-409c-b3cb-fbca5e9835c3 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Image pref 0:0:0 {{(pid=116266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 01 01:18:56.135504 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.virt.hardware [None req-f72d07fe-4d06-409c-b3cb-fbca5e9835c3 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 01 01:18:56.145593 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f72d07fe-4d06-409c-b3cb-fbca5e9835c3 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:18:56.146151 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f72d07fe-4d06-409c-b3cb-fbca5e9835c3 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:18:56.147095 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f72d07fe-4d06-409c-b3cb-fbca5e9835c3 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:18:56.147631 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f72d07fe-4d06-409c-b3cb-fbca5e9835c3 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:18:56.167777 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.quota [None req-f72d07fe-4d06-409c-b3cb-fbca5e9835c3 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Getting quotas for project 3834c4e78a0d45ac88f2ad9e4c7a8111. Resources: {'instances', 'cores', 'ram'} {{(pid=116266) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 01 01:18:56.175808 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.quota [None req-f72d07fe-4d06-409c-b3cb-fbca5e9835c3 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Getting quotas for user 7a505f0e83744cbd9cb8dadcbfdb7de8 and project 3834c4e78a0d45ac88f2ad9e4c7a8111. Resources: {'instances', 'cores', 'ram'} {{(pid=116266) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 01 01:18:56.192191 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-f72d07fe-4d06-409c-b3cb-fbca5e9835c3 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Going to run 1 instances... {{(pid=116266) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 01 01:18:56.195239 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-f72d07fe-4d06-409c-b3cb-fbca5e9835c3 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b9068d8d-b02d-4043-9f0c-3d774cb372b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116266) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 01 01:18:56.257930 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-aeeed534-9e5c-41c6-a522-0a9849442268 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887cfd0993f448faafa95b4543bf5085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a22541a330f4071a6c2100f2dc47e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:18:56.265970 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-aeeed534-9e5c-41c6-a522-0a9849442268 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] 10.222.0.47 "GET /compute/v2.1/servers/908ea23f-8ec7-4bd2-83d4-676d4e252830" status: 200 len: 1314 microversion: 2.1 time: 0.200696 Nov 01 01:18:56.266686 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 113/230] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:18:56 2021] GET /compute/v2.1/servers/908ea23f-8ec7-4bd2-83d4-676d4e252830 => generated 1314 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:18:56.385919 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-f72d07fe-4d06-409c-b3cb-fbca5e9835c3 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.876831 Nov 01 01:18:56.392572 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 118/231] 10.222.0.47 () {60 vars in 1146 bytes} [Mon Nov 1 01:18:55 2021] POST /compute/v2.1/servers => generated 383 bytes in 882 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 01 01:18:56.396926 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-c7b1256c-2aeb-42af-b4a4-157bd0eab630 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:18:56.397544 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-c7b1256c-2aeb-42af-b4a4-157bd0eab630 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:18:56.471390 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-c7b1256c-2aeb-42af-b4a4-157bd0eab630 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:18:56.478769 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-c7b1256c-2aeb-42af-b4a4-157bd0eab630 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1222 microversion: 2.1 time: 0.085357 Nov 01 01:18:56.479832 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 114/232] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:18:56 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1222 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:18:56.682014 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-4486cab0-1583-4dec-bad6-ee2c4a4aad44 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-178172122", "imageRef": "b9068d8d-b02d-4043-9f0c-3d774cb372b3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "cf9038d3-b8b5-4db0-bd72-c2eb66e7ce19"}]}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:18:56.749758 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.network.neutron [None req-4486cab0-1583-4dec-bad6-ee2c4a4aad44 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] validate_networks() for [('cf9038d3-b8b5-4db0-bd72-c2eb66e7ce19', None, None, None, None, None)] {{(pid=116266) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Nov 01 01:18:56.878122 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-4b42a961-24f6-4fd7-a2f6-53872cbef66d tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:18:56.879658 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-4b42a961-24f6-4fd7-a2f6-53872cbef66d tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:18:56.899774 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4b42a961-24f6-4fd7-a2f6-53872cbef66d tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:18:56.900218 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4b42a961-24f6-4fd7-a2f6-53872cbef66d tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:18:56.901176 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4b42a961-24f6-4fd7-a2f6-53872cbef66d tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:18:56.901891 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4b42a961-24f6-4fd7-a2f6-53872cbef66d tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:18:57.024179 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-4b42a961-24f6-4fd7-a2f6-53872cbef66d tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "POST /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/action" status: 200 len: 28224 microversion: 2.1 time: 0.149577 Nov 01 01:18:57.028305 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 115/233] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Nov 1 01:18:56 2021] POST /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/action => generated 28224 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 01 01:18:57.146551 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.virt.hardware [None req-4486cab0-1583-4dec-bad6-ee2c4a4aad44 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Flavor limits 0:0:0 {{(pid=116266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 01 01:18:57.146996 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.virt.hardware [None req-4486cab0-1583-4dec-bad6-ee2c4a4aad44 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Image limits 0:0:0 {{(pid=116266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 01 01:18:57.147465 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.virt.hardware [None req-4486cab0-1583-4dec-bad6-ee2c4a4aad44 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Flavor pref 0:0:0 {{(pid=116266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 01 01:18:57.147866 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.virt.hardware [None req-4486cab0-1583-4dec-bad6-ee2c4a4aad44 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Image pref 0:0:0 {{(pid=116266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 01 01:18:57.148277 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.virt.hardware [None req-4486cab0-1583-4dec-bad6-ee2c4a4aad44 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 01 01:18:57.161836 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4486cab0-1583-4dec-bad6-ee2c4a4aad44 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:18:57.162264 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4486cab0-1583-4dec-bad6-ee2c4a4aad44 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:18:57.163692 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4486cab0-1583-4dec-bad6-ee2c4a4aad44 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:18:57.164332 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4486cab0-1583-4dec-bad6-ee2c4a4aad44 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:18:57.181715 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.quota [None req-4486cab0-1583-4dec-bad6-ee2c4a4aad44 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Getting quotas for project 3834c4e78a0d45ac88f2ad9e4c7a8111. Resources: {'instances', 'cores', 'ram'} {{(pid=116266) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 01 01:18:57.185763 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.quota [None req-4486cab0-1583-4dec-bad6-ee2c4a4aad44 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Getting quotas for user 7a505f0e83744cbd9cb8dadcbfdb7de8 and project 3834c4e78a0d45ac88f2ad9e4c7a8111. Resources: {'instances', 'cores', 'ram'} {{(pid=116266) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 01 01:18:57.199936 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-4486cab0-1583-4dec-bad6-ee2c4a4aad44 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Going to run 1 instances... {{(pid=116266) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 01 01:18:57.203314 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-4486cab0-1583-4dec-bad6-ee2c4a4aad44 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: 5c06a09a-23e3-468c-9a18-d40bd3785c9d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b9068d8d-b02d-4043-9f0c-3d774cb372b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116266) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 01 01:18:57.283133 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-aa430415-879e-4fa1-893e-19abbf4555f2 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:18:57.284071 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-aa430415-879e-4fa1-893e-19abbf4555f2 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] [instance: 908ea23f-8ec7-4bd2-83d4-676d4e252830] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:18:57.293167 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-aa430415-879e-4fa1-893e-19abbf4555f2 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:18:57.294187 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-aa430415-879e-4fa1-893e-19abbf4555f2 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:18:57.295535 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-aa430415-879e-4fa1-893e-19abbf4555f2 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:18:57.297107 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-aa430415-879e-4fa1-893e-19abbf4555f2 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:18:57.452572 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-aa430415-879e-4fa1-893e-19abbf4555f2 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887cfd0993f448faafa95b4543bf5085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a22541a330f4071a6c2100f2dc47e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:18:57.459346 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-aa430415-879e-4fa1-893e-19abbf4555f2 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] 10.222.0.47 "GET /compute/v2.1/servers/908ea23f-8ec7-4bd2-83d4-676d4e252830" status: 200 len: 1498 microversion: 2.1 time: 0.180754 Nov 01 01:18:57.459911 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 116/234] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:18:57 2021] GET /compute/v2.1/servers/908ea23f-8ec7-4bd2-83d4-676d4e252830 => generated 1498 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:18:57.511332 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-4486cab0-1583-4dec-bad6-ee2c4a4aad44 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.833846 Nov 01 01:18:57.512283 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 119/235] 10.222.0.47 () {60 vars in 1146 bytes} [Mon Nov 1 01:18:56 2021] POST /compute/v2.1/servers => generated 383 bytes in 836 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 01 01:18:57.522976 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-b97f127a-964d-4ec2-9344-044c04126d5f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:18:57.523651 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-b97f127a-964d-4ec2-9344-044c04126d5f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: 5c06a09a-23e3-468c-9a18-d40bd3785c9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:18:57.617670 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-b97f127a-964d-4ec2-9344-044c04126d5f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:18:57.640205 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-b97f127a-964d-4ec2-9344-044c04126d5f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/5c06a09a-23e3-468c-9a18-d40bd3785c9d" status: 200 len: 1221 microversion: 2.1 time: 0.118057 Nov 01 01:18:57.641011 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 117/236] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:18:57 2021] GET /compute/v2.1/servers/5c06a09a-23e3-468c-9a18-d40bd3785c9d => generated 1221 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:18:58.038868 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-59232436-13f3-47d7-bc17-2c45e3036c75 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:18:58.040024 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-59232436-13f3-47d7-bc17-2c45e3036c75 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:18:58.059704 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-59232436-13f3-47d7-bc17-2c45e3036c75 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:18:58.067378 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-59232436-13f3-47d7-bc17-2c45e3036c75 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:18:58.067378 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-59232436-13f3-47d7-bc17-2c45e3036c75 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:18:58.067378 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-59232436-13f3-47d7-bc17-2c45e3036c75 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:18:58.168235 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-59232436-13f3-47d7-bc17-2c45e3036c75 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "POST /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/action" status: 200 len: 28224 microversion: 2.1 time: 0.132617 Nov 01 01:18:58.171704 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 120/237] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Nov 1 01:18:58 2021] POST /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/action => generated 28224 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 01 01:18:58.660071 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-b51f003e-eda6-46a3-8320-aa4db37b15d1 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:18:58.660884 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-b51f003e-eda6-46a3-8320-aa4db37b15d1 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: 5c06a09a-23e3-468c-9a18-d40bd3785c9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:18:58.775867 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-b51f003e-eda6-46a3-8320-aa4db37b15d1 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:18:58.788954 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-b51f003e-eda6-46a3-8320-aa4db37b15d1 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/5c06a09a-23e3-468c-9a18-d40bd3785c9d" status: 200 len: 1221 microversion: 2.1 time: 0.135582 Nov 01 01:18:58.791084 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 118/238] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:18:58 2021] GET /compute/v2.1/servers/5c06a09a-23e3-468c-9a18-d40bd3785c9d => generated 1221 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:18:58.871622 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-6afe1bbc-bfbb-413e-a72c-c98b9d21016c tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:18:58.872510 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-6afe1bbc-bfbb-413e-a72c-c98b9d21016c tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] [instance: 908ea23f-8ec7-4bd2-83d4-676d4e252830] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:18:58.886814 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6afe1bbc-bfbb-413e-a72c-c98b9d21016c tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:18:58.891798 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6afe1bbc-bfbb-413e-a72c-c98b9d21016c tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:18:58.905690 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6afe1bbc-bfbb-413e-a72c-c98b9d21016c tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:18:58.909820 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6afe1bbc-bfbb-413e-a72c-c98b9d21016c tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:18:59.003863 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-6afe1bbc-bfbb-413e-a72c-c98b9d21016c tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] [instance: 908ea23f-8ec7-4bd2-83d4-676d4e252830] Going to try to terminate instance {{(pid=116266) delete /opt/stack/nova/nova/compute/api.py:2612}} Nov 01 01:18:59.182713 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-56702020-f32b-4547-8cca-d8d87b23840d tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:18:59.184055 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-56702020-f32b-4547-8cca-d8d87b23840d tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:18:59.202632 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-56702020-f32b-4547-8cca-d8d87b23840d tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:18:59.203110 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-56702020-f32b-4547-8cca-d8d87b23840d tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:18:59.204039 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-56702020-f32b-4547-8cca-d8d87b23840d tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:18:59.204551 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-56702020-f32b-4547-8cca-d8d87b23840d tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:18:59.299566 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-56702020-f32b-4547-8cca-d8d87b23840d tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "POST /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/action" status: 200 len: 28224 microversion: 2.1 time: 0.122088 Nov 01 01:18:59.300386 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 119/239] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Nov 1 01:18:59 2021] POST /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/action => generated 28224 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 01 01:18:59.703647 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-6afe1bbc-bfbb-413e-a72c-c98b9d21016c tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] 10.222.0.47 "DELETE /compute/v2.1/servers/908ea23f-8ec7-4bd2-83d4-676d4e252830" status: 204 len: 0 microversion: 2.1 time: 0.836374 Nov 01 01:18:59.705277 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 121/240] 10.222.0.47 () {58 vars in 1238 bytes} [Mon Nov 1 01:18:58 2021] DELETE /compute/v2.1/servers/908ea23f-8ec7-4bd2-83d4-676d4e252830 => generated 0 bytes in 839 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 01 01:18:59.713108 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-3d266148-cf47-45b2-9154-2bcb5752332b tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:18:59.713832 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-3d266148-cf47-45b2-9154-2bcb5752332b tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] [instance: 908ea23f-8ec7-4bd2-83d4-676d4e252830] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:18:59.720718 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3d266148-cf47-45b2-9154-2bcb5752332b tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:18:59.721166 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3d266148-cf47-45b2-9154-2bcb5752332b tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:18:59.721920 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3d266148-cf47-45b2-9154-2bcb5752332b tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:18:59.722343 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3d266148-cf47-45b2-9154-2bcb5752332b tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:18:59.810492 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-909263d6-2f71-49d7-b72a-e290cb125506 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:18:59.811917 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-909263d6-2f71-49d7-b72a-e290cb125506 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: 5c06a09a-23e3-468c-9a18-d40bd3785c9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:18:59.819690 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-909263d6-2f71-49d7-b72a-e290cb125506 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:18:59.820730 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-909263d6-2f71-49d7-b72a-e290cb125506 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:18:59.821695 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-909263d6-2f71-49d7-b72a-e290cb125506 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:18:59.822216 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-909263d6-2f71-49d7-b72a-e290cb125506 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:18:59.928505 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-909263d6-2f71-49d7-b72a-e290cb125506 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:18:59.943447 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-909263d6-2f71-49d7-b72a-e290cb125506 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/5c06a09a-23e3-468c-9a18-d40bd3785c9d" status: 200 len: 1217 microversion: 2.1 time: 0.133009 Nov 01 01:18:59.943560 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-3d266148-cf47-45b2-9154-2bcb5752332b tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887cfd0993f448faafa95b4543bf5085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a22541a330f4071a6c2100f2dc47e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:18:59.950790 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 122/241] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:18:59 2021] GET /compute/v2.1/servers/5c06a09a-23e3-468c-9a18-d40bd3785c9d => generated 1217 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:18:59.956085 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-3d266148-cf47-45b2-9154-2bcb5752332b tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] 10.222.0.47 "GET /compute/v2.1/servers/908ea23f-8ec7-4bd2-83d4-676d4e252830" status: 200 len: 1504 microversion: 2.1 time: 0.246982 Nov 01 01:18:59.956693 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 120/242] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:18:59 2021] GET /compute/v2.1/servers/908ea23f-8ec7-4bd2-83d4-676d4e252830 => generated 1504 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:19:00.315225 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-671f6484-2a97-4845-95ca-9c2b7c2f46f9 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:19:00.317500 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-671f6484-2a97-4845-95ca-9c2b7c2f46f9 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:19:00.326515 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-671f6484-2a97-4845-95ca-9c2b7c2f46f9 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:00.328143 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-671f6484-2a97-4845-95ca-9c2b7c2f46f9 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:00.328952 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-671f6484-2a97-4845-95ca-9c2b7c2f46f9 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:00.329256 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-671f6484-2a97-4845-95ca-9c2b7c2f46f9 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:00.438898 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-671f6484-2a97-4845-95ca-9c2b7c2f46f9 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "POST /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/action" status: 200 len: 28515 microversion: 2.1 time: 0.127489 Nov 01 01:19:00.439640 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 123/243] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Nov 1 01:19:00 2021] POST /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/action => generated 28515 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 01 01:19:00.957607 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-6567c689-6065-4fd9-aef4-5711621f161c tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:19:00.958291 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-6567c689-6065-4fd9-aef4-5711621f161c tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: 5c06a09a-23e3-468c-9a18-d40bd3785c9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:19:00.974819 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-6567c689-6065-4fd9-aef4-5711621f161c tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:00.974819 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-6567c689-6065-4fd9-aef4-5711621f161c tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:00.974819 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-6567c689-6065-4fd9-aef4-5711621f161c tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:00.974819 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-6567c689-6065-4fd9-aef4-5711621f161c tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:00.976366 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-a579b3ae-9b06-4967-9fcb-b1f6aab559f3 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:19:00.977181 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-a579b3ae-9b06-4967-9fcb-b1f6aab559f3 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] [instance: 908ea23f-8ec7-4bd2-83d4-676d4e252830] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:19:00.988978 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a579b3ae-9b06-4967-9fcb-b1f6aab559f3 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:00.989427 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a579b3ae-9b06-4967-9fcb-b1f6aab559f3 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:00.995562 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a579b3ae-9b06-4967-9fcb-b1f6aab559f3 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:00.996337 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a579b3ae-9b06-4967-9fcb-b1f6aab559f3 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:01.140367 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-6567c689-6065-4fd9-aef4-5711621f161c tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:19:01.149090 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-6567c689-6065-4fd9-aef4-5711621f161c tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/5c06a09a-23e3-468c-9a18-d40bd3785c9d" status: 200 len: 1273 microversion: 2.1 time: 0.195603 Nov 01 01:19:01.157368 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 121/244] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:19:00 2021] GET /compute/v2.1/servers/5c06a09a-23e3-468c-9a18-d40bd3785c9d => generated 1273 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:19:01.252809 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-a579b3ae-9b06-4967-9fcb-b1f6aab559f3 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887cfd0993f448faafa95b4543bf5085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a22541a330f4071a6c2100f2dc47e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:19:01.260590 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-a579b3ae-9b06-4967-9fcb-b1f6aab559f3 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] 10.222.0.47 "GET /compute/v2.1/servers/908ea23f-8ec7-4bd2-83d4-676d4e252830" status: 200 len: 1504 microversion: 2.1 time: 0.289716 Nov 01 01:19:01.261215 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 124/245] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:19:00 2021] GET /compute/v2.1/servers/908ea23f-8ec7-4bd2-83d4-676d4e252830 => generated 1504 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:19:01.449848 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-d3cbc18a-f2f3-4a57-a997-a138aad57c51 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:19:01.450808 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-d3cbc18a-f2f3-4a57-a997-a138aad57c51 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:19:01.456982 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d3cbc18a-f2f3-4a57-a997-a138aad57c51 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:01.457449 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d3cbc18a-f2f3-4a57-a997-a138aad57c51 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:01.458203 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d3cbc18a-f2f3-4a57-a997-a138aad57c51 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:01.458713 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d3cbc18a-f2f3-4a57-a997-a138aad57c51 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:01.662978 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-d3cbc18a-f2f3-4a57-a997-a138aad57c51 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "POST /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/action" status: 200 len: 28515 microversion: 2.1 time: 0.215079 Nov 01 01:19:01.667932 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 122/246] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Nov 1 01:19:01 2021] POST /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/action => generated 28515 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 01 01:19:02.164710 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-1531e0ac-f717-4a6f-bca9-eedb506ab629 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:19:02.165779 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-1531e0ac-f717-4a6f-bca9-eedb506ab629 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: 5c06a09a-23e3-468c-9a18-d40bd3785c9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:19:02.179608 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1531e0ac-f717-4a6f-bca9-eedb506ab629 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:02.179810 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1531e0ac-f717-4a6f-bca9-eedb506ab629 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:02.188538 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1531e0ac-f717-4a6f-bca9-eedb506ab629 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:02.188995 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1531e0ac-f717-4a6f-bca9-eedb506ab629 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:02.278514 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-5a2beb7b-4a50-49fe-9f50-b6916539091e tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:19:02.279210 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-5a2beb7b-4a50-49fe-9f50-b6916539091e tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] [instance: 908ea23f-8ec7-4bd2-83d4-676d4e252830] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:19:02.304246 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-5a2beb7b-4a50-49fe-9f50-b6916539091e tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:02.304704 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-5a2beb7b-4a50-49fe-9f50-b6916539091e tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:02.305499 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-5a2beb7b-4a50-49fe-9f50-b6916539091e tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:02.305925 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-5a2beb7b-4a50-49fe-9f50-b6916539091e tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:02.372813 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-1531e0ac-f717-4a6f-bca9-eedb506ab629 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:19:02.383673 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-1531e0ac-f717-4a6f-bca9-eedb506ab629 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/5c06a09a-23e3-468c-9a18-d40bd3785c9d" status: 200 len: 1279 microversion: 2.1 time: 0.222414 Nov 01 01:19:02.386036 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 125/247] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:19:02 2021] GET /compute/v2.1/servers/5c06a09a-23e3-468c-9a18-d40bd3785c9d => generated 1279 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:19:02.513336 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-5a2beb7b-4a50-49fe-9f50-b6916539091e tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887cfd0993f448faafa95b4543bf5085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a22541a330f4071a6c2100f2dc47e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:19:02.513336 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-5a2beb7b-4a50-49fe-9f50-b6916539091e tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] 10.222.0.47 "GET /compute/v2.1/servers/908ea23f-8ec7-4bd2-83d4-676d4e252830" status: 200 len: 1504 microversion: 2.1 time: 0.237045 Nov 01 01:19:02.513336 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 123/248] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:19:02 2021] GET /compute/v2.1/servers/908ea23f-8ec7-4bd2-83d4-676d4e252830 => generated 1504 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:19:02.674748 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-ca9e6380-bb0b-40df-a8f3-38092d7ab686 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:19:02.675669 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-ca9e6380-bb0b-40df-a8f3-38092d7ab686 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:19:02.694659 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ca9e6380-bb0b-40df-a8f3-38092d7ab686 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:02.698741 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ca9e6380-bb0b-40df-a8f3-38092d7ab686 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:02.708754 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ca9e6380-bb0b-40df-a8f3-38092d7ab686 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:02.709518 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ca9e6380-bb0b-40df-a8f3-38092d7ab686 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:02.849469 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-ca9e6380-bb0b-40df-a8f3-38092d7ab686 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "POST /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/action" status: 200 len: 28683 microversion: 2.1 time: 0.177934 Nov 01 01:19:02.853568 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 126/249] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Nov 1 01:19:02 2021] POST /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/action => generated 28683 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 01 01:19:03.265006 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [req-03565fba-e158-4d0a-ba15-1a059ba6e1d0 req-8fae356e-3c60-4f81-8ff0-dd69573d23cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "908ea23f-8ec7-4bd2-83d4-676d4e252830", "name": "network-vif-deleted", "tag": "ecf12606-0353-4c44-bde9-6c1bfed6b6ca"}]} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:19:03.266781 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 01 01:19:03.266781 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: warnings.warn(msg) Nov 01 01:19:03.274982 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [req-03565fba-e158-4d0a-ba15-1a059ba6e1d0 req-8fae356e-3c60-4f81-8ff0-dd69573d23cb service nova] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:03.275733 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [req-03565fba-e158-4d0a-ba15-1a059ba6e1d0 req-8fae356e-3c60-4f81-8ff0-dd69573d23cb service nova] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:03.289594 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.compute.server_external_events [req-03565fba-e158-4d0a-ba15-1a059ba6e1d0 req-8fae356e-3c60-4f81-8ff0-dd69573d23cb service nova] Creating event network-vif-deleted:ecf12606-0353-4c44-bde9-6c1bfed6b6ca for instance 908ea23f-8ec7-4bd2-83d4-676d4e252830 on hv-cinder-81561 Nov 01 01:19:03.296642 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [req-03565fba-e158-4d0a-ba15-1a059ba6e1d0 req-8fae356e-3c60-4f81-8ff0-dd69573d23cb service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034863 Nov 01 01:19:03.297770 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 124/250] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Nov 1 01:19:03 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:19:03.408245 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-99a5f126-91d8-4cab-b9b8-b593c7c18540 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:19:03.409025 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-99a5f126-91d8-4cab-b9b8-b593c7c18540 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: 5c06a09a-23e3-468c-9a18-d40bd3785c9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:19:03.415884 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-99a5f126-91d8-4cab-b9b8-b593c7c18540 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:03.416532 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-99a5f126-91d8-4cab-b9b8-b593c7c18540 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:03.417453 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-99a5f126-91d8-4cab-b9b8-b593c7c18540 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:03.418033 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-99a5f126-91d8-4cab-b9b8-b593c7c18540 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:03.529857 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-7c803502-9a5d-45ae-8798-d7b723bc4263 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:19:03.530795 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-7c803502-9a5d-45ae-8798-d7b723bc4263 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] [instance: 908ea23f-8ec7-4bd2-83d4-676d4e252830] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:19:03.562766 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-7c803502-9a5d-45ae-8798-d7b723bc4263 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:03.566936 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-7c803502-9a5d-45ae-8798-d7b723bc4263 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:03.568006 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-7c803502-9a5d-45ae-8798-d7b723bc4263 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:03.570601 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-7c803502-9a5d-45ae-8798-d7b723bc4263 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:03.672950 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-99a5f126-91d8-4cab-b9b8-b593c7c18540 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:19:03.681209 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-99a5f126-91d8-4cab-b9b8-b593c7c18540 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/5c06a09a-23e3-468c-9a18-d40bd3785c9d" status: 200 len: 1321 microversion: 2.1 time: 0.277300 Nov 01 01:19:03.682257 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 127/251] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:19:03 2021] GET /compute/v2.1/servers/5c06a09a-23e3-468c-9a18-d40bd3785c9d => generated 1321 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:19:03.687004 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [req-f94ea157-6d47-4a0c-806e-528b0cc97f9b req-32fe454a-a8e9-4d65-8abc-7b42d8c2edb5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f02098be-ed15-45a0-a599-941cb0e1eebb", "tag": "675c5b62-2b1b-4dd7-823c-c35403e383c1"}]} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:19:03.688929 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 01 01:19:03.688929 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: warnings.warn(msg) Nov 01 01:19:03.696738 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [req-f94ea157-6d47-4a0c-806e-528b0cc97f9b req-32fe454a-a8e9-4d65-8abc-7b42d8c2edb5 service nova] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:03.697262 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [req-f94ea157-6d47-4a0c-806e-528b0cc97f9b req-32fe454a-a8e9-4d65-8abc-7b42d8c2edb5 service nova] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:03.710406 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.compute.server_external_events [req-f94ea157-6d47-4a0c-806e-528b0cc97f9b req-32fe454a-a8e9-4d65-8abc-7b42d8c2edb5 service nova] Creating event network-changed:675c5b62-2b1b-4dd7-823c-c35403e383c1 for instance f02098be-ed15-45a0-a599-941cb0e1eebb on hv-cinder-81561 Nov 01 01:19:03.715933 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [req-f94ea157-6d47-4a0c-806e-528b0cc97f9b req-32fe454a-a8e9-4d65-8abc-7b42d8c2edb5 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032319 Nov 01 01:19:03.716496 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 128/252] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Nov 1 01:19:03 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:19:03.736575 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-7c803502-9a5d-45ae-8798-d7b723bc4263 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887cfd0993f448faafa95b4543bf5085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a22541a330f4071a6c2100f2dc47e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:19:03.746326 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-7c803502-9a5d-45ae-8798-d7b723bc4263 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] 10.222.0.47 "GET /compute/v2.1/servers/908ea23f-8ec7-4bd2-83d4-676d4e252830" status: 200 len: 1299 microversion: 2.1 time: 0.220982 Nov 01 01:19:03.746958 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 125/253] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:19:03 2021] GET /compute/v2.1/servers/908ea23f-8ec7-4bd2-83d4-676d4e252830 => generated 1299 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:19:03.869309 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-bbee1f06-9998-4a1a-a5fa-8b21c5fafcbf tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:19:03.869309 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-bbee1f06-9998-4a1a-a5fa-8b21c5fafcbf tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:19:03.877744 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-bbee1f06-9998-4a1a-a5fa-8b21c5fafcbf tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:03.891208 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-bbee1f06-9998-4a1a-a5fa-8b21c5fafcbf tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:03.891208 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-bbee1f06-9998-4a1a-a5fa-8b21c5fafcbf tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:03.891208 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-bbee1f06-9998-4a1a-a5fa-8b21c5fafcbf tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:04.008302 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-bbee1f06-9998-4a1a-a5fa-8b21c5fafcbf tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "POST /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/action" status: 200 len: 28683 microversion: 2.1 time: 0.149808 Nov 01 01:19:04.009456 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 129/254] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Nov 1 01:19:03 2021] POST /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/action => generated 28683 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 01 01:19:04.711854 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-813f2478-fd6b-4043-b1b0-9b6afed8dc81 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:19:04.711854 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-813f2478-fd6b-4043-b1b0-9b6afed8dc81 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: 5c06a09a-23e3-468c-9a18-d40bd3785c9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:19:04.718726 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-813f2478-fd6b-4043-b1b0-9b6afed8dc81 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:04.718726 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-813f2478-fd6b-4043-b1b0-9b6afed8dc81 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:04.719442 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-813f2478-fd6b-4043-b1b0-9b6afed8dc81 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:04.719865 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-813f2478-fd6b-4043-b1b0-9b6afed8dc81 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:04.764835 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-3d8fd06b-546e-4002-9639-7d1cb723e2dc tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:19:04.766260 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-3d8fd06b-546e-4002-9639-7d1cb723e2dc tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] [instance: 908ea23f-8ec7-4bd2-83d4-676d4e252830] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:19:04.785081 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3d8fd06b-546e-4002-9639-7d1cb723e2dc tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:04.785081 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3d8fd06b-546e-4002-9639-7d1cb723e2dc tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:04.785646 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3d8fd06b-546e-4002-9639-7d1cb723e2dc tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:04.786087 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3d8fd06b-546e-4002-9639-7d1cb723e2dc tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:04.827282 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3d8fd06b-546e-4002-9639-7d1cb723e2dc tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:04.827651 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3d8fd06b-546e-4002-9639-7d1cb723e2dc tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:04.828248 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.objects.instance [None req-3d8fd06b-546e-4002-9639-7d1cb723e2dc tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lazy-loading 'fault' on Instance uuid 908ea23f-8ec7-4bd2-83d4-676d4e252830 {{(pid=116266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 01 01:19:04.900969 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-3d8fd06b-546e-4002-9639-7d1cb723e2dc tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887cfd0993f448faafa95b4543bf5085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a22541a330f4071a6c2100f2dc47e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:19:04.910413 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-3d8fd06b-546e-4002-9639-7d1cb723e2dc tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] 10.222.0.47 "GET /compute/v2.1/servers/908ea23f-8ec7-4bd2-83d4-676d4e252830" status: 200 len: 1304 microversion: 2.1 time: 0.150885 Nov 01 01:19:04.911258 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 130/255] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:19:04 2021] GET /compute/v2.1/servers/908ea23f-8ec7-4bd2-83d4-676d4e252830 => generated 1304 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:19:05.023323 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-4a4558f6-468c-42db-a084-ca37a0c2e49b tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:19:05.024256 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-4a4558f6-468c-42db-a084-ca37a0c2e49b tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:19:05.031691 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4a4558f6-468c-42db-a084-ca37a0c2e49b tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:05.031691 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4a4558f6-468c-42db-a084-ca37a0c2e49b tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:05.033006 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4a4558f6-468c-42db-a084-ca37a0c2e49b tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:05.033006 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4a4558f6-468c-42db-a084-ca37a0c2e49b tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:05.147136 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-4a4558f6-468c-42db-a084-ca37a0c2e49b tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "POST /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/action" status: 200 len: 28683 microversion: 2.1 time: 0.127217 Nov 01 01:19:05.147788 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 131/256] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Nov 1 01:19:05 2021] POST /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/action => generated 28683 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 01 01:19:05.315027 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [req-b9e2415a-855e-48fb-b009-bf6d86e7ec41 req-63d64132-fcae-4ccf-a635-c20304d808c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c06a09a-23e3-468c-9a18-d40bd3785c9d", "tag": "c8a25e8a-7f87-4425-985e-192fc8e74209"}]} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:19:05.316676 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 01 01:19:05.316676 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: warnings.warn(msg) Nov 01 01:19:05.321766 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-813f2478-fd6b-4043-b1b0-9b6afed8dc81 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:19:05.324576 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [req-b9e2415a-855e-48fb-b009-bf6d86e7ec41 req-63d64132-fcae-4ccf-a635-c20304d808c4 service nova] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:05.325012 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [req-b9e2415a-855e-48fb-b009-bf6d86e7ec41 req-63d64132-fcae-4ccf-a635-c20304d808c4 service nova] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:05.329581 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-813f2478-fd6b-4043-b1b0-9b6afed8dc81 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/5c06a09a-23e3-468c-9a18-d40bd3785c9d" status: 200 len: 1321 microversion: 2.1 time: 0.628147 Nov 01 01:19:05.337755 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.compute.server_external_events [req-b9e2415a-855e-48fb-b009-bf6d86e7ec41 req-63d64132-fcae-4ccf-a635-c20304d808c4 service nova] Creating event network-changed:c8a25e8a-7f87-4425-985e-192fc8e74209 for instance 5c06a09a-23e3-468c-9a18-d40bd3785c9d on hv-cinder-81561 Nov 01 01:19:05.339573 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 126/257] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:19:04 2021] GET /compute/v2.1/servers/5c06a09a-23e3-468c-9a18-d40bd3785c9d => generated 1321 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:19:05.354721 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [req-b9e2415a-855e-48fb-b009-bf6d86e7ec41 req-63d64132-fcae-4ccf-a635-c20304d808c4 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039414 Nov 01 01:19:05.354721 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 132/258] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Nov 1 01:19:05 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 01 01:19:05.931271 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-4910efe6-ae71-4228-b352-043a16accd8e tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:19:05.931983 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-4910efe6-ae71-4228-b352-043a16accd8e tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] [instance: 908ea23f-8ec7-4bd2-83d4-676d4e252830] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:19:05.949300 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4910efe6-ae71-4228-b352-043a16accd8e tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:05.949859 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4910efe6-ae71-4228-b352-043a16accd8e tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:05.950768 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4910efe6-ae71-4228-b352-043a16accd8e tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:05.951436 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4910efe6-ae71-4228-b352-043a16accd8e tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:05.966363 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.wsgi [None req-4910efe6-ae71-4228-b352-043a16accd8e tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] HTTP exception thrown: Instance 908ea23f-8ec7-4bd2-83d4-676d4e252830 could not be found. Nov 01 01:19:05.967060 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-4910efe6-ae71-4228-b352-043a16accd8e tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Returning 404 to user: Instance 908ea23f-8ec7-4bd2-83d4-676d4e252830 could not be found. {{(pid=116267) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 01 01:19:05.967890 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-4910efe6-ae71-4228-b352-043a16accd8e tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] 10.222.0.47 "GET /compute/v2.1/servers/908ea23f-8ec7-4bd2-83d4-676d4e252830" status: 404 len: 111 microversion: 2.1 time: 0.040287 Nov 01 01:19:05.968420 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 127/259] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:19:05 2021] GET /compute/v2.1/servers/908ea23f-8ec7-4bd2-83d4-676d4e252830 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 01:19:06.079500 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-af93a5b5-dcc5-46fd-9596-5b2fbc587369 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1756090817", "imageRef": "b9068d8d-b02d-4043-9f0c-3d774cb372b3", "flavorRef": "452", "networks": [{"uuid": "f0dd56fe-eb79-4250-ac89-da394c190ab1"}]}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:19:06.151766 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.network.neutron [None req-af93a5b5-dcc5-46fd-9596-5b2fbc587369 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] validate_networks() for [('f0dd56fe-eb79-4250-ac89-da394c190ab1', None, None, None, None, None)] {{(pid=116266) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Nov 01 01:19:06.159695 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-d6be8f2b-26c8-4363-9071-8e9acc19394c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:19:06.160994 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-d6be8f2b-26c8-4363-9071-8e9acc19394c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:19:06.168154 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d6be8f2b-26c8-4363-9071-8e9acc19394c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:06.169373 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d6be8f2b-26c8-4363-9071-8e9acc19394c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:06.170572 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d6be8f2b-26c8-4363-9071-8e9acc19394c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:06.171163 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d6be8f2b-26c8-4363-9071-8e9acc19394c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:06.317455 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-d6be8f2b-26c8-4363-9071-8e9acc19394c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "POST /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/action" status: 200 len: 28683 microversion: 2.1 time: 0.162411 Nov 01 01:19:06.319392 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 128/260] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Nov 1 01:19:06 2021] POST /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/action => generated 28683 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 01 01:19:06.346910 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-632a7e28-88ae-426f-9670-a75a930740f6 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:19:06.347886 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-632a7e28-88ae-426f-9670-a75a930740f6 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: 5c06a09a-23e3-468c-9a18-d40bd3785c9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:19:06.355041 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-632a7e28-88ae-426f-9670-a75a930740f6 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:06.355755 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-632a7e28-88ae-426f-9670-a75a930740f6 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:06.356655 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-632a7e28-88ae-426f-9670-a75a930740f6 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:06.357469 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-632a7e28-88ae-426f-9670-a75a930740f6 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:06.579431 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-632a7e28-88ae-426f-9670-a75a930740f6 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:19:06.586741 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-632a7e28-88ae-426f-9670-a75a930740f6 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/5c06a09a-23e3-468c-9a18-d40bd3785c9d" status: 200 len: 1321 microversion: 2.1 time: 0.243968 Nov 01 01:19:06.587306 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 129/261] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:19:06 2021] GET /compute/v2.1/servers/5c06a09a-23e3-468c-9a18-d40bd3785c9d => generated 1321 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:19:06.704694 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.virt.hardware [None req-af93a5b5-dcc5-46fd-9596-5b2fbc587369 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Flavor limits 0:0:0 {{(pid=116266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 01 01:19:06.705107 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.virt.hardware [None req-af93a5b5-dcc5-46fd-9596-5b2fbc587369 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Image limits 0:0:0 {{(pid=116266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 01 01:19:06.705565 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.virt.hardware [None req-af93a5b5-dcc5-46fd-9596-5b2fbc587369 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Flavor pref 0:0:0 {{(pid=116266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 01 01:19:06.705959 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.virt.hardware [None req-af93a5b5-dcc5-46fd-9596-5b2fbc587369 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Image pref 0:0:0 {{(pid=116266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 01 01:19:06.706670 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.virt.hardware [None req-af93a5b5-dcc5-46fd-9596-5b2fbc587369 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 01 01:19:06.718551 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-af93a5b5-dcc5-46fd-9596-5b2fbc587369 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:06.723372 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-af93a5b5-dcc5-46fd-9596-5b2fbc587369 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:06.723372 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-af93a5b5-dcc5-46fd-9596-5b2fbc587369 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:06.723372 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-af93a5b5-dcc5-46fd-9596-5b2fbc587369 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:06.740825 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.quota [None req-af93a5b5-dcc5-46fd-9596-5b2fbc587369 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Getting quotas for project 7a22541a330f4071a6c2100f2dc47e39. Resources: {'instances', 'cores', 'ram'} {{(pid=116266) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 01 01:19:06.745613 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.quota [None req-af93a5b5-dcc5-46fd-9596-5b2fbc587369 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Getting quotas for user 887cfd0993f448faafa95b4543bf5085 and project 7a22541a330f4071a6c2100f2dc47e39. Resources: {'instances', 'cores', 'ram'} {{(pid=116266) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 01 01:19:06.758676 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-af93a5b5-dcc5-46fd-9596-5b2fbc587369 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Going to run 1 instances... {{(pid=116266) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 01 01:19:06.763747 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-af93a5b5-dcc5-46fd-9596-5b2fbc587369 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] [instance: 8c69967f-adef-4cdf-9db9-e3596d607641] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b9068d8d-b02d-4043-9f0c-3d774cb372b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116266) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 01 01:19:06.916777 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-af93a5b5-dcc5-46fd-9596-5b2fbc587369 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.843045 Nov 01 01:19:06.927565 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-f30e720a-7ce0-4cfe-ba28-c9dc330736cb tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:19:06.928189 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-f30e720a-7ce0-4cfe-ba28-c9dc330736cb tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] [instance: 8c69967f-adef-4cdf-9db9-e3596d607641] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:19:06.932774 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 133/262] 10.222.0.47 () {60 vars in 1146 bytes} [Mon Nov 1 01:19:06 2021] POST /compute/v2.1/servers => generated 380 bytes in 850 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 01 01:19:07.036522 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-f30e720a-7ce0-4cfe-ba28-c9dc330736cb tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887cfd0993f448faafa95b4543bf5085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a22541a330f4071a6c2100f2dc47e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:19:07.046222 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-f30e720a-7ce0-4cfe-ba28-c9dc330736cb tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] 10.222.0.47 "GET /compute/v2.1/servers/8c69967f-adef-4cdf-9db9-e3596d607641" status: 200 len: 1214 microversion: 2.1 time: 0.121542 Nov 01 01:19:07.047172 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 130/263] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:19:06 2021] GET /compute/v2.1/servers/8c69967f-adef-4cdf-9db9-e3596d607641 => generated 1214 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:19:07.330158 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-ea72c4ad-96b4-4d23-8896-bc3bee3263a0 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:19:07.331227 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-ea72c4ad-96b4-4d23-8896-bc3bee3263a0 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:19:07.338389 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ea72c4ad-96b4-4d23-8896-bc3bee3263a0 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:07.338879 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ea72c4ad-96b4-4d23-8896-bc3bee3263a0 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:07.339689 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ea72c4ad-96b4-4d23-8896-bc3bee3263a0 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:07.340122 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ea72c4ad-96b4-4d23-8896-bc3bee3263a0 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:07.451115 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-ea72c4ad-96b4-4d23-8896-bc3bee3263a0 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "POST /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/action" status: 200 len: 28683 microversion: 2.1 time: 0.124995 Nov 01 01:19:07.455779 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 134/264] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Nov 1 01:19:07 2021] POST /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/action => generated 28683 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 01 01:19:07.603815 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-bf4c2270-b24a-4f5d-bcac-6004ea223f6d tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:19:07.604443 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-bf4c2270-b24a-4f5d-bcac-6004ea223f6d tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: 5c06a09a-23e3-468c-9a18-d40bd3785c9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:19:07.611264 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-bf4c2270-b24a-4f5d-bcac-6004ea223f6d tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:07.611709 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-bf4c2270-b24a-4f5d-bcac-6004ea223f6d tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:07.612460 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-bf4c2270-b24a-4f5d-bcac-6004ea223f6d tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:07.612895 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-bf4c2270-b24a-4f5d-bcac-6004ea223f6d tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:07.740732 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-bf4c2270-b24a-4f5d-bcac-6004ea223f6d tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:19:07.749102 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-bf4c2270-b24a-4f5d-bcac-6004ea223f6d tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/5c06a09a-23e3-468c-9a18-d40bd3785c9d" status: 200 len: 1321 microversion: 2.1 time: 0.149001 Nov 01 01:19:07.754879 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 131/265] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:19:07 2021] GET /compute/v2.1/servers/5c06a09a-23e3-468c-9a18-d40bd3785c9d => generated 1321 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:19:08.063421 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-91275c41-f4a9-46bd-afab-11a8e0e2b040 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:19:08.064115 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-91275c41-f4a9-46bd-afab-11a8e0e2b040 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] [instance: 8c69967f-adef-4cdf-9db9-e3596d607641] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:19:08.121357 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-91275c41-f4a9-46bd-afab-11a8e0e2b040 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887cfd0993f448faafa95b4543bf5085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a22541a330f4071a6c2100f2dc47e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:19:08.127776 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-91275c41-f4a9-46bd-afab-11a8e0e2b040 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] 10.222.0.47 "GET /compute/v2.1/servers/8c69967f-adef-4cdf-9db9-e3596d607641" status: 200 len: 1214 microversion: 2.1 time: 0.068270 Nov 01 01:19:08.128332 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 135/266] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:19:08 2021] GET /compute/v2.1/servers/8c69967f-adef-4cdf-9db9-e3596d607641 => generated 1214 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:19:08.463046 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-5eb408ff-f2e5-45c6-9fac-a297c24d5e32 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:19:08.463959 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-5eb408ff-f2e5-45c6-9fac-a297c24d5e32 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:19:08.471121 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-5eb408ff-f2e5-45c6-9fac-a297c24d5e32 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:08.471682 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-5eb408ff-f2e5-45c6-9fac-a297c24d5e32 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:08.472454 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-5eb408ff-f2e5-45c6-9fac-a297c24d5e32 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:08.472882 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-5eb408ff-f2e5-45c6-9fac-a297c24d5e32 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:08.769436 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-508daa5f-b0da-46b3-8880-55d0974197de tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:19:08.777706 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-508daa5f-b0da-46b3-8880-55d0974197de tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: 5c06a09a-23e3-468c-9a18-d40bd3785c9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:19:08.777706 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-508daa5f-b0da-46b3-8880-55d0974197de tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:08.777706 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-508daa5f-b0da-46b3-8880-55d0974197de tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:08.777706 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-508daa5f-b0da-46b3-8880-55d0974197de tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:08.778248 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-508daa5f-b0da-46b3-8880-55d0974197de tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:08.897711 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-508daa5f-b0da-46b3-8880-55d0974197de tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:19:08.905039 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-508daa5f-b0da-46b3-8880-55d0974197de tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/5c06a09a-23e3-468c-9a18-d40bd3785c9d" status: 200 len: 1321 microversion: 2.1 time: 0.139942 Nov 01 01:19:08.905602 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 136/267] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:19:08 2021] GET /compute/v2.1/servers/5c06a09a-23e3-468c-9a18-d40bd3785c9d => generated 1321 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:19:09.144427 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-4f8d1585-9a81-4622-aa3e-303eb9c0a563 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:19:09.145094 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-4f8d1585-9a81-4622-aa3e-303eb9c0a563 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] [instance: 8c69967f-adef-4cdf-9db9-e3596d607641] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:19:09.151277 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4f8d1585-9a81-4622-aa3e-303eb9c0a563 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:09.151722 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4f8d1585-9a81-4622-aa3e-303eb9c0a563 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:09.152724 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4f8d1585-9a81-4622-aa3e-303eb9c0a563 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:09.153161 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4f8d1585-9a81-4622-aa3e-303eb9c0a563 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:09.211396 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-4f8d1585-9a81-4622-aa3e-303eb9c0a563 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887cfd0993f448faafa95b4543bf5085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a22541a330f4071a6c2100f2dc47e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:19:09.218582 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-4f8d1585-9a81-4622-aa3e-303eb9c0a563 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] 10.222.0.47 "GET /compute/v2.1/servers/8c69967f-adef-4cdf-9db9-e3596d607641" status: 200 len: 1218 microversion: 2.1 time: 0.077727 Nov 01 01:19:09.219183 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 137/268] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:19:09 2021] GET /compute/v2.1/servers/8c69967f-adef-4cdf-9db9-e3596d607641 => generated 1218 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:19:09.921906 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-b6794d52-970f-4c96-9a92-d01a78548d3e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:19:09.922659 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-b6794d52-970f-4c96-9a92-d01a78548d3e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: 5c06a09a-23e3-468c-9a18-d40bd3785c9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:19:09.929132 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b6794d52-970f-4c96-9a92-d01a78548d3e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:09.929570 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b6794d52-970f-4c96-9a92-d01a78548d3e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:09.930325 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b6794d52-970f-4c96-9a92-d01a78548d3e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:09.930782 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b6794d52-970f-4c96-9a92-d01a78548d3e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:10.055523 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-b6794d52-970f-4c96-9a92-d01a78548d3e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:19:10.062804 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-b6794d52-970f-4c96-9a92-d01a78548d3e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/5c06a09a-23e3-468c-9a18-d40bd3785c9d" status: 200 len: 1321 microversion: 2.1 time: 0.144567 Nov 01 01:19:10.064684 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 138/269] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:19:09 2021] GET /compute/v2.1/servers/5c06a09a-23e3-468c-9a18-d40bd3785c9d => generated 1321 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:19:10.235230 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-c8c78cfb-1731-46a9-bb3a-50d86305ca27 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:19:10.235772 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-c8c78cfb-1731-46a9-bb3a-50d86305ca27 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] [instance: 8c69967f-adef-4cdf-9db9-e3596d607641] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:19:10.241358 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c8c78cfb-1731-46a9-bb3a-50d86305ca27 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:10.248348 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c8c78cfb-1731-46a9-bb3a-50d86305ca27 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:10.248348 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c8c78cfb-1731-46a9-bb3a-50d86305ca27 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:10.248348 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c8c78cfb-1731-46a9-bb3a-50d86305ca27 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:10.305695 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-c8c78cfb-1731-46a9-bb3a-50d86305ca27 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887cfd0993f448faafa95b4543bf5085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a22541a330f4071a6c2100f2dc47e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:19:10.312745 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-c8c78cfb-1731-46a9-bb3a-50d86305ca27 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] 10.222.0.47 "GET /compute/v2.1/servers/8c69967f-adef-4cdf-9db9-e3596d607641" status: 200 len: 1218 microversion: 2.1 time: 0.081316 Nov 01 01:19:10.313845 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 139/270] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:19:10 2021] GET /compute/v2.1/servers/8c69967f-adef-4cdf-9db9-e3596d607641 => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:19:11.079815 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-e12b7343-d81d-46c6-8b9e-21ba7af3284e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:19:11.080426 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-e12b7343-d81d-46c6-8b9e-21ba7af3284e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: 5c06a09a-23e3-468c-9a18-d40bd3785c9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:19:11.086879 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e12b7343-d81d-46c6-8b9e-21ba7af3284e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:11.087321 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e12b7343-d81d-46c6-8b9e-21ba7af3284e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:11.088138 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e12b7343-d81d-46c6-8b9e-21ba7af3284e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:11.088582 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e12b7343-d81d-46c6-8b9e-21ba7af3284e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:11.235108 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-e12b7343-d81d-46c6-8b9e-21ba7af3284e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:19:11.244811 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-e12b7343-d81d-46c6-8b9e-21ba7af3284e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/5c06a09a-23e3-468c-9a18-d40bd3785c9d" status: 200 len: 1321 microversion: 2.1 time: 0.168711 Nov 01 01:19:11.252546 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 140/271] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:19:11 2021] GET /compute/v2.1/servers/5c06a09a-23e3-468c-9a18-d40bd3785c9d => generated 1321 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:19:11.328595 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-96c42424-97f4-4c77-8cc9-71cb7aed2dab tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:19:11.329840 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-96c42424-97f4-4c77-8cc9-71cb7aed2dab tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] [instance: 8c69967f-adef-4cdf-9db9-e3596d607641] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:19:11.335637 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-96c42424-97f4-4c77-8cc9-71cb7aed2dab tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:11.340469 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-96c42424-97f4-4c77-8cc9-71cb7aed2dab tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:11.340469 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-96c42424-97f4-4c77-8cc9-71cb7aed2dab tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:11.340469 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-96c42424-97f4-4c77-8cc9-71cb7aed2dab tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:11.401960 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-96c42424-97f4-4c77-8cc9-71cb7aed2dab tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887cfd0993f448faafa95b4543bf5085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a22541a330f4071a6c2100f2dc47e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:19:11.409040 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-96c42424-97f4-4c77-8cc9-71cb7aed2dab tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] 10.222.0.47 "GET /compute/v2.1/servers/8c69967f-adef-4cdf-9db9-e3596d607641" status: 200 len: 1218 microversion: 2.1 time: 0.084014 Nov 01 01:19:11.409605 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 141/272] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:19:11 2021] GET /compute/v2.1/servers/8c69967f-adef-4cdf-9db9-e3596d607641 => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:19:12.025558 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-5eb408ff-f2e5-45c6-9fac-a297c24d5e32 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "POST /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/action" status: 200 len: 28683 microversion: 2.1 time: 3.561593 Nov 01 01:19:12.025558 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 132/273] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Nov 1 01:19:08 2021] POST /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/action => generated 28683 bytes in 3563 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 01 01:19:12.266182 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-9ab52e9a-3e1a-4288-a809-ef7543a86acd tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:19:12.267598 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-9ab52e9a-3e1a-4288-a809-ef7543a86acd tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: 5c06a09a-23e3-468c-9a18-d40bd3785c9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:19:12.276664 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9ab52e9a-3e1a-4288-a809-ef7543a86acd tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:12.276664 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9ab52e9a-3e1a-4288-a809-ef7543a86acd tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:12.276664 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9ab52e9a-3e1a-4288-a809-ef7543a86acd tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:12.276664 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9ab52e9a-3e1a-4288-a809-ef7543a86acd tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:12.414924 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-9ab52e9a-3e1a-4288-a809-ef7543a86acd tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:19:12.423521 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-9ab52e9a-3e1a-4288-a809-ef7543a86acd tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/5c06a09a-23e3-468c-9a18-d40bd3785c9d" status: 200 len: 1321 microversion: 2.1 time: 0.164364 Nov 01 01:19:12.424305 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 142/274] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:19:12 2021] GET /compute/v2.1/servers/5c06a09a-23e3-468c-9a18-d40bd3785c9d => generated 1321 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:19:12.425758 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-1c3e83d7-22b9-4371-8f57-6b2d18cb5640 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:19:12.426475 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-1c3e83d7-22b9-4371-8f57-6b2d18cb5640 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] [instance: 8c69967f-adef-4cdf-9db9-e3596d607641] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:19:12.434187 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-1c3e83d7-22b9-4371-8f57-6b2d18cb5640 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:12.434771 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-1c3e83d7-22b9-4371-8f57-6b2d18cb5640 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:12.435589 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-1c3e83d7-22b9-4371-8f57-6b2d18cb5640 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:12.436073 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-1c3e83d7-22b9-4371-8f57-6b2d18cb5640 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:12.505516 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-1c3e83d7-22b9-4371-8f57-6b2d18cb5640 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887cfd0993f448faafa95b4543bf5085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a22541a330f4071a6c2100f2dc47e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:19:12.513053 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-1c3e83d7-22b9-4371-8f57-6b2d18cb5640 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] 10.222.0.47 "GET /compute/v2.1/servers/8c69967f-adef-4cdf-9db9-e3596d607641" status: 200 len: 1266 microversion: 2.1 time: 0.091476 Nov 01 01:19:12.513675 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 133/275] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:19:12 2021] GET /compute/v2.1/servers/8c69967f-adef-4cdf-9db9-e3596d607641 => generated 1266 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:19:13.036602 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-1c2208d9-cdd6-4646-9cbb-2192f42a629f tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:19:13.037508 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-1c2208d9-cdd6-4646-9cbb-2192f42a629f tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:19:13.043282 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1c2208d9-cdd6-4646-9cbb-2192f42a629f tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:13.043718 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1c2208d9-cdd6-4646-9cbb-2192f42a629f tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:13.045718 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1c2208d9-cdd6-4646-9cbb-2192f42a629f tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:13.045718 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1c2208d9-cdd6-4646-9cbb-2192f42a629f tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:13.440735 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-430ea136-32a6-40a9-b1aa-6ab7cd21e332 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:19:13.441332 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-430ea136-32a6-40a9-b1aa-6ab7cd21e332 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: 5c06a09a-23e3-468c-9a18-d40bd3785c9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:19:13.447802 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-430ea136-32a6-40a9-b1aa-6ab7cd21e332 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:13.448321 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-430ea136-32a6-40a9-b1aa-6ab7cd21e332 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:13.449173 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-430ea136-32a6-40a9-b1aa-6ab7cd21e332 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:13.449596 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-430ea136-32a6-40a9-b1aa-6ab7cd21e332 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:13.577311 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-430ea136-32a6-40a9-b1aa-6ab7cd21e332 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:19:13.584523 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-430ea136-32a6-40a9-b1aa-6ab7cd21e332 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/5c06a09a-23e3-468c-9a18-d40bd3785c9d" status: 200 len: 1321 microversion: 2.1 time: 0.148115 Nov 01 01:19:13.585091 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 134/276] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:19:13 2021] GET /compute/v2.1/servers/5c06a09a-23e3-468c-9a18-d40bd3785c9d => generated 1321 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:19:13.589195 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-373c591f-b615-4db9-8209-bd4e74c93b4d tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:19:13.589789 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-373c591f-b615-4db9-8209-bd4e74c93b4d tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] [instance: 8c69967f-adef-4cdf-9db9-e3596d607641] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:19:13.596100 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-373c591f-b615-4db9-8209-bd4e74c93b4d tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:13.596539 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-373c591f-b615-4db9-8209-bd4e74c93b4d tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:13.597351 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-373c591f-b615-4db9-8209-bd4e74c93b4d tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:13.597777 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-373c591f-b615-4db9-8209-bd4e74c93b4d tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:13.656385 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-373c591f-b615-4db9-8209-bd4e74c93b4d tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887cfd0993f448faafa95b4543bf5085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a22541a330f4071a6c2100f2dc47e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:19:13.665358 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-373c591f-b615-4db9-8209-bd4e74c93b4d tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] 10.222.0.47 "GET /compute/v2.1/servers/8c69967f-adef-4cdf-9db9-e3596d607641" status: 200 len: 1266 microversion: 2.1 time: 0.078993 Nov 01 01:19:13.669702 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 135/277] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:19:13 2021] GET /compute/v2.1/servers/8c69967f-adef-4cdf-9db9-e3596d607641 => generated 1266 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:19:14.600826 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-39154efc-0f81-426e-a593-f31267f26e43 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:19:14.601465 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-39154efc-0f81-426e-a593-f31267f26e43 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: 5c06a09a-23e3-468c-9a18-d40bd3785c9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:19:14.607602 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-39154efc-0f81-426e-a593-f31267f26e43 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:14.608013 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-39154efc-0f81-426e-a593-f31267f26e43 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:14.608929 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-39154efc-0f81-426e-a593-f31267f26e43 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:14.609354 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-39154efc-0f81-426e-a593-f31267f26e43 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:14.742393 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-39154efc-0f81-426e-a593-f31267f26e43 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:19:14.750144 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-39154efc-0f81-426e-a593-f31267f26e43 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/5c06a09a-23e3-468c-9a18-d40bd3785c9d" status: 200 len: 1321 microversion: 2.1 time: 0.153182 Nov 01 01:19:14.750729 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 136/278] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:19:14 2021] GET /compute/v2.1/servers/5c06a09a-23e3-468c-9a18-d40bd3785c9d => generated 1321 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:19:14.758816 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-fae7c7bd-f4e3-4dda-97e0-79a3d7cc9f7a tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:19:14.760101 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-fae7c7bd-f4e3-4dda-97e0-79a3d7cc9f7a tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] [instance: 8c69967f-adef-4cdf-9db9-e3596d607641] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:19:14.766913 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-fae7c7bd-f4e3-4dda-97e0-79a3d7cc9f7a tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:14.767521 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-fae7c7bd-f4e3-4dda-97e0-79a3d7cc9f7a tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:14.768321 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-fae7c7bd-f4e3-4dda-97e0-79a3d7cc9f7a tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:14.768782 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-fae7c7bd-f4e3-4dda-97e0-79a3d7cc9f7a tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:14.833564 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-fae7c7bd-f4e3-4dda-97e0-79a3d7cc9f7a tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887cfd0993f448faafa95b4543bf5085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a22541a330f4071a6c2100f2dc47e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:19:14.842965 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-fae7c7bd-f4e3-4dda-97e0-79a3d7cc9f7a tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] 10.222.0.47 "GET /compute/v2.1/servers/8c69967f-adef-4cdf-9db9-e3596d607641" status: 200 len: 1266 microversion: 2.1 time: 0.090305 Nov 01 01:19:14.843543 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 137/279] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:19:14 2021] GET /compute/v2.1/servers/8c69967f-adef-4cdf-9db9-e3596d607641 => generated 1266 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:19:15.769473 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-0cf1890c-1fa1-4328-80c8-18e6b0a93719 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:19:15.770080 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-0cf1890c-1fa1-4328-80c8-18e6b0a93719 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: 5c06a09a-23e3-468c-9a18-d40bd3785c9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:19:15.776895 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0cf1890c-1fa1-4328-80c8-18e6b0a93719 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:15.777295 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0cf1890c-1fa1-4328-80c8-18e6b0a93719 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:15.778058 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0cf1890c-1fa1-4328-80c8-18e6b0a93719 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:15.778516 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0cf1890c-1fa1-4328-80c8-18e6b0a93719 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:15.898013 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-0cf1890c-1fa1-4328-80c8-18e6b0a93719 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:19:15.905092 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-0cf1890c-1fa1-4328-80c8-18e6b0a93719 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/5c06a09a-23e3-468c-9a18-d40bd3785c9d" status: 200 len: 1321 microversion: 2.1 time: 0.139342 Nov 01 01:19:15.905650 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 138/280] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:19:15 2021] GET /compute/v2.1/servers/5c06a09a-23e3-468c-9a18-d40bd3785c9d => generated 1321 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:19:15.910232 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-8c43316e-7714-4dba-8c8a-487ec6dd228f tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:19:15.910852 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-8c43316e-7714-4dba-8c8a-487ec6dd228f tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] [instance: 8c69967f-adef-4cdf-9db9-e3596d607641] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:19:15.916123 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8c43316e-7714-4dba-8c8a-487ec6dd228f tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:15.916563 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8c43316e-7714-4dba-8c8a-487ec6dd228f tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:15.917315 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8c43316e-7714-4dba-8c8a-487ec6dd228f tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:15.917739 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8c43316e-7714-4dba-8c8a-487ec6dd228f tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:15.978809 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-8c43316e-7714-4dba-8c8a-487ec6dd228f tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887cfd0993f448faafa95b4543bf5085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a22541a330f4071a6c2100f2dc47e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:19:15.985963 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-8c43316e-7714-4dba-8c8a-487ec6dd228f tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] 10.222.0.47 "GET /compute/v2.1/servers/8c69967f-adef-4cdf-9db9-e3596d607641" status: 200 len: 1266 microversion: 2.1 time: 0.079381 Nov 01 01:19:15.986582 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 139/281] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:19:15 2021] GET /compute/v2.1/servers/8c69967f-adef-4cdf-9db9-e3596d607641 => generated 1266 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:19:16.921716 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-6262429a-7e85-4f4d-807d-fcb51945898c tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:19:16.922325 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-6262429a-7e85-4f4d-807d-fcb51945898c tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: 5c06a09a-23e3-468c-9a18-d40bd3785c9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:19:16.929093 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-6262429a-7e85-4f4d-807d-fcb51945898c tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:16.929537 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-6262429a-7e85-4f4d-807d-fcb51945898c tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:16.930297 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-6262429a-7e85-4f4d-807d-fcb51945898c tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:16.930759 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-6262429a-7e85-4f4d-807d-fcb51945898c tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:17.187882 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-6262429a-7e85-4f4d-807d-fcb51945898c tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:19:17.195660 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-6262429a-7e85-4f4d-807d-fcb51945898c tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/5c06a09a-23e3-468c-9a18-d40bd3785c9d" status: 200 len: 1321 microversion: 2.1 time: 0.277527 Nov 01 01:19:17.196214 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 140/282] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:19:16 2021] GET /compute/v2.1/servers/5c06a09a-23e3-468c-9a18-d40bd3785c9d => generated 1321 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:19:17.200382 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-a090f79f-98f8-49dc-ab76-4d2cb7a90c55 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:19:17.200971 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-a090f79f-98f8-49dc-ab76-4d2cb7a90c55 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] [instance: 8c69967f-adef-4cdf-9db9-e3596d607641] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:19:17.206324 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a090f79f-98f8-49dc-ab76-4d2cb7a90c55 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:17.206788 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a090f79f-98f8-49dc-ab76-4d2cb7a90c55 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:17.207554 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a090f79f-98f8-49dc-ab76-4d2cb7a90c55 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:17.207973 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a090f79f-98f8-49dc-ab76-4d2cb7a90c55 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:17.269862 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-a090f79f-98f8-49dc-ab76-4d2cb7a90c55 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887cfd0993f448faafa95b4543bf5085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a22541a330f4071a6c2100f2dc47e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:19:17.276978 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-a090f79f-98f8-49dc-ab76-4d2cb7a90c55 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] 10.222.0.47 "GET /compute/v2.1/servers/8c69967f-adef-4cdf-9db9-e3596d607641" status: 200 len: 1266 microversion: 2.1 time: 0.079847 Nov 01 01:19:17.277511 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 141/283] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:19:17 2021] GET /compute/v2.1/servers/8c69967f-adef-4cdf-9db9-e3596d607641 => generated 1266 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:19:18.097011 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-1c2208d9-cdd6-4646-9cbb-2192f42a629f tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "POST /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/action" status: 200 len: 28683 microversion: 2.1 time: 5.062578 Nov 01 01:19:18.099257 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 143/284] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Nov 1 01:19:13 2021] POST /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/action => generated 28683 bytes in 5067 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 01 01:19:18.212407 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-aa9dc286-97bc-49a6-927f-6e22de9b670a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:19:18.213015 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-aa9dc286-97bc-49a6-927f-6e22de9b670a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: 5c06a09a-23e3-468c-9a18-d40bd3785c9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:19:18.219218 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-aa9dc286-97bc-49a6-927f-6e22de9b670a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:18.219666 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-aa9dc286-97bc-49a6-927f-6e22de9b670a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:18.220485 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-aa9dc286-97bc-49a6-927f-6e22de9b670a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:18.220898 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-aa9dc286-97bc-49a6-927f-6e22de9b670a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:18.294373 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-a6bc38fc-1691-4f0c-a72c-c421b56a9ed8 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:19:18.295127 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-a6bc38fc-1691-4f0c-a72c-c421b56a9ed8 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] [instance: 8c69967f-adef-4cdf-9db9-e3596d607641] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:19:18.307038 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a6bc38fc-1691-4f0c-a72c-c421b56a9ed8 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:18.312127 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a6bc38fc-1691-4f0c-a72c-c421b56a9ed8 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:18.312127 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a6bc38fc-1691-4f0c-a72c-c421b56a9ed8 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:18.312127 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a6bc38fc-1691-4f0c-a72c-c421b56a9ed8 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:18.388187 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-a6bc38fc-1691-4f0c-a72c-c421b56a9ed8 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887cfd0993f448faafa95b4543bf5085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a22541a330f4071a6c2100f2dc47e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:19:18.396656 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-a6bc38fc-1691-4f0c-a72c-c421b56a9ed8 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] 10.222.0.47 "GET /compute/v2.1/servers/8c69967f-adef-4cdf-9db9-e3596d607641" status: 200 len: 1272 microversion: 2.1 time: 0.106383 Nov 01 01:19:18.397454 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 144/285] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:19:18 2021] GET /compute/v2.1/servers/8c69967f-adef-4cdf-9db9-e3596d607641 => generated 1272 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:19:18.487368 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-aa9dc286-97bc-49a6-927f-6e22de9b670a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:19:18.494912 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-aa9dc286-97bc-49a6-927f-6e22de9b670a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/5c06a09a-23e3-468c-9a18-d40bd3785c9d" status: 200 len: 1321 microversion: 2.1 time: 0.286123 Nov 01 01:19:18.495476 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 142/286] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:19:18 2021] GET /compute/v2.1/servers/5c06a09a-23e3-468c-9a18-d40bd3785c9d => generated 1321 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:19:19.110993 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-ac6459e1-c763-4cfc-b714-d914a08338ae tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:19:19.111938 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-ac6459e1-c763-4cfc-b714-d914a08338ae tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:19:19.118721 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ac6459e1-c763-4cfc-b714-d914a08338ae tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:19.119166 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ac6459e1-c763-4cfc-b714-d914a08338ae tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:19.119944 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ac6459e1-c763-4cfc-b714-d914a08338ae tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:19.120396 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ac6459e1-c763-4cfc-b714-d914a08338ae tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:19.316804 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-ac6459e1-c763-4cfc-b714-d914a08338ae tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "POST /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/action" status: 200 len: 28683 microversion: 2.1 time: 0.211134 Nov 01 01:19:19.320680 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 145/287] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Nov 1 01:19:19 2021] POST /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/action => generated 28683 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 01 01:19:19.415017 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-f4339f2e-9777-4cc0-8f00-665c992d1401 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:19:19.415017 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-f4339f2e-9777-4cc0-8f00-665c992d1401 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] [instance: 8c69967f-adef-4cdf-9db9-e3596d607641] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:19:19.420784 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f4339f2e-9777-4cc0-8f00-665c992d1401 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:19.421224 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f4339f2e-9777-4cc0-8f00-665c992d1401 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:19.421987 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f4339f2e-9777-4cc0-8f00-665c992d1401 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:19.422412 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f4339f2e-9777-4cc0-8f00-665c992d1401 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:19.515106 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-445be12d-bc74-42d0-bdf1-7dd8cb2b7851 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:19:19.516008 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-445be12d-bc74-42d0-bdf1-7dd8cb2b7851 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: 5c06a09a-23e3-468c-9a18-d40bd3785c9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:19:19.535642 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-445be12d-bc74-42d0-bdf1-7dd8cb2b7851 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:19.537106 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-445be12d-bc74-42d0-bdf1-7dd8cb2b7851 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:19.539726 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-445be12d-bc74-42d0-bdf1-7dd8cb2b7851 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:19.540767 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-445be12d-bc74-42d0-bdf1-7dd8cb2b7851 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:19.653931 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-f4339f2e-9777-4cc0-8f00-665c992d1401 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887cfd0993f448faafa95b4543bf5085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a22541a330f4071a6c2100f2dc47e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:19:19.664214 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-f4339f2e-9777-4cc0-8f00-665c992d1401 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] 10.222.0.47 "GET /compute/v2.1/servers/8c69967f-adef-4cdf-9db9-e3596d607641" status: 200 len: 1314 microversion: 2.1 time: 0.253720 Nov 01 01:19:19.664793 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 143/288] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:19:19 2021] GET /compute/v2.1/servers/8c69967f-adef-4cdf-9db9-e3596d607641 => generated 1314 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:19:19.691184 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [req-a32d0442-5989-4551-ac76-b63bb9fd1486 req-7b330e7c-9ebe-41c3-ba7b-019538d85188 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c06a09a-23e3-468c-9a18-d40bd3785c9d", "name": "network-vif-plugged", "status": "completed", "tag": "c8a25e8a-7f87-4425-985e-192fc8e74209"}]} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:19:19.693844 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 01 01:19:19.693844 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: warnings.warn(msg) Nov 01 01:19:19.715794 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [req-a32d0442-5989-4551-ac76-b63bb9fd1486 req-7b330e7c-9ebe-41c3-ba7b-019538d85188 service nova] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:19.724849 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [req-a32d0442-5989-4551-ac76-b63bb9fd1486 req-7b330e7c-9ebe-41c3-ba7b-019538d85188 service nova] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:19.751027 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.compute.server_external_events [req-a32d0442-5989-4551-ac76-b63bb9fd1486 req-7b330e7c-9ebe-41c3-ba7b-019538d85188 service nova] Creating event network-vif-plugged:c8a25e8a-7f87-4425-985e-192fc8e74209 for instance 5c06a09a-23e3-468c-9a18-d40bd3785c9d on hv-cinder-81561 Nov 01 01:19:19.759070 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [req-a32d0442-5989-4551-ac76-b63bb9fd1486 req-7b330e7c-9ebe-41c3-ba7b-019538d85188 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080659 Nov 01 01:19:19.760139 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 144/289] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Nov 1 01:19:19 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 01 01:19:19.772632 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-445be12d-bc74-42d0-bdf1-7dd8cb2b7851 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:19:19.780090 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-445be12d-bc74-42d0-bdf1-7dd8cb2b7851 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/5c06a09a-23e3-468c-9a18-d40bd3785c9d" status: 200 len: 1321 microversion: 2.1 time: 0.271125 Nov 01 01:19:19.780650 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 146/290] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:19:19 2021] GET /compute/v2.1/servers/5c06a09a-23e3-468c-9a18-d40bd3785c9d => generated 1321 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:19:19.932760 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [req-70d7cc1e-8b5d-46b2-b154-03f0f74508cc req-2827ac16-cdb3-47e1-9198-7c86c5ecdad6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c69967f-adef-4cdf-9db9-e3596d607641", "tag": "e5a085ab-aefa-4bb0-8f93-856a427e17b3"}]} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:19:19.938591 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 01 01:19:19.938591 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: warnings.warn(msg) Nov 01 01:19:19.954100 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [req-70d7cc1e-8b5d-46b2-b154-03f0f74508cc req-2827ac16-cdb3-47e1-9198-7c86c5ecdad6 service nova] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:19.954100 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [req-70d7cc1e-8b5d-46b2-b154-03f0f74508cc req-2827ac16-cdb3-47e1-9198-7c86c5ecdad6 service nova] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:19.967465 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.compute.server_external_events [req-70d7cc1e-8b5d-46b2-b154-03f0f74508cc req-2827ac16-cdb3-47e1-9198-7c86c5ecdad6 service nova] Creating event network-changed:e5a085ab-aefa-4bb0-8f93-856a427e17b3 for instance 8c69967f-adef-4cdf-9db9-e3596d607641 on hv-cinder-81561 Nov 01 01:19:19.972922 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [req-70d7cc1e-8b5d-46b2-b154-03f0f74508cc req-2827ac16-cdb3-47e1-9198-7c86c5ecdad6 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055745 Nov 01 01:19:19.974267 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 145/291] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Nov 1 01:19:19 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 01 01:19:20.519165 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-d7c198a5-0dde-45b9-9ae9-6708d2ff430b tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:19:20.519165 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-d7c198a5-0dde-45b9-9ae9-6708d2ff430b tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:19:20.519165 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d7c198a5-0dde-45b9-9ae9-6708d2ff430b tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:20.519165 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d7c198a5-0dde-45b9-9ae9-6708d2ff430b tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:20.520663 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d7c198a5-0dde-45b9-9ae9-6708d2ff430b tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:20.520663 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d7c198a5-0dde-45b9-9ae9-6708d2ff430b tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:20.681411 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-542342bb-d8dc-4218-aad7-26e417f5ab3f tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:19:20.682104 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-542342bb-d8dc-4218-aad7-26e417f5ab3f tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] [instance: 8c69967f-adef-4cdf-9db9-e3596d607641] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:19:20.688254 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-542342bb-d8dc-4218-aad7-26e417f5ab3f tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:20.688718 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-542342bb-d8dc-4218-aad7-26e417f5ab3f tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:20.689449 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-542342bb-d8dc-4218-aad7-26e417f5ab3f tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:20.689876 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-542342bb-d8dc-4218-aad7-26e417f5ab3f tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:20.721905 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-d7c198a5-0dde-45b9-9ae9-6708d2ff430b tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "POST /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/action" status: 200 len: 28683 microversion: 2.1 time: 0.397026 Nov 01 01:19:20.722563 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 147/292] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Nov 1 01:19:20 2021] POST /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/action => generated 28683 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 01 01:19:20.800373 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-3432973a-322a-4804-b938-3f90958e927f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:19:20.801973 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-3432973a-322a-4804-b938-3f90958e927f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: 5c06a09a-23e3-468c-9a18-d40bd3785c9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:19:20.811959 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3432973a-322a-4804-b938-3f90958e927f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:20.815768 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3432973a-322a-4804-b938-3f90958e927f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:20.822113 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3432973a-322a-4804-b938-3f90958e927f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:20.822747 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3432973a-322a-4804-b938-3f90958e927f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:20.845534 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-542342bb-d8dc-4218-aad7-26e417f5ab3f tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887cfd0993f448faafa95b4543bf5085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a22541a330f4071a6c2100f2dc47e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:19:20.855317 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-542342bb-d8dc-4218-aad7-26e417f5ab3f tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] 10.222.0.47 "GET /compute/v2.1/servers/8c69967f-adef-4cdf-9db9-e3596d607641" status: 200 len: 1314 microversion: 2.1 time: 0.178579 Nov 01 01:19:20.861159 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 146/293] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:19:20 2021] GET /compute/v2.1/servers/8c69967f-adef-4cdf-9db9-e3596d607641 => generated 1314 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:19:20.964664 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-3432973a-322a-4804-b938-3f90958e927f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:19:20.972410 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-3432973a-322a-4804-b938-3f90958e927f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/5c06a09a-23e3-468c-9a18-d40bd3785c9d" status: 200 len: 1321 microversion: 2.1 time: 0.178979 Nov 01 01:19:20.981796 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 148/294] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:19:20 2021] GET /compute/v2.1/servers/5c06a09a-23e3-468c-9a18-d40bd3785c9d => generated 1321 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:19:21.732974 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-fbdabb5d-4e55-4c89-8d0a-f2425a06a727 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:19:21.733887 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-fbdabb5d-4e55-4c89-8d0a-f2425a06a727 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:19:21.740497 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-fbdabb5d-4e55-4c89-8d0a-f2425a06a727 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:21.745879 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-fbdabb5d-4e55-4c89-8d0a-f2425a06a727 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:21.745879 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-fbdabb5d-4e55-4c89-8d0a-f2425a06a727 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:21.745879 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-fbdabb5d-4e55-4c89-8d0a-f2425a06a727 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:21.775104 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [req-1eb4de1d-ada4-4496-85a8-bf202f447304 req-d41aa0bb-6484-4ca6-96b4-a04e1dd07640 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f02098be-ed15-45a0-a599-941cb0e1eebb", "name": "network-vif-plugged", "status": "completed", "tag": "675c5b62-2b1b-4dd7-823c-c35403e383c1"}]} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:19:21.777456 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 01 01:19:21.777456 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: warnings.warn(msg) Nov 01 01:19:21.791782 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [req-1eb4de1d-ada4-4496-85a8-bf202f447304 req-d41aa0bb-6484-4ca6-96b4-a04e1dd07640 service nova] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:21.792527 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [req-1eb4de1d-ada4-4496-85a8-bf202f447304 req-d41aa0bb-6484-4ca6-96b4-a04e1dd07640 service nova] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:21.804916 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.compute.server_external_events [req-1eb4de1d-ada4-4496-85a8-bf202f447304 req-d41aa0bb-6484-4ca6-96b4-a04e1dd07640 service nova] Creating event network-vif-plugged:675c5b62-2b1b-4dd7-823c-c35403e383c1 for instance f02098be-ed15-45a0-a599-941cb0e1eebb on hv-cinder-81561 Nov 01 01:19:21.809822 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [req-1eb4de1d-ada4-4496-85a8-bf202f447304 req-d41aa0bb-6484-4ca6-96b4-a04e1dd07640 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039387 Nov 01 01:19:21.810599 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 149/295] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Nov 1 01:19:21 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 01 01:19:21.864254 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-fbdabb5d-4e55-4c89-8d0a-f2425a06a727 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "POST /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/action" status: 200 len: 28683 microversion: 2.1 time: 0.133945 Nov 01 01:19:21.864784 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 147/296] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Nov 1 01:19:21 2021] POST /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/action => generated 28683 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 01 01:19:21.877432 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-de424cb3-c1da-4a11-99d3-beb8aee289b2 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:19:21.878133 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-de424cb3-c1da-4a11-99d3-beb8aee289b2 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] [instance: 8c69967f-adef-4cdf-9db9-e3596d607641] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:19:21.885300 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-de424cb3-c1da-4a11-99d3-beb8aee289b2 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:21.885724 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-de424cb3-c1da-4a11-99d3-beb8aee289b2 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:21.886576 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-de424cb3-c1da-4a11-99d3-beb8aee289b2 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:21.887000 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-de424cb3-c1da-4a11-99d3-beb8aee289b2 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:22.000862 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-54ea4a83-858e-4c9d-8980-cb12613d2ac9 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:19:22.001545 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-54ea4a83-858e-4c9d-8980-cb12613d2ac9 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: 5c06a09a-23e3-468c-9a18-d40bd3785c9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:19:22.024487 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-54ea4a83-858e-4c9d-8980-cb12613d2ac9 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:22.024487 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-54ea4a83-858e-4c9d-8980-cb12613d2ac9 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:22.024487 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-54ea4a83-858e-4c9d-8980-cb12613d2ac9 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:22.024487 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-54ea4a83-858e-4c9d-8980-cb12613d2ac9 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:22.055069 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-de424cb3-c1da-4a11-99d3-beb8aee289b2 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887cfd0993f448faafa95b4543bf5085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a22541a330f4071a6c2100f2dc47e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:19:22.062671 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-de424cb3-c1da-4a11-99d3-beb8aee289b2 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] 10.222.0.47 "GET /compute/v2.1/servers/8c69967f-adef-4cdf-9db9-e3596d607641" status: 200 len: 1314 microversion: 2.1 time: 0.189201 Nov 01 01:19:22.063318 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 150/297] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:19:21 2021] GET /compute/v2.1/servers/8c69967f-adef-4cdf-9db9-e3596d607641 => generated 1314 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:19:22.175764 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-54ea4a83-858e-4c9d-8980-cb12613d2ac9 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:19:22.184436 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-54ea4a83-858e-4c9d-8980-cb12613d2ac9 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/5c06a09a-23e3-468c-9a18-d40bd3785c9d" status: 200 len: 1515 microversion: 2.1 time: 0.187286 Nov 01 01:19:22.185122 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 148/298] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:19:21 2021] GET /compute/v2.1/servers/5c06a09a-23e3-468c-9a18-d40bd3785c9d => generated 1515 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:19:22.201908 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-b5ad592d-e763-431b-9914-88c32d3c59d2 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:19:22.202915 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-b5ad592d-e763-431b-9914-88c32d3c59d2 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: 5c06a09a-23e3-468c-9a18-d40bd3785c9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:19:22.210895 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b5ad592d-e763-431b-9914-88c32d3c59d2 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:22.211460 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b5ad592d-e763-431b-9914-88c32d3c59d2 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:22.212383 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b5ad592d-e763-431b-9914-88c32d3c59d2 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:22.212991 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b5ad592d-e763-431b-9914-88c32d3c59d2 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:22.240271 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.objects.instance [None req-b5ad592d-e763-431b-9914-88c32d3c59d2 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lazy-loading 'flavor' on Instance uuid 5c06a09a-23e3-468c-9a18-d40bd3785c9d {{(pid=116266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 01 01:19:22.569225 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-b5ad592d-e763-431b-9914-88c32d3c59d2 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "POST /compute/v2.1/servers/5c06a09a-23e3-468c-9a18-d40bd3785c9d/action" status: 200 len: 32 microversion: 2.1 time: 0.371406 Nov 01 01:19:22.570163 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 151/299] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Nov 1 01:19:22 2021] POST /compute/v2.1/servers/5c06a09a-23e3-468c-9a18-d40bd3785c9d/action => generated 32 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 01 01:19:22.578469 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-ab00b4a5-41bc-41b4-a7bd-92cc748b835f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:19:22.579081 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-ab00b4a5-41bc-41b4-a7bd-92cc748b835f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: 5c06a09a-23e3-468c-9a18-d40bd3785c9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:19:22.586169 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ab00b4a5-41bc-41b4-a7bd-92cc748b835f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:22.586669 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ab00b4a5-41bc-41b4-a7bd-92cc748b835f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:22.587463 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ab00b4a5-41bc-41b4-a7bd-92cc748b835f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:22.587889 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ab00b4a5-41bc-41b4-a7bd-92cc748b835f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:22.740232 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-ab00b4a5-41bc-41b4-a7bd-92cc748b835f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:19:22.755406 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-ab00b4a5-41bc-41b4-a7bd-92cc748b835f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/5c06a09a-23e3-468c-9a18-d40bd3785c9d" status: 200 len: 1521 microversion: 2.1 time: 0.180463 Nov 01 01:19:22.755972 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 149/300] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:19:22 2021] GET /compute/v2.1/servers/5c06a09a-23e3-468c-9a18-d40bd3785c9d => generated 1521 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:19:22.877590 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-13e73490-5a27-4498-ad1f-e71b371d3092 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:19:22.878759 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-13e73490-5a27-4498-ad1f-e71b371d3092 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:19:22.886139 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-13e73490-5a27-4498-ad1f-e71b371d3092 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:22.886738 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-13e73490-5a27-4498-ad1f-e71b371d3092 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:22.887592 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-13e73490-5a27-4498-ad1f-e71b371d3092 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:22.888092 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-13e73490-5a27-4498-ad1f-e71b371d3092 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:22.981836 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-13e73490-5a27-4498-ad1f-e71b371d3092 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "POST /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/action" status: 200 len: 28683 microversion: 2.1 time: 0.108077 Nov 01 01:19:22.982561 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 152/301] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Nov 1 01:19:22 2021] POST /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/action => generated 28683 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 01 01:19:23.080899 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-7cd49366-94ca-4556-acf6-b274fcda8b88 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:19:23.081511 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-7cd49366-94ca-4556-acf6-b274fcda8b88 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] [instance: 8c69967f-adef-4cdf-9db9-e3596d607641] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:19:23.088330 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-7cd49366-94ca-4556-acf6-b274fcda8b88 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:23.088778 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-7cd49366-94ca-4556-acf6-b274fcda8b88 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:23.089543 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-7cd49366-94ca-4556-acf6-b274fcda8b88 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:23.089968 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-7cd49366-94ca-4556-acf6-b274fcda8b88 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:23.221553 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-7cd49366-94ca-4556-acf6-b274fcda8b88 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887cfd0993f448faafa95b4543bf5085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a22541a330f4071a6c2100f2dc47e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:19:23.232195 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-7cd49366-94ca-4556-acf6-b274fcda8b88 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] 10.222.0.47 "GET /compute/v2.1/servers/8c69967f-adef-4cdf-9db9-e3596d607641" status: 200 len: 1314 microversion: 2.1 time: 0.154820 Nov 01 01:19:23.233159 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 150/302] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:19:23 2021] GET /compute/v2.1/servers/8c69967f-adef-4cdf-9db9-e3596d607641 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:19:23.772506 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-f142be97-3a89-4a0a-a680-9094c7139ac8 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:19:23.773245 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-f142be97-3a89-4a0a-a680-9094c7139ac8 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: 5c06a09a-23e3-468c-9a18-d40bd3785c9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:19:23.780017 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f142be97-3a89-4a0a-a680-9094c7139ac8 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:23.780509 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f142be97-3a89-4a0a-a680-9094c7139ac8 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:23.781275 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f142be97-3a89-4a0a-a680-9094c7139ac8 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:23.781704 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f142be97-3a89-4a0a-a680-9094c7139ac8 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:23.923279 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-f142be97-3a89-4a0a-a680-9094c7139ac8 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:19:23.931578 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-f142be97-3a89-4a0a-a680-9094c7139ac8 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/5c06a09a-23e3-468c-9a18-d40bd3785c9d" status: 200 len: 1521 microversion: 2.1 time: 0.163702 Nov 01 01:19:23.932142 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 153/303] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:19:23 2021] GET /compute/v2.1/servers/5c06a09a-23e3-468c-9a18-d40bd3785c9d => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:19:23.994141 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-7d18abe5-fa20-405f-9fc0-55ca67e4f11c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:19:23.995815 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-7d18abe5-fa20-405f-9fc0-55ca67e4f11c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:19:24.002224 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-7d18abe5-fa20-405f-9fc0-55ca67e4f11c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:24.002709 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-7d18abe5-fa20-405f-9fc0-55ca67e4f11c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:24.003480 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-7d18abe5-fa20-405f-9fc0-55ca67e4f11c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:24.003909 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-7d18abe5-fa20-405f-9fc0-55ca67e4f11c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:24.096256 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-7d18abe5-fa20-405f-9fc0-55ca67e4f11c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "POST /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/action" status: 200 len: 28683 microversion: 2.1 time: 0.106323 Nov 01 01:19:24.096898 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 151/304] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Nov 1 01:19:23 2021] POST /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/action => generated 28683 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 01 01:19:24.249715 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-6ed60fe7-1f91-4655-b3ce-20929a3d7586 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:19:24.250442 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-6ed60fe7-1f91-4655-b3ce-20929a3d7586 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] [instance: 8c69967f-adef-4cdf-9db9-e3596d607641] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:19:24.257574 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6ed60fe7-1f91-4655-b3ce-20929a3d7586 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:24.258016 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6ed60fe7-1f91-4655-b3ce-20929a3d7586 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:24.258985 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6ed60fe7-1f91-4655-b3ce-20929a3d7586 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:24.259637 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6ed60fe7-1f91-4655-b3ce-20929a3d7586 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:24.533093 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-6ed60fe7-1f91-4655-b3ce-20929a3d7586 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887cfd0993f448faafa95b4543bf5085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a22541a330f4071a6c2100f2dc47e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:19:24.541233 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-6ed60fe7-1f91-4655-b3ce-20929a3d7586 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] 10.222.0.47 "GET /compute/v2.1/servers/8c69967f-adef-4cdf-9db9-e3596d607641" status: 200 len: 1314 microversion: 2.1 time: 0.295730 Nov 01 01:19:24.541966 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 154/305] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:19:24 2021] GET /compute/v2.1/servers/8c69967f-adef-4cdf-9db9-e3596d607641 => generated 1314 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:19:24.955094 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-256e5f62-e964-47a5-bffb-c78b22c96a76 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:19:24.955797 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-256e5f62-e964-47a5-bffb-c78b22c96a76 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: 5c06a09a-23e3-468c-9a18-d40bd3785c9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:19:24.967684 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-256e5f62-e964-47a5-bffb-c78b22c96a76 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:24.968132 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-256e5f62-e964-47a5-bffb-c78b22c96a76 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:24.968913 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-256e5f62-e964-47a5-bffb-c78b22c96a76 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:24.969342 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-256e5f62-e964-47a5-bffb-c78b22c96a76 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:25.108961 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-a8fd4258-8242-40b3-8a60-5fd60c82b23d tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:19:25.110186 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-a8fd4258-8242-40b3-8a60-5fd60c82b23d tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:19:25.116540 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-256e5f62-e964-47a5-bffb-c78b22c96a76 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:19:25.117270 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a8fd4258-8242-40b3-8a60-5fd60c82b23d tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:25.118240 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a8fd4258-8242-40b3-8a60-5fd60c82b23d tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:25.119076 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a8fd4258-8242-40b3-8a60-5fd60c82b23d tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:25.119759 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a8fd4258-8242-40b3-8a60-5fd60c82b23d tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:25.129878 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-256e5f62-e964-47a5-bffb-c78b22c96a76 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/5c06a09a-23e3-468c-9a18-d40bd3785c9d" status: 200 len: 1521 microversion: 2.1 time: 0.179639 Nov 01 01:19:25.132857 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 152/306] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:19:24 2021] GET /compute/v2.1/servers/5c06a09a-23e3-468c-9a18-d40bd3785c9d => generated 1521 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:19:25.231191 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-a8fd4258-8242-40b3-8a60-5fd60c82b23d tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "POST /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/action" status: 200 len: 28683 microversion: 2.1 time: 0.125729 Nov 01 01:19:25.232843 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 155/307] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Nov 1 01:19:25 2021] POST /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/action => generated 28683 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 01 01:19:25.557934 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-29590fdb-e2b8-492a-97e0-dd8f509349a2 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:19:25.558563 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-29590fdb-e2b8-492a-97e0-dd8f509349a2 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] [instance: 8c69967f-adef-4cdf-9db9-e3596d607641] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:19:25.564871 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-29590fdb-e2b8-492a-97e0-dd8f509349a2 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:25.571201 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-29590fdb-e2b8-492a-97e0-dd8f509349a2 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:25.571201 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-29590fdb-e2b8-492a-97e0-dd8f509349a2 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:25.571201 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-29590fdb-e2b8-492a-97e0-dd8f509349a2 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:25.704143 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-29590fdb-e2b8-492a-97e0-dd8f509349a2 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887cfd0993f448faafa95b4543bf5085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a22541a330f4071a6c2100f2dc47e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:19:25.711857 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-29590fdb-e2b8-492a-97e0-dd8f509349a2 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] 10.222.0.47 "GET /compute/v2.1/servers/8c69967f-adef-4cdf-9db9-e3596d607641" status: 200 len: 1314 microversion: 2.1 time: 0.157696 Nov 01 01:19:25.712660 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 153/308] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:19:25 2021] GET /compute/v2.1/servers/8c69967f-adef-4cdf-9db9-e3596d607641 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:19:26.148623 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-f8b86f86-35dd-4138-8254-1144d4292a25 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:19:26.149231 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-f8b86f86-35dd-4138-8254-1144d4292a25 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: 5c06a09a-23e3-468c-9a18-d40bd3785c9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:19:26.156262 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f8b86f86-35dd-4138-8254-1144d4292a25 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:26.156861 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f8b86f86-35dd-4138-8254-1144d4292a25 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:26.157458 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f8b86f86-35dd-4138-8254-1144d4292a25 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:26.157891 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f8b86f86-35dd-4138-8254-1144d4292a25 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:26.246096 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-3bd52147-dc6d-4432-88a1-3ff12549baa0 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:19:26.247074 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-3bd52147-dc6d-4432-88a1-3ff12549baa0 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:19:26.253378 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3bd52147-dc6d-4432-88a1-3ff12549baa0 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:26.253846 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3bd52147-dc6d-4432-88a1-3ff12549baa0 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:26.255316 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3bd52147-dc6d-4432-88a1-3ff12549baa0 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:26.255813 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3bd52147-dc6d-4432-88a1-3ff12549baa0 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:26.321204 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-f8b86f86-35dd-4138-8254-1144d4292a25 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:19:26.328441 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-f8b86f86-35dd-4138-8254-1144d4292a25 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/5c06a09a-23e3-468c-9a18-d40bd3785c9d" status: 200 len: 1521 microversion: 2.1 time: 0.184512 Nov 01 01:19:26.329033 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 156/309] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:19:26 2021] GET /compute/v2.1/servers/5c06a09a-23e3-468c-9a18-d40bd3785c9d => generated 1521 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:19:26.367266 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-3bd52147-dc6d-4432-88a1-3ff12549baa0 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "POST /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/action" status: 200 len: 28683 microversion: 2.1 time: 0.126362 Nov 01 01:19:26.384128 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 154/310] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Nov 1 01:19:26 2021] POST /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/action => generated 28683 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 01 01:19:26.729697 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-67e926a5-966c-4f71-a77b-8a0f265f867d tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:19:26.730295 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-67e926a5-966c-4f71-a77b-8a0f265f867d tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] [instance: 8c69967f-adef-4cdf-9db9-e3596d607641] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:19:26.736520 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-67e926a5-966c-4f71-a77b-8a0f265f867d tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:26.736999 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-67e926a5-966c-4f71-a77b-8a0f265f867d tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:26.737749 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-67e926a5-966c-4f71-a77b-8a0f265f867d tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:26.738170 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-67e926a5-966c-4f71-a77b-8a0f265f867d tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:26.859602 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-67e926a5-966c-4f71-a77b-8a0f265f867d tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887cfd0993f448faafa95b4543bf5085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a22541a330f4071a6c2100f2dc47e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:19:26.868157 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-67e926a5-966c-4f71-a77b-8a0f265f867d tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] 10.222.0.47 "GET /compute/v2.1/servers/8c69967f-adef-4cdf-9db9-e3596d607641" status: 200 len: 1314 microversion: 2.1 time: 0.141868 Nov 01 01:19:26.869122 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 157/311] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:19:26 2021] GET /compute/v2.1/servers/8c69967f-adef-4cdf-9db9-e3596d607641 => generated 1314 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:19:27.345071 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-d131eb25-0aa9-40f3-9249-02580c721575 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:19:27.345770 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-d131eb25-0aa9-40f3-9249-02580c721575 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: 5c06a09a-23e3-468c-9a18-d40bd3785c9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:19:27.352413 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d131eb25-0aa9-40f3-9249-02580c721575 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:27.352854 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d131eb25-0aa9-40f3-9249-02580c721575 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:27.353618 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d131eb25-0aa9-40f3-9249-02580c721575 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:27.354044 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d131eb25-0aa9-40f3-9249-02580c721575 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:27.391137 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-e0385524-f8b4-425f-b3a8-092122322b33 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:19:27.392049 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-e0385524-f8b4-425f-b3a8-092122322b33 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:19:27.398546 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e0385524-f8b4-425f-b3a8-092122322b33 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:27.399000 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e0385524-f8b4-425f-b3a8-092122322b33 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:27.399776 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e0385524-f8b4-425f-b3a8-092122322b33 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:27.400213 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e0385524-f8b4-425f-b3a8-092122322b33 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:27.497850 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-d131eb25-0aa9-40f3-9249-02580c721575 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:19:27.505544 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-d131eb25-0aa9-40f3-9249-02580c721575 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/5c06a09a-23e3-468c-9a18-d40bd3785c9d" status: 200 len: 1521 microversion: 2.1 time: 0.164453 Nov 01 01:19:27.506187 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 155/312] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:19:27 2021] GET /compute/v2.1/servers/5c06a09a-23e3-468c-9a18-d40bd3785c9d => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:19:27.513322 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-e0385524-f8b4-425f-b3a8-092122322b33 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "POST /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/action" status: 200 len: 28683 microversion: 2.1 time: 0.125727 Nov 01 01:19:27.514056 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 158/313] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Nov 1 01:19:27 2021] POST /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/action => generated 28683 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 01 01:19:27.884886 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-410ff080-5421-46d5-97c7-7bff020e7001 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:19:27.885749 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-410ff080-5421-46d5-97c7-7bff020e7001 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] [instance: 8c69967f-adef-4cdf-9db9-e3596d607641] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:19:27.893757 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-410ff080-5421-46d5-97c7-7bff020e7001 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:27.894379 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-410ff080-5421-46d5-97c7-7bff020e7001 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:27.896048 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-410ff080-5421-46d5-97c7-7bff020e7001 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:27.896507 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-410ff080-5421-46d5-97c7-7bff020e7001 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:28.026896 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-410ff080-5421-46d5-97c7-7bff020e7001 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887cfd0993f448faafa95b4543bf5085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a22541a330f4071a6c2100f2dc47e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:19:28.034387 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-410ff080-5421-46d5-97c7-7bff020e7001 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] 10.222.0.47 "GET /compute/v2.1/servers/8c69967f-adef-4cdf-9db9-e3596d607641" status: 200 len: 1314 microversion: 2.1 time: 0.153182 Nov 01 01:19:28.034964 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 156/314] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:19:27 2021] GET /compute/v2.1/servers/8c69967f-adef-4cdf-9db9-e3596d607641 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:19:28.525057 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-2b6160aa-86dc-4f80-93be-bb5328b589da tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:19:28.526305 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-2b6160aa-86dc-4f80-93be-bb5328b589da tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: 5c06a09a-23e3-468c-9a18-d40bd3785c9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:19:28.534704 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-69acd65c-5365-4b8e-8f22-cfd63f3c0d82 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:19:28.535371 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-69acd65c-5365-4b8e-8f22-cfd63f3c0d82 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:19:28.536953 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2b6160aa-86dc-4f80-93be-bb5328b589da tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:28.537413 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2b6160aa-86dc-4f80-93be-bb5328b589da tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:28.538535 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2b6160aa-86dc-4f80-93be-bb5328b589da tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:28.538971 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2b6160aa-86dc-4f80-93be-bb5328b589da tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:28.541986 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-69acd65c-5365-4b8e-8f22-cfd63f3c0d82 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:28.542479 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-69acd65c-5365-4b8e-8f22-cfd63f3c0d82 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:28.543390 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-69acd65c-5365-4b8e-8f22-cfd63f3c0d82 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:28.543983 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-69acd65c-5365-4b8e-8f22-cfd63f3c0d82 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:28.663193 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-69acd65c-5365-4b8e-8f22-cfd63f3c0d82 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "POST /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/action" status: 200 len: 28683 microversion: 2.1 time: 0.132278 Nov 01 01:19:28.663865 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 157/315] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Nov 1 01:19:28 2021] POST /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/action => generated 28683 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 01 01:19:28.673867 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-2b6160aa-86dc-4f80-93be-bb5328b589da tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:19:28.682640 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-2b6160aa-86dc-4f80-93be-bb5328b589da tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/5c06a09a-23e3-468c-9a18-d40bd3785c9d" status: 200 len: 1521 microversion: 2.1 time: 0.163538 Nov 01 01:19:28.683296 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 159/316] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:19:28 2021] GET /compute/v2.1/servers/5c06a09a-23e3-468c-9a18-d40bd3785c9d => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:19:29.052095 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-628186f6-8033-4b42-84f3-5a6b65257e30 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:19:29.052787 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-628186f6-8033-4b42-84f3-5a6b65257e30 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] [instance: 8c69967f-adef-4cdf-9db9-e3596d607641] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:19:29.059691 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-628186f6-8033-4b42-84f3-5a6b65257e30 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:29.060132 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-628186f6-8033-4b42-84f3-5a6b65257e30 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:29.060882 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-628186f6-8033-4b42-84f3-5a6b65257e30 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:29.061305 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-628186f6-8033-4b42-84f3-5a6b65257e30 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:29.187944 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-628186f6-8033-4b42-84f3-5a6b65257e30 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887cfd0993f448faafa95b4543bf5085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a22541a330f4071a6c2100f2dc47e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:19:29.196046 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-628186f6-8033-4b42-84f3-5a6b65257e30 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] 10.222.0.47 "GET /compute/v2.1/servers/8c69967f-adef-4cdf-9db9-e3596d607641" status: 200 len: 1314 microversion: 2.1 time: 0.148653 Nov 01 01:19:29.196602 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 158/317] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:19:29 2021] GET /compute/v2.1/servers/8c69967f-adef-4cdf-9db9-e3596d607641 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:19:29.675402 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-05c56416-51af-4cde-a104-6a55843d3f02 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:19:29.676584 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-05c56416-51af-4cde-a104-6a55843d3f02 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:19:29.683081 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-05c56416-51af-4cde-a104-6a55843d3f02 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:29.683531 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-05c56416-51af-4cde-a104-6a55843d3f02 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:29.684306 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-05c56416-51af-4cde-a104-6a55843d3f02 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:29.684738 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-05c56416-51af-4cde-a104-6a55843d3f02 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:29.700225 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-9e984e2c-78bd-4229-96d6-4825f220c952 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:19:29.700837 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-9e984e2c-78bd-4229-96d6-4825f220c952 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: 5c06a09a-23e3-468c-9a18-d40bd3785c9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:19:29.707862 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9e984e2c-78bd-4229-96d6-4825f220c952 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:29.710574 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9e984e2c-78bd-4229-96d6-4825f220c952 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:29.710574 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9e984e2c-78bd-4229-96d6-4825f220c952 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:29.710574 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9e984e2c-78bd-4229-96d6-4825f220c952 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:29.789408 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-05c56416-51af-4cde-a104-6a55843d3f02 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "POST /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/action" status: 200 len: 28683 microversion: 2.1 time: 0.117856 Nov 01 01:19:29.790694 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 160/318] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Nov 1 01:19:29 2021] POST /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/action => generated 28683 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 01 01:19:29.838964 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-9e984e2c-78bd-4229-96d6-4825f220c952 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:19:29.850667 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-9e984e2c-78bd-4229-96d6-4825f220c952 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/5c06a09a-23e3-468c-9a18-d40bd3785c9d" status: 200 len: 1521 microversion: 2.1 time: 0.154052 Nov 01 01:19:29.851239 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 159/319] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:19:29 2021] GET /compute/v2.1/servers/5c06a09a-23e3-468c-9a18-d40bd3785c9d => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:19:30.213573 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-6a530172-8149-45d4-9fef-443ff94960ee tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:19:30.214266 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-6a530172-8149-45d4-9fef-443ff94960ee tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] [instance: 8c69967f-adef-4cdf-9db9-e3596d607641] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:19:30.221119 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6a530172-8149-45d4-9fef-443ff94960ee tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:30.221609 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6a530172-8149-45d4-9fef-443ff94960ee tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:30.222371 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6a530172-8149-45d4-9fef-443ff94960ee tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:30.222856 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6a530172-8149-45d4-9fef-443ff94960ee tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:30.354008 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-6a530172-8149-45d4-9fef-443ff94960ee tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887cfd0993f448faafa95b4543bf5085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a22541a330f4071a6c2100f2dc47e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:19:30.364746 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-6a530172-8149-45d4-9fef-443ff94960ee tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] 10.222.0.47 "GET /compute/v2.1/servers/8c69967f-adef-4cdf-9db9-e3596d607641" status: 200 len: 1314 microversion: 2.1 time: 0.155078 Nov 01 01:19:30.365527 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 161/320] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:19:30 2021] GET /compute/v2.1/servers/8c69967f-adef-4cdf-9db9-e3596d607641 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:19:30.801799 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-9088e0cd-db5c-4584-87b1-59cedeb4eda3 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:19:30.802658 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-9088e0cd-db5c-4584-87b1-59cedeb4eda3 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:19:30.808877 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9088e0cd-db5c-4584-87b1-59cedeb4eda3 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:30.816235 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9088e0cd-db5c-4584-87b1-59cedeb4eda3 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:30.816235 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9088e0cd-db5c-4584-87b1-59cedeb4eda3 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:30.816235 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9088e0cd-db5c-4584-87b1-59cedeb4eda3 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:30.869245 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-9b70947b-c286-44e0-b1c9-424bd4fcf00a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:19:30.872480 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-9b70947b-c286-44e0-b1c9-424bd4fcf00a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: 5c06a09a-23e3-468c-9a18-d40bd3785c9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:19:30.877416 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9b70947b-c286-44e0-b1c9-424bd4fcf00a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:30.877859 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9b70947b-c286-44e0-b1c9-424bd4fcf00a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:30.878698 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9b70947b-c286-44e0-b1c9-424bd4fcf00a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:30.879757 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9b70947b-c286-44e0-b1c9-424bd4fcf00a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:30.908175 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-9088e0cd-db5c-4584-87b1-59cedeb4eda3 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "POST /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/action" status: 200 len: 28683 microversion: 2.1 time: 0.110548 Nov 01 01:19:30.913172 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 160/321] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Nov 1 01:19:30 2021] POST /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/action => generated 28683 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 01 01:19:31.007915 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-9b70947b-c286-44e0-b1c9-424bd4fcf00a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:19:31.015444 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-9b70947b-c286-44e0-b1c9-424bd4fcf00a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/5c06a09a-23e3-468c-9a18-d40bd3785c9d" status: 200 len: 1521 microversion: 2.1 time: 0.151108 Nov 01 01:19:31.016002 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 162/322] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:19:30 2021] GET /compute/v2.1/servers/5c06a09a-23e3-468c-9a18-d40bd3785c9d => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:19:31.381237 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-bd8f560d-221f-4a47-bca7-e1d3d894a41d tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:19:31.381999 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-bd8f560d-221f-4a47-bca7-e1d3d894a41d tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] [instance: 8c69967f-adef-4cdf-9db9-e3596d607641] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:19:31.388708 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-bd8f560d-221f-4a47-bca7-e1d3d894a41d tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:31.389155 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-bd8f560d-221f-4a47-bca7-e1d3d894a41d tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:31.389937 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-bd8f560d-221f-4a47-bca7-e1d3d894a41d tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:31.390359 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-bd8f560d-221f-4a47-bca7-e1d3d894a41d tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:31.515563 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-bd8f560d-221f-4a47-bca7-e1d3d894a41d tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887cfd0993f448faafa95b4543bf5085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a22541a330f4071a6c2100f2dc47e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:19:31.524693 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-bd8f560d-221f-4a47-bca7-e1d3d894a41d tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] 10.222.0.47 "GET /compute/v2.1/servers/8c69967f-adef-4cdf-9db9-e3596d607641" status: 200 len: 1314 microversion: 2.1 time: 0.147020 Nov 01 01:19:31.524846 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 161/323] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:19:31 2021] GET /compute/v2.1/servers/8c69967f-adef-4cdf-9db9-e3596d607641 => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:19:31.920836 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-8f4444cc-5bff-4573-96ca-fd86984f9c61 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:19:31.921751 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-8f4444cc-5bff-4573-96ca-fd86984f9c61 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:19:31.928089 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8f4444cc-5bff-4573-96ca-fd86984f9c61 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:31.928532 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8f4444cc-5bff-4573-96ca-fd86984f9c61 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:31.929295 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8f4444cc-5bff-4573-96ca-fd86984f9c61 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:31.929723 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8f4444cc-5bff-4573-96ca-fd86984f9c61 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:32.031317 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-8f4444cc-5bff-4573-96ca-fd86984f9c61 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "POST /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/action" status: 200 len: 28683 microversion: 2.1 time: 0.113621 Nov 01 01:19:32.033141 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 163/324] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Nov 1 01:19:31 2021] POST /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/action => generated 28683 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 01 01:19:32.035540 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-0aa25f4c-690d-47ad-b068-6d25ee7e2cd9 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:19:32.036777 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-0aa25f4c-690d-47ad-b068-6d25ee7e2cd9 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: 5c06a09a-23e3-468c-9a18-d40bd3785c9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:19:32.043505 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0aa25f4c-690d-47ad-b068-6d25ee7e2cd9 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:32.055510 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0aa25f4c-690d-47ad-b068-6d25ee7e2cd9 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:32.055510 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0aa25f4c-690d-47ad-b068-6d25ee7e2cd9 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:32.055510 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0aa25f4c-690d-47ad-b068-6d25ee7e2cd9 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:32.170132 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-0aa25f4c-690d-47ad-b068-6d25ee7e2cd9 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:19:32.177932 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-0aa25f4c-690d-47ad-b068-6d25ee7e2cd9 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/5c06a09a-23e3-468c-9a18-d40bd3785c9d" status: 200 len: 1521 microversion: 2.1 time: 0.148235 Nov 01 01:19:32.178513 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 162/325] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:19:32 2021] GET /compute/v2.1/servers/5c06a09a-23e3-468c-9a18-d40bd3785c9d => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:19:32.541377 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-0c342644-bfd8-4530-838a-05fa60e22402 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:19:32.542060 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-0c342644-bfd8-4530-838a-05fa60e22402 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] [instance: 8c69967f-adef-4cdf-9db9-e3596d607641] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:19:32.548753 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0c342644-bfd8-4530-838a-05fa60e22402 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:32.549187 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0c342644-bfd8-4530-838a-05fa60e22402 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:32.549937 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0c342644-bfd8-4530-838a-05fa60e22402 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:32.550346 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0c342644-bfd8-4530-838a-05fa60e22402 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:32.673914 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-0c342644-bfd8-4530-838a-05fa60e22402 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887cfd0993f448faafa95b4543bf5085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a22541a330f4071a6c2100f2dc47e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:19:32.681624 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-0c342644-bfd8-4530-838a-05fa60e22402 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] 10.222.0.47 "GET /compute/v2.1/servers/8c69967f-adef-4cdf-9db9-e3596d607641" status: 200 len: 1314 microversion: 2.1 time: 0.144214 Nov 01 01:19:32.682178 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 164/326] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:19:32 2021] GET /compute/v2.1/servers/8c69967f-adef-4cdf-9db9-e3596d607641 => generated 1314 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:19:33.043197 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-27662fef-9a76-42c1-bf75-2cf3e44a8950 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:19:33.044250 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-27662fef-9a76-42c1-bf75-2cf3e44a8950 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:19:33.051247 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-27662fef-9a76-42c1-bf75-2cf3e44a8950 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:33.052673 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-27662fef-9a76-42c1-bf75-2cf3e44a8950 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:33.052673 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-27662fef-9a76-42c1-bf75-2cf3e44a8950 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:33.052932 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-27662fef-9a76-42c1-bf75-2cf3e44a8950 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:33.187892 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-27662fef-9a76-42c1-bf75-2cf3e44a8950 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "POST /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/action" status: 200 len: 28683 microversion: 2.1 time: 0.148351 Nov 01 01:19:33.189761 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 163/327] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Nov 1 01:19:33 2021] POST /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/action => generated 28683 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 01 01:19:33.195702 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-e5a6c7cb-1567-4d56-bff4-e83e68602bfc tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:19:33.196303 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-e5a6c7cb-1567-4d56-bff4-e83e68602bfc tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: 5c06a09a-23e3-468c-9a18-d40bd3785c9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:19:33.202945 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e5a6c7cb-1567-4d56-bff4-e83e68602bfc tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:33.203332 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e5a6c7cb-1567-4d56-bff4-e83e68602bfc tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:33.204091 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e5a6c7cb-1567-4d56-bff4-e83e68602bfc tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:33.204519 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e5a6c7cb-1567-4d56-bff4-e83e68602bfc tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:33.353880 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-e5a6c7cb-1567-4d56-bff4-e83e68602bfc tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:19:33.369289 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-e5a6c7cb-1567-4d56-bff4-e83e68602bfc tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/5c06a09a-23e3-468c-9a18-d40bd3785c9d" status: 200 len: 1521 microversion: 2.1 time: 0.177739 Nov 01 01:19:33.380060 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 165/328] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:19:33 2021] GET /compute/v2.1/servers/5c06a09a-23e3-468c-9a18-d40bd3785c9d => generated 1521 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:19:33.698972 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-cdc31b04-4a37-49eb-a981-da38da327360 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:19:33.699793 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-cdc31b04-4a37-49eb-a981-da38da327360 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] [instance: 8c69967f-adef-4cdf-9db9-e3596d607641] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:19:33.712777 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-cdc31b04-4a37-49eb-a981-da38da327360 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:33.712777 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-cdc31b04-4a37-49eb-a981-da38da327360 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:33.712777 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-cdc31b04-4a37-49eb-a981-da38da327360 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:33.712777 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-cdc31b04-4a37-49eb-a981-da38da327360 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:34.062401 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-cdc31b04-4a37-49eb-a981-da38da327360 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887cfd0993f448faafa95b4543bf5085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a22541a330f4071a6c2100f2dc47e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:19:34.069556 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-cdc31b04-4a37-49eb-a981-da38da327360 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] 10.222.0.47 "GET /compute/v2.1/servers/8c69967f-adef-4cdf-9db9-e3596d607641" status: 200 len: 1314 microversion: 2.1 time: 0.374616 Nov 01 01:19:34.070151 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 164/329] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:19:33 2021] GET /compute/v2.1/servers/8c69967f-adef-4cdf-9db9-e3596d607641 => generated 1314 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:19:34.200180 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-201497e7-7cbc-4cd6-b0f9-472309337ed7 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:19:34.201662 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-201497e7-7cbc-4cd6-b0f9-472309337ed7 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:19:34.207635 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-201497e7-7cbc-4cd6-b0f9-472309337ed7 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:34.208077 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-201497e7-7cbc-4cd6-b0f9-472309337ed7 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:34.208833 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-201497e7-7cbc-4cd6-b0f9-472309337ed7 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:34.209256 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-201497e7-7cbc-4cd6-b0f9-472309337ed7 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:34.385874 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-df791180-a117-47fd-8aac-6d6da079b2a2 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:19:34.386510 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-df791180-a117-47fd-8aac-6d6da079b2a2 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: 5c06a09a-23e3-468c-9a18-d40bd3785c9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:19:34.392850 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-df791180-a117-47fd-8aac-6d6da079b2a2 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:34.393294 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-df791180-a117-47fd-8aac-6d6da079b2a2 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:34.394064 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-df791180-a117-47fd-8aac-6d6da079b2a2 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:34.394554 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-df791180-a117-47fd-8aac-6d6da079b2a2 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:34.478553 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-201497e7-7cbc-4cd6-b0f9-472309337ed7 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "POST /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/action" status: 200 len: 28683 microversion: 2.1 time: 0.281792 Nov 01 01:19:34.479199 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 166/330] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Nov 1 01:19:34 2021] POST /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/action => generated 28683 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 01 01:19:34.521952 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-df791180-a117-47fd-8aac-6d6da079b2a2 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:19:34.530643 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-df791180-a117-47fd-8aac-6d6da079b2a2 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/5c06a09a-23e3-468c-9a18-d40bd3785c9d" status: 200 len: 1521 microversion: 2.1 time: 0.148418 Nov 01 01:19:34.531216 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 165/331] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:19:34 2021] GET /compute/v2.1/servers/5c06a09a-23e3-468c-9a18-d40bd3785c9d => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:19:35.087129 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-e19c4bf4-22f6-4ae8-b1a4-794a51953d27 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:19:35.087817 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-e19c4bf4-22f6-4ae8-b1a4-794a51953d27 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] [instance: 8c69967f-adef-4cdf-9db9-e3596d607641] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:19:35.094641 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e19c4bf4-22f6-4ae8-b1a4-794a51953d27 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:35.095123 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e19c4bf4-22f6-4ae8-b1a4-794a51953d27 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:35.095889 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e19c4bf4-22f6-4ae8-b1a4-794a51953d27 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:35.100334 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e19c4bf4-22f6-4ae8-b1a4-794a51953d27 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:35.229270 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-e19c4bf4-22f6-4ae8-b1a4-794a51953d27 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887cfd0993f448faafa95b4543bf5085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a22541a330f4071a6c2100f2dc47e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:19:35.237190 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-e19c4bf4-22f6-4ae8-b1a4-794a51953d27 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] 10.222.0.47 "GET /compute/v2.1/servers/8c69967f-adef-4cdf-9db9-e3596d607641" status: 200 len: 1314 microversion: 2.1 time: 0.154091 Nov 01 01:19:35.237752 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 167/332] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:19:35 2021] GET /compute/v2.1/servers/8c69967f-adef-4cdf-9db9-e3596d607641 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:19:35.490811 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-d1504254-64d4-415c-91d8-28f66b9337d2 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:19:35.491770 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-d1504254-64d4-415c-91d8-28f66b9337d2 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:19:35.498242 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d1504254-64d4-415c-91d8-28f66b9337d2 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:35.498725 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d1504254-64d4-415c-91d8-28f66b9337d2 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:35.499490 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d1504254-64d4-415c-91d8-28f66b9337d2 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:35.499922 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d1504254-64d4-415c-91d8-28f66b9337d2 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:35.547609 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-94fe6640-6e07-456c-9077-67c827aef809 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:19:35.548213 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-94fe6640-6e07-456c-9077-67c827aef809 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: 5c06a09a-23e3-468c-9a18-d40bd3785c9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:19:35.556323 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-94fe6640-6e07-456c-9077-67c827aef809 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:35.557038 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-94fe6640-6e07-456c-9077-67c827aef809 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:35.557947 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-94fe6640-6e07-456c-9077-67c827aef809 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:35.558470 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-94fe6640-6e07-456c-9077-67c827aef809 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:35.683567 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-94fe6640-6e07-456c-9077-67c827aef809 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:19:35.691815 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-94fe6640-6e07-456c-9077-67c827aef809 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/5c06a09a-23e3-468c-9a18-d40bd3785c9d" status: 200 len: 1521 microversion: 2.1 time: 0.148352 Nov 01 01:19:35.692705 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 168/333] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:19:35 2021] GET /compute/v2.1/servers/5c06a09a-23e3-468c-9a18-d40bd3785c9d => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:19:36.254649 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-4fadcd5d-7655-4362-b77b-3c90c022ee16 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:19:36.255914 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-4fadcd5d-7655-4362-b77b-3c90c022ee16 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] [instance: 8c69967f-adef-4cdf-9db9-e3596d607641] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:19:36.262071 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4fadcd5d-7655-4362-b77b-3c90c022ee16 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:36.262541 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4fadcd5d-7655-4362-b77b-3c90c022ee16 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:36.263301 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4fadcd5d-7655-4362-b77b-3c90c022ee16 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:36.263730 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4fadcd5d-7655-4362-b77b-3c90c022ee16 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:36.394606 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-4fadcd5d-7655-4362-b77b-3c90c022ee16 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887cfd0993f448faafa95b4543bf5085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a22541a330f4071a6c2100f2dc47e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:19:36.401784 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-4fadcd5d-7655-4362-b77b-3c90c022ee16 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] 10.222.0.47 "GET /compute/v2.1/servers/8c69967f-adef-4cdf-9db9-e3596d607641" status: 200 len: 1314 microversion: 2.1 time: 0.151120 Nov 01 01:19:36.402458 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 169/334] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:19:36 2021] GET /compute/v2.1/servers/8c69967f-adef-4cdf-9db9-e3596d607641 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:19:36.708544 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-57e5d080-a1ba-44f1-b510-1cbd57d05977 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:19:36.709150 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-57e5d080-a1ba-44f1-b510-1cbd57d05977 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: 5c06a09a-23e3-468c-9a18-d40bd3785c9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:19:36.715091 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-57e5d080-a1ba-44f1-b510-1cbd57d05977 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:36.715533 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-57e5d080-a1ba-44f1-b510-1cbd57d05977 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:36.716290 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-57e5d080-a1ba-44f1-b510-1cbd57d05977 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:36.716718 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-57e5d080-a1ba-44f1-b510-1cbd57d05977 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:36.843097 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-57e5d080-a1ba-44f1-b510-1cbd57d05977 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:19:36.851260 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-57e5d080-a1ba-44f1-b510-1cbd57d05977 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/5c06a09a-23e3-468c-9a18-d40bd3785c9d" status: 200 len: 1521 microversion: 2.1 time: 0.146305 Nov 01 01:19:36.851896 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 170/335] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:19:36 2021] GET /compute/v2.1/servers/5c06a09a-23e3-468c-9a18-d40bd3785c9d => generated 1521 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:19:37.417705 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-4dfc5e47-90d8-49ae-9121-b8b4756070f6 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:19:37.418353 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-4dfc5e47-90d8-49ae-9121-b8b4756070f6 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] [instance: 8c69967f-adef-4cdf-9db9-e3596d607641] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:19:37.424160 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4dfc5e47-90d8-49ae-9121-b8b4756070f6 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:37.424608 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4dfc5e47-90d8-49ae-9121-b8b4756070f6 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:37.425400 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4dfc5e47-90d8-49ae-9121-b8b4756070f6 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:37.425805 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4dfc5e47-90d8-49ae-9121-b8b4756070f6 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:37.545733 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-4dfc5e47-90d8-49ae-9121-b8b4756070f6 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887cfd0993f448faafa95b4543bf5085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a22541a330f4071a6c2100f2dc47e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:19:37.553283 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-4dfc5e47-90d8-49ae-9121-b8b4756070f6 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] 10.222.0.47 "GET /compute/v2.1/servers/8c69967f-adef-4cdf-9db9-e3596d607641" status: 200 len: 1314 microversion: 2.1 time: 0.139106 Nov 01 01:19:37.553784 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 171/336] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:19:37 2021] GET /compute/v2.1/servers/8c69967f-adef-4cdf-9db9-e3596d607641 => generated 1314 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:19:37.868335 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-12b0cd78-5ff5-4830-a5fd-eaaeda5d2a02 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:19:37.869036 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-12b0cd78-5ff5-4830-a5fd-eaaeda5d2a02 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: 5c06a09a-23e3-468c-9a18-d40bd3785c9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:19:37.875164 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-12b0cd78-5ff5-4830-a5fd-eaaeda5d2a02 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:37.875616 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-12b0cd78-5ff5-4830-a5fd-eaaeda5d2a02 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:37.876382 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-12b0cd78-5ff5-4830-a5fd-eaaeda5d2a02 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:37.876812 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-12b0cd78-5ff5-4830-a5fd-eaaeda5d2a02 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:37.995329 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-12b0cd78-5ff5-4830-a5fd-eaaeda5d2a02 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:19:38.002669 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-12b0cd78-5ff5-4830-a5fd-eaaeda5d2a02 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/5c06a09a-23e3-468c-9a18-d40bd3785c9d" status: 200 len: 1521 microversion: 2.1 time: 0.138250 Nov 01 01:19:38.003222 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 172/337] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:19:37 2021] GET /compute/v2.1/servers/5c06a09a-23e3-468c-9a18-d40bd3785c9d => generated 1521 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:19:38.570200 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-23813742-b559-4217-91c3-211e8b398fe2 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:19:38.570829 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-23813742-b559-4217-91c3-211e8b398fe2 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] [instance: 8c69967f-adef-4cdf-9db9-e3596d607641] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:19:38.576607 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-23813742-b559-4217-91c3-211e8b398fe2 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:38.577054 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-23813742-b559-4217-91c3-211e8b398fe2 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:38.577814 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-23813742-b559-4217-91c3-211e8b398fe2 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:38.578240 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-23813742-b559-4217-91c3-211e8b398fe2 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:38.694351 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-23813742-b559-4217-91c3-211e8b398fe2 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887cfd0993f448faafa95b4543bf5085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a22541a330f4071a6c2100f2dc47e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:19:38.701423 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-23813742-b559-4217-91c3-211e8b398fe2 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] 10.222.0.47 "GET /compute/v2.1/servers/8c69967f-adef-4cdf-9db9-e3596d607641" status: 200 len: 1314 microversion: 2.1 time: 0.135456 Nov 01 01:19:38.701984 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 173/338] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:19:38 2021] GET /compute/v2.1/servers/8c69967f-adef-4cdf-9db9-e3596d607641 => generated 1314 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:19:39.019655 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-8bf3546a-ee9d-41fc-bb63-925df6d4fa60 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:19:39.020261 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-8bf3546a-ee9d-41fc-bb63-925df6d4fa60 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: 5c06a09a-23e3-468c-9a18-d40bd3785c9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:19:39.027070 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8bf3546a-ee9d-41fc-bb63-925df6d4fa60 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:39.027524 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8bf3546a-ee9d-41fc-bb63-925df6d4fa60 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:39.028291 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8bf3546a-ee9d-41fc-bb63-925df6d4fa60 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:39.028722 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8bf3546a-ee9d-41fc-bb63-925df6d4fa60 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:39.151136 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-8bf3546a-ee9d-41fc-bb63-925df6d4fa60 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:19:39.158295 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-8bf3546a-ee9d-41fc-bb63-925df6d4fa60 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/5c06a09a-23e3-468c-9a18-d40bd3785c9d" status: 200 len: 1521 microversion: 2.1 time: 0.142296 Nov 01 01:19:39.158887 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 174/339] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:19:39 2021] GET /compute/v2.1/servers/5c06a09a-23e3-468c-9a18-d40bd3785c9d => generated 1521 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:19:39.717512 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-48e71a31-bc6c-45a9-98e3-a8b144a09a32 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:19:39.718127 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-48e71a31-bc6c-45a9-98e3-a8b144a09a32 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] [instance: 8c69967f-adef-4cdf-9db9-e3596d607641] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:19:39.723845 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-48e71a31-bc6c-45a9-98e3-a8b144a09a32 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:39.724289 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-48e71a31-bc6c-45a9-98e3-a8b144a09a32 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:39.725042 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-48e71a31-bc6c-45a9-98e3-a8b144a09a32 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:39.725472 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-48e71a31-bc6c-45a9-98e3-a8b144a09a32 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:39.840843 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-48e71a31-bc6c-45a9-98e3-a8b144a09a32 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887cfd0993f448faafa95b4543bf5085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a22541a330f4071a6c2100f2dc47e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:19:39.847948 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-48e71a31-bc6c-45a9-98e3-a8b144a09a32 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] 10.222.0.47 "GET /compute/v2.1/servers/8c69967f-adef-4cdf-9db9-e3596d607641" status: 200 len: 1314 microversion: 2.1 time: 0.134021 Nov 01 01:19:39.848510 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 175/340] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:19:39 2021] GET /compute/v2.1/servers/8c69967f-adef-4cdf-9db9-e3596d607641 => generated 1314 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:19:40.175392 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-1b699a0a-9639-471c-ae4a-6877996f308e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:19:40.176000 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-1b699a0a-9639-471c-ae4a-6877996f308e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: 5c06a09a-23e3-468c-9a18-d40bd3785c9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:19:40.182793 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1b699a0a-9639-471c-ae4a-6877996f308e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:40.183236 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1b699a0a-9639-471c-ae4a-6877996f308e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:40.183992 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1b699a0a-9639-471c-ae4a-6877996f308e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:40.184468 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1b699a0a-9639-471c-ae4a-6877996f308e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:40.299718 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-1b699a0a-9639-471c-ae4a-6877996f308e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:19:40.306906 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-1b699a0a-9639-471c-ae4a-6877996f308e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/5c06a09a-23e3-468c-9a18-d40bd3785c9d" status: 200 len: 1521 microversion: 2.1 time: 0.135107 Nov 01 01:19:40.307466 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 176/341] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:19:40 2021] GET /compute/v2.1/servers/5c06a09a-23e3-468c-9a18-d40bd3785c9d => generated 1521 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:19:40.864297 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-d5537255-46f5-4bb2-b1df-85771985a57b tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:19:40.864887 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-d5537255-46f5-4bb2-b1df-85771985a57b tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] [instance: 8c69967f-adef-4cdf-9db9-e3596d607641] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:19:40.871598 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d5537255-46f5-4bb2-b1df-85771985a57b tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:40.872042 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d5537255-46f5-4bb2-b1df-85771985a57b tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:40.872797 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d5537255-46f5-4bb2-b1df-85771985a57b tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:40.873225 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d5537255-46f5-4bb2-b1df-85771985a57b tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:40.992001 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-d5537255-46f5-4bb2-b1df-85771985a57b tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887cfd0993f448faafa95b4543bf5085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a22541a330f4071a6c2100f2dc47e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:19:40.999388 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-d5537255-46f5-4bb2-b1df-85771985a57b tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] 10.222.0.47 "GET /compute/v2.1/servers/8c69967f-adef-4cdf-9db9-e3596d607641" status: 200 len: 1314 microversion: 2.1 time: 0.138722 Nov 01 01:19:41.000152 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 177/342] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:19:40 2021] GET /compute/v2.1/servers/8c69967f-adef-4cdf-9db9-e3596d607641 => generated 1314 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:19:41.183256 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-d1504254-64d4-415c-91d8-28f66b9337d2 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "POST /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/action" status: 200 len: 28683 microversion: 2.1 time: 5.696566 Nov 01 01:19:41.186464 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 166/343] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Nov 1 01:19:35 2021] POST /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/action => generated 28683 bytes in 5698 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 01 01:19:41.323388 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-3c26a92d-9c3d-4bec-9546-e0da7cafbaee tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:19:41.324136 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-3c26a92d-9c3d-4bec-9546-e0da7cafbaee tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: 5c06a09a-23e3-468c-9a18-d40bd3785c9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:19:41.331745 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3c26a92d-9c3d-4bec-9546-e0da7cafbaee tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:41.332192 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3c26a92d-9c3d-4bec-9546-e0da7cafbaee tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:41.333244 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3c26a92d-9c3d-4bec-9546-e0da7cafbaee tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:41.333724 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3c26a92d-9c3d-4bec-9546-e0da7cafbaee tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:41.451097 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-3c26a92d-9c3d-4bec-9546-e0da7cafbaee tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:19:41.458173 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-3c26a92d-9c3d-4bec-9546-e0da7cafbaee tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/5c06a09a-23e3-468c-9a18-d40bd3785c9d" status: 200 len: 1521 microversion: 2.1 time: 0.138667 Nov 01 01:19:41.458757 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 178/344] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:19:41 2021] GET /compute/v2.1/servers/5c06a09a-23e3-468c-9a18-d40bd3785c9d => generated 1521 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:19:42.016520 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-102b03a4-c73e-43e8-b772-bf1c29ecd6f1 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:19:42.017210 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-102b03a4-c73e-43e8-b772-bf1c29ecd6f1 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] [instance: 8c69967f-adef-4cdf-9db9-e3596d607641] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:19:42.024462 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-102b03a4-c73e-43e8-b772-bf1c29ecd6f1 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:42.024908 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-102b03a4-c73e-43e8-b772-bf1c29ecd6f1 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:42.025675 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-102b03a4-c73e-43e8-b772-bf1c29ecd6f1 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:42.026102 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-102b03a4-c73e-43e8-b772-bf1c29ecd6f1 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:42.149032 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-102b03a4-c73e-43e8-b772-bf1c29ecd6f1 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887cfd0993f448faafa95b4543bf5085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a22541a330f4071a6c2100f2dc47e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:19:42.156772 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-102b03a4-c73e-43e8-b772-bf1c29ecd6f1 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] 10.222.0.47 "GET /compute/v2.1/servers/8c69967f-adef-4cdf-9db9-e3596d607641" status: 200 len: 1314 microversion: 2.1 time: 0.144300 Nov 01 01:19:42.157335 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 167/345] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:19:42 2021] GET /compute/v2.1/servers/8c69967f-adef-4cdf-9db9-e3596d607641 => generated 1314 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:19:42.195392 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-dd5e401c-0129-4852-af22-a3bd360ad81d tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:19:42.196250 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-dd5e401c-0129-4852-af22-a3bd360ad81d tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:19:42.202215 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-dd5e401c-0129-4852-af22-a3bd360ad81d tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:42.202694 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-dd5e401c-0129-4852-af22-a3bd360ad81d tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:42.203461 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-dd5e401c-0129-4852-af22-a3bd360ad81d tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:42.203886 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-dd5e401c-0129-4852-af22-a3bd360ad81d tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:42.435467 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-dd5e401c-0129-4852-af22-a3bd360ad81d tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "POST /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/action" status: 200 len: 28683 microversion: 2.1 time: 0.244237 Nov 01 01:19:42.436114 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 179/346] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Nov 1 01:19:42 2021] POST /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/action => generated 28683 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 01 01:19:42.476099 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-45a8c86b-81fe-4b5d-8edf-c933a29228b5 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:19:42.476614 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-45a8c86b-81fe-4b5d-8edf-c933a29228b5 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: 5c06a09a-23e3-468c-9a18-d40bd3785c9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:19:42.482870 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-45a8c86b-81fe-4b5d-8edf-c933a29228b5 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:42.483304 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-45a8c86b-81fe-4b5d-8edf-c933a29228b5 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:42.484065 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-45a8c86b-81fe-4b5d-8edf-c933a29228b5 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:42.484493 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-45a8c86b-81fe-4b5d-8edf-c933a29228b5 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:42.624686 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-45a8c86b-81fe-4b5d-8edf-c933a29228b5 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:19:42.632079 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-45a8c86b-81fe-4b5d-8edf-c933a29228b5 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/5c06a09a-23e3-468c-9a18-d40bd3785c9d" status: 200 len: 1521 microversion: 2.1 time: 0.160208 Nov 01 01:19:42.632652 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 168/347] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:19:42 2021] GET /compute/v2.1/servers/5c06a09a-23e3-468c-9a18-d40bd3785c9d => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:19:43.173888 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-43b5f5ca-3aef-4955-bb66-f95cff23100d tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:19:43.174632 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-43b5f5ca-3aef-4955-bb66-f95cff23100d tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] [instance: 8c69967f-adef-4cdf-9db9-e3596d607641] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:19:43.183343 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-43b5f5ca-3aef-4955-bb66-f95cff23100d tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:43.183846 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-43b5f5ca-3aef-4955-bb66-f95cff23100d tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:43.184711 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-43b5f5ca-3aef-4955-bb66-f95cff23100d tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:43.185157 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-43b5f5ca-3aef-4955-bb66-f95cff23100d tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:43.315008 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-43b5f5ca-3aef-4955-bb66-f95cff23100d tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887cfd0993f448faafa95b4543bf5085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a22541a330f4071a6c2100f2dc47e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:19:43.326099 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-43b5f5ca-3aef-4955-bb66-f95cff23100d tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] 10.222.0.47 "GET /compute/v2.1/servers/8c69967f-adef-4cdf-9db9-e3596d607641" status: 200 len: 1314 microversion: 2.1 time: 0.156425 Nov 01 01:19:43.326832 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 180/348] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:19:43 2021] GET /compute/v2.1/servers/8c69967f-adef-4cdf-9db9-e3596d607641 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:19:43.447769 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-f895872f-9dfc-4389-90f7-f8728ac6f6eb tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:19:43.448772 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-f895872f-9dfc-4389-90f7-f8728ac6f6eb tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:19:43.454878 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f895872f-9dfc-4389-90f7-f8728ac6f6eb tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:43.459298 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f895872f-9dfc-4389-90f7-f8728ac6f6eb tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:43.459298 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f895872f-9dfc-4389-90f7-f8728ac6f6eb tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:43.459298 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f895872f-9dfc-4389-90f7-f8728ac6f6eb tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:43.554412 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-f895872f-9dfc-4389-90f7-f8728ac6f6eb tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "POST /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/action" status: 200 len: 28683 microversion: 2.1 time: 0.110102 Nov 01 01:19:43.558801 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 169/349] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Nov 1 01:19:43 2021] POST /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/action => generated 28683 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 01 01:19:43.649124 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-bbde204d-9fc1-4143-b548-99b5590803b4 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:19:43.649761 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-bbde204d-9fc1-4143-b548-99b5590803b4 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: 5c06a09a-23e3-468c-9a18-d40bd3785c9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:19:43.656058 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-bbde204d-9fc1-4143-b548-99b5590803b4 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:43.656487 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-bbde204d-9fc1-4143-b548-99b5590803b4 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:43.657173 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-bbde204d-9fc1-4143-b548-99b5590803b4 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:43.657602 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-bbde204d-9fc1-4143-b548-99b5590803b4 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:43.780924 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-bbde204d-9fc1-4143-b548-99b5590803b4 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:19:43.788311 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-bbde204d-9fc1-4143-b548-99b5590803b4 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/5c06a09a-23e3-468c-9a18-d40bd3785c9d" status: 200 len: 1521 microversion: 2.1 time: 0.143205 Nov 01 01:19:43.788881 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 181/350] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:19:43 2021] GET /compute/v2.1/servers/5c06a09a-23e3-468c-9a18-d40bd3785c9d => generated 1521 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:19:44.346031 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-13082e26-35a0-4b1f-a456-5bc6334d5256 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:19:44.346980 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-13082e26-35a0-4b1f-a456-5bc6334d5256 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] [instance: 8c69967f-adef-4cdf-9db9-e3596d607641] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:19:44.360115 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-13082e26-35a0-4b1f-a456-5bc6334d5256 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:44.360115 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-13082e26-35a0-4b1f-a456-5bc6334d5256 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:44.362280 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-13082e26-35a0-4b1f-a456-5bc6334d5256 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:44.362280 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-13082e26-35a0-4b1f-a456-5bc6334d5256 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:44.518759 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-13082e26-35a0-4b1f-a456-5bc6334d5256 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887cfd0993f448faafa95b4543bf5085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a22541a330f4071a6c2100f2dc47e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:19:44.526580 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-13082e26-35a0-4b1f-a456-5bc6334d5256 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] 10.222.0.47 "GET /compute/v2.1/servers/8c69967f-adef-4cdf-9db9-e3596d607641" status: 200 len: 1314 microversion: 2.1 time: 0.185316 Nov 01 01:19:44.527144 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 170/351] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:19:44 2021] GET /compute/v2.1/servers/8c69967f-adef-4cdf-9db9-e3596d607641 => generated 1314 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:19:44.567109 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-235c4025-5062-4d8f-8f1a-77e893d8a2a8 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:19:44.568035 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-235c4025-5062-4d8f-8f1a-77e893d8a2a8 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:19:44.574970 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-235c4025-5062-4d8f-8f1a-77e893d8a2a8 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:44.575420 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-235c4025-5062-4d8f-8f1a-77e893d8a2a8 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:44.576189 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-235c4025-5062-4d8f-8f1a-77e893d8a2a8 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:44.576630 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-235c4025-5062-4d8f-8f1a-77e893d8a2a8 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:44.695356 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-235c4025-5062-4d8f-8f1a-77e893d8a2a8 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "POST /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/action" status: 200 len: 28683 microversion: 2.1 time: 0.131662 Nov 01 01:19:44.697118 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 182/352] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Nov 1 01:19:44 2021] POST /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/action => generated 28683 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 01 01:19:44.806901 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-161d7216-1f7f-4cea-87ff-38eb2d558ca0 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:19:44.807496 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-161d7216-1f7f-4cea-87ff-38eb2d558ca0 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: 5c06a09a-23e3-468c-9a18-d40bd3785c9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:19:44.813787 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-161d7216-1f7f-4cea-87ff-38eb2d558ca0 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:44.814232 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-161d7216-1f7f-4cea-87ff-38eb2d558ca0 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:44.815025 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-161d7216-1f7f-4cea-87ff-38eb2d558ca0 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:44.815456 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-161d7216-1f7f-4cea-87ff-38eb2d558ca0 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:44.932353 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-161d7216-1f7f-4cea-87ff-38eb2d558ca0 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:19:44.939586 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-161d7216-1f7f-4cea-87ff-38eb2d558ca0 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/5c06a09a-23e3-468c-9a18-d40bd3785c9d" status: 200 len: 1521 microversion: 2.1 time: 0.137091 Nov 01 01:19:44.940149 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 171/353] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:19:44 2021] GET /compute/v2.1/servers/5c06a09a-23e3-468c-9a18-d40bd3785c9d => generated 1521 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:19:45.551092 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-617112b7-85ee-442c-9505-1b3aef3e1b20 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:19:45.551788 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-617112b7-85ee-442c-9505-1b3aef3e1b20 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] [instance: 8c69967f-adef-4cdf-9db9-e3596d607641] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:19:45.558673 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-617112b7-85ee-442c-9505-1b3aef3e1b20 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:45.559120 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-617112b7-85ee-442c-9505-1b3aef3e1b20 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:45.559878 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-617112b7-85ee-442c-9505-1b3aef3e1b20 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:45.560305 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-617112b7-85ee-442c-9505-1b3aef3e1b20 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:45.685097 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-617112b7-85ee-442c-9505-1b3aef3e1b20 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887cfd0993f448faafa95b4543bf5085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a22541a330f4071a6c2100f2dc47e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:19:45.692736 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-617112b7-85ee-442c-9505-1b3aef3e1b20 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] 10.222.0.47 "GET /compute/v2.1/servers/8c69967f-adef-4cdf-9db9-e3596d607641" status: 200 len: 1314 microversion: 2.1 time: 0.145599 Nov 01 01:19:45.693406 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 183/354] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:19:45 2021] GET /compute/v2.1/servers/8c69967f-adef-4cdf-9db9-e3596d607641 => generated 1314 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:19:45.707063 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-8fc80555-ad8f-4c7a-9c50-daa5dd35d3ed tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:19:45.708039 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-8fc80555-ad8f-4c7a-9c50-daa5dd35d3ed tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:19:45.715025 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8fc80555-ad8f-4c7a-9c50-daa5dd35d3ed tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:45.715469 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8fc80555-ad8f-4c7a-9c50-daa5dd35d3ed tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:45.716230 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8fc80555-ad8f-4c7a-9c50-daa5dd35d3ed tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:45.716663 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8fc80555-ad8f-4c7a-9c50-daa5dd35d3ed tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:45.956453 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-dc604eca-283f-44e5-b62c-a6d34eb3382f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:19:45.957077 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-dc604eca-283f-44e5-b62c-a6d34eb3382f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: 5c06a09a-23e3-468c-9a18-d40bd3785c9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:19:45.963648 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-dc604eca-283f-44e5-b62c-a6d34eb3382f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:45.964094 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-dc604eca-283f-44e5-b62c-a6d34eb3382f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:45.964869 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-dc604eca-283f-44e5-b62c-a6d34eb3382f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:45.965301 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-dc604eca-283f-44e5-b62c-a6d34eb3382f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:46.089036 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-dc604eca-283f-44e5-b62c-a6d34eb3382f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:19:46.096316 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-dc604eca-283f-44e5-b62c-a6d34eb3382f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/5c06a09a-23e3-468c-9a18-d40bd3785c9d" status: 200 len: 1521 microversion: 2.1 time: 0.143759 Nov 01 01:19:46.096870 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 184/355] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:19:45 2021] GET /compute/v2.1/servers/5c06a09a-23e3-468c-9a18-d40bd3785c9d => generated 1521 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:19:46.709073 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-7fb630dc-92a1-4f87-a6d8-09ef32c4fa98 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:19:46.709764 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-7fb630dc-92a1-4f87-a6d8-09ef32c4fa98 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] [instance: 8c69967f-adef-4cdf-9db9-e3596d607641] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:19:46.716177 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7fb630dc-92a1-4f87-a6d8-09ef32c4fa98 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:46.716631 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7fb630dc-92a1-4f87-a6d8-09ef32c4fa98 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:46.717392 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7fb630dc-92a1-4f87-a6d8-09ef32c4fa98 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:46.717822 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7fb630dc-92a1-4f87-a6d8-09ef32c4fa98 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:46.850982 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-7fb630dc-92a1-4f87-a6d8-09ef32c4fa98 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887cfd0993f448faafa95b4543bf5085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a22541a330f4071a6c2100f2dc47e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:19:46.865562 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-7fb630dc-92a1-4f87-a6d8-09ef32c4fa98 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] 10.222.0.47 "GET /compute/v2.1/servers/8c69967f-adef-4cdf-9db9-e3596d607641" status: 200 len: 1314 microversion: 2.1 time: 0.160243 Nov 01 01:19:46.866744 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 185/356] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:19:46 2021] GET /compute/v2.1/servers/8c69967f-adef-4cdf-9db9-e3596d607641 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:19:47.114090 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-664374b1-2add-4ebc-9efe-983ee74f5f37 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:19:47.114745 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-664374b1-2add-4ebc-9efe-983ee74f5f37 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: 5c06a09a-23e3-468c-9a18-d40bd3785c9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:19:47.123196 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-664374b1-2add-4ebc-9efe-983ee74f5f37 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:47.123641 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-664374b1-2add-4ebc-9efe-983ee74f5f37 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:47.124415 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-664374b1-2add-4ebc-9efe-983ee74f5f37 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:47.124845 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-664374b1-2add-4ebc-9efe-983ee74f5f37 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:47.249695 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-664374b1-2add-4ebc-9efe-983ee74f5f37 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:19:47.261961 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-664374b1-2add-4ebc-9efe-983ee74f5f37 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/5c06a09a-23e3-468c-9a18-d40bd3785c9d" status: 200 len: 1521 microversion: 2.1 time: 0.151750 Nov 01 01:19:47.262545 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 186/357] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:19:47 2021] GET /compute/v2.1/servers/5c06a09a-23e3-468c-9a18-d40bd3785c9d => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:19:47.891642 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-1b27812b-c313-40f8-a31c-9d14fec31ee6 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:19:47.892244 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-1b27812b-c313-40f8-a31c-9d14fec31ee6 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] [instance: 8c69967f-adef-4cdf-9db9-e3596d607641] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:19:47.897948 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1b27812b-c313-40f8-a31c-9d14fec31ee6 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:47.898386 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1b27812b-c313-40f8-a31c-9d14fec31ee6 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:47.899165 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1b27812b-c313-40f8-a31c-9d14fec31ee6 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:47.899587 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1b27812b-c313-40f8-a31c-9d14fec31ee6 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:48.025425 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-1b27812b-c313-40f8-a31c-9d14fec31ee6 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887cfd0993f448faafa95b4543bf5085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a22541a330f4071a6c2100f2dc47e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:19:48.032631 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-1b27812b-c313-40f8-a31c-9d14fec31ee6 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] 10.222.0.47 "GET /compute/v2.1/servers/8c69967f-adef-4cdf-9db9-e3596d607641" status: 200 len: 1314 microversion: 2.1 time: 0.144587 Nov 01 01:19:48.033184 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 187/358] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:19:47 2021] GET /compute/v2.1/servers/8c69967f-adef-4cdf-9db9-e3596d607641 => generated 1314 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:19:48.278416 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-c2f9acf7-91ad-4d5f-851e-080948fe4ec3 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:19:48.278971 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-c2f9acf7-91ad-4d5f-851e-080948fe4ec3 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: 5c06a09a-23e3-468c-9a18-d40bd3785c9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:19:48.285059 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c2f9acf7-91ad-4d5f-851e-080948fe4ec3 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:48.285502 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c2f9acf7-91ad-4d5f-851e-080948fe4ec3 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:48.286262 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c2f9acf7-91ad-4d5f-851e-080948fe4ec3 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:48.286728 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c2f9acf7-91ad-4d5f-851e-080948fe4ec3 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:48.405559 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-c2f9acf7-91ad-4d5f-851e-080948fe4ec3 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:19:48.412743 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-c2f9acf7-91ad-4d5f-851e-080948fe4ec3 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/5c06a09a-23e3-468c-9a18-d40bd3785c9d" status: 200 len: 1521 microversion: 2.1 time: 0.137940 Nov 01 01:19:48.413303 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 188/359] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:19:48 2021] GET /compute/v2.1/servers/5c06a09a-23e3-468c-9a18-d40bd3785c9d => generated 1521 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:19:49.048700 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-f4127094-a444-4e81-af25-b14c478bd0dd tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:19:49.049343 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-f4127094-a444-4e81-af25-b14c478bd0dd tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] [instance: 8c69967f-adef-4cdf-9db9-e3596d607641] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:19:49.055700 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f4127094-a444-4e81-af25-b14c478bd0dd tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:49.056079 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f4127094-a444-4e81-af25-b14c478bd0dd tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:49.056832 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f4127094-a444-4e81-af25-b14c478bd0dd tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:49.057255 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f4127094-a444-4e81-af25-b14c478bd0dd tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:49.173686 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-f4127094-a444-4e81-af25-b14c478bd0dd tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887cfd0993f448faafa95b4543bf5085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a22541a330f4071a6c2100f2dc47e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:19:49.181579 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-f4127094-a444-4e81-af25-b14c478bd0dd tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] 10.222.0.47 "GET /compute/v2.1/servers/8c69967f-adef-4cdf-9db9-e3596d607641" status: 200 len: 1314 microversion: 2.1 time: 0.136422 Nov 01 01:19:49.182149 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 189/360] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:19:49 2021] GET /compute/v2.1/servers/8c69967f-adef-4cdf-9db9-e3596d607641 => generated 1314 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:19:49.429445 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-2de99a10-99c9-41e4-8d65-53647b329771 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:19:49.430120 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-2de99a10-99c9-41e4-8d65-53647b329771 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: 5c06a09a-23e3-468c-9a18-d40bd3785c9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:19:49.436309 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2de99a10-99c9-41e4-8d65-53647b329771 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:49.436751 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2de99a10-99c9-41e4-8d65-53647b329771 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:49.437504 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2de99a10-99c9-41e4-8d65-53647b329771 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:49.437928 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2de99a10-99c9-41e4-8d65-53647b329771 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:49.560230 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-2de99a10-99c9-41e4-8d65-53647b329771 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:19:49.567304 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-2de99a10-99c9-41e4-8d65-53647b329771 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/5c06a09a-23e3-468c-9a18-d40bd3785c9d" status: 200 len: 1521 microversion: 2.1 time: 0.142146 Nov 01 01:19:49.567857 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 190/361] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:19:49 2021] GET /compute/v2.1/servers/5c06a09a-23e3-468c-9a18-d40bd3785c9d => generated 1521 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:19:50.198536 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-a46fbf7f-2dad-46ea-bd8d-3dfbc6a3fbdc tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:19:50.199166 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-a46fbf7f-2dad-46ea-bd8d-3dfbc6a3fbdc tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] [instance: 8c69967f-adef-4cdf-9db9-e3596d607641] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:19:50.204813 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a46fbf7f-2dad-46ea-bd8d-3dfbc6a3fbdc tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:50.205255 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a46fbf7f-2dad-46ea-bd8d-3dfbc6a3fbdc tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:50.206006 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a46fbf7f-2dad-46ea-bd8d-3dfbc6a3fbdc tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:50.206451 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a46fbf7f-2dad-46ea-bd8d-3dfbc6a3fbdc tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:50.323376 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-a46fbf7f-2dad-46ea-bd8d-3dfbc6a3fbdc tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887cfd0993f448faafa95b4543bf5085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a22541a330f4071a6c2100f2dc47e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:19:50.330367 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-a46fbf7f-2dad-46ea-bd8d-3dfbc6a3fbdc tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] 10.222.0.47 "GET /compute/v2.1/servers/8c69967f-adef-4cdf-9db9-e3596d607641" status: 200 len: 1314 microversion: 2.1 time: 0.135514 Nov 01 01:19:50.330949 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 191/362] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:19:50 2021] GET /compute/v2.1/servers/8c69967f-adef-4cdf-9db9-e3596d607641 => generated 1314 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:19:50.463116 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-8fc80555-ad8f-4c7a-9c50-daa5dd35d3ed tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "POST /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/action" status: 200 len: 28683 microversion: 2.1 time: 4.759540 Nov 01 01:19:50.463801 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 172/363] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Nov 1 01:19:45 2021] POST /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/action => generated 28683 bytes in 4761 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 01 01:19:50.583541 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-6dd7b267-56f0-4e10-a56e-252295fb2431 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:19:50.584136 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-6dd7b267-56f0-4e10-a56e-252295fb2431 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: 5c06a09a-23e3-468c-9a18-d40bd3785c9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:19:50.590203 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6dd7b267-56f0-4e10-a56e-252295fb2431 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:50.590677 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6dd7b267-56f0-4e10-a56e-252295fb2431 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:50.591430 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6dd7b267-56f0-4e10-a56e-252295fb2431 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:50.591850 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6dd7b267-56f0-4e10-a56e-252295fb2431 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:50.710452 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-6dd7b267-56f0-4e10-a56e-252295fb2431 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:19:50.717642 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-6dd7b267-56f0-4e10-a56e-252295fb2431 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/5c06a09a-23e3-468c-9a18-d40bd3785c9d" status: 200 len: 1521 microversion: 2.1 time: 0.137704 Nov 01 01:19:50.718196 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 192/364] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:19:50 2021] GET /compute/v2.1/servers/5c06a09a-23e3-468c-9a18-d40bd3785c9d => generated 1521 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:19:51.347449 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-cd07465f-65ba-4267-a591-27c9c3db02a6 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:19:51.348119 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-cd07465f-65ba-4267-a591-27c9c3db02a6 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] [instance: 8c69967f-adef-4cdf-9db9-e3596d607641] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:19:51.354951 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-cd07465f-65ba-4267-a591-27c9c3db02a6 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:51.355408 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-cd07465f-65ba-4267-a591-27c9c3db02a6 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:51.356165 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-cd07465f-65ba-4267-a591-27c9c3db02a6 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:51.356582 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-cd07465f-65ba-4267-a591-27c9c3db02a6 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:51.475093 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-26f77c31-f9bf-4cb4-a4dd-7f67f9ed574a tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:19:51.476104 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-26f77c31-f9bf-4cb4-a4dd-7f67f9ed574a tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:19:51.481964 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-26f77c31-f9bf-4cb4-a4dd-7f67f9ed574a tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:51.482403 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-26f77c31-f9bf-4cb4-a4dd-7f67f9ed574a tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:51.483487 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-26f77c31-f9bf-4cb4-a4dd-7f67f9ed574a tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:51.484135 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-26f77c31-f9bf-4cb4-a4dd-7f67f9ed574a tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:51.500176 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-cd07465f-65ba-4267-a591-27c9c3db02a6 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887cfd0993f448faafa95b4543bf5085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a22541a330f4071a6c2100f2dc47e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:19:51.508479 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-cd07465f-65ba-4267-a591-27c9c3db02a6 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] 10.222.0.47 "GET /compute/v2.1/servers/8c69967f-adef-4cdf-9db9-e3596d607641" status: 200 len: 1314 microversion: 2.1 time: 0.165044 Nov 01 01:19:51.509048 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 173/365] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:19:51 2021] GET /compute/v2.1/servers/8c69967f-adef-4cdf-9db9-e3596d607641 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:19:51.585448 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-26f77c31-f9bf-4cb4-a4dd-7f67f9ed574a tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "POST /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/action" status: 200 len: 28683 microversion: 2.1 time: 0.113416 Nov 01 01:19:51.586346 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 193/366] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Nov 1 01:19:51 2021] POST /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/action => generated 28683 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 01 01:19:51.702972 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [req-b7c5e87f-9511-4eb4-a310-c58be590eed2 req-2f4eb149-8308-411c-90fe-0e57b91f6136 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c69967f-adef-4cdf-9db9-e3596d607641", "name": "network-vif-plugged", "status": "completed", "tag": "e5a085ab-aefa-4bb0-8f93-856a427e17b3"}]} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:19:51.704495 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 01 01:19:51.704495 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: warnings.warn(msg) Nov 01 01:19:51.712035 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [req-b7c5e87f-9511-4eb4-a310-c58be590eed2 req-2f4eb149-8308-411c-90fe-0e57b91f6136 service nova] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:51.713362 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [req-b7c5e87f-9511-4eb4-a310-c58be590eed2 req-2f4eb149-8308-411c-90fe-0e57b91f6136 service nova] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:51.723505 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.compute.server_external_events [req-b7c5e87f-9511-4eb4-a310-c58be590eed2 req-2f4eb149-8308-411c-90fe-0e57b91f6136 service nova] Creating event network-vif-plugged:e5a085ab-aefa-4bb0-8f93-856a427e17b3 for instance 8c69967f-adef-4cdf-9db9-e3596d607641 on hv-cinder-81561 Nov 01 01:19:51.729088 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [req-b7c5e87f-9511-4eb4-a310-c58be590eed2 req-2f4eb149-8308-411c-90fe-0e57b91f6136 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029789 Nov 01 01:19:51.729664 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 174/367] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Nov 1 01:19:51 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:19:51.735279 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-839689e8-5575-4fa4-a196-bf9f205b8e45 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:19:51.736401 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-839689e8-5575-4fa4-a196-bf9f205b8e45 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: 5c06a09a-23e3-468c-9a18-d40bd3785c9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:19:51.743022 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-839689e8-5575-4fa4-a196-bf9f205b8e45 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:51.743468 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-839689e8-5575-4fa4-a196-bf9f205b8e45 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:51.744228 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-839689e8-5575-4fa4-a196-bf9f205b8e45 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:51.744654 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-839689e8-5575-4fa4-a196-bf9f205b8e45 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:51.878979 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-839689e8-5575-4fa4-a196-bf9f205b8e45 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:19:51.887086 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-839689e8-5575-4fa4-a196-bf9f205b8e45 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/5c06a09a-23e3-468c-9a18-d40bd3785c9d" status: 200 len: 1521 microversion: 2.1 time: 0.154931 Nov 01 01:19:51.887086 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 194/368] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:19:51 2021] GET /compute/v2.1/servers/5c06a09a-23e3-468c-9a18-d40bd3785c9d => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:19:52.526411 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-68be3dfe-f496-41f0-a8fa-74edfecb6806 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:19:52.527086 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-68be3dfe-f496-41f0-a8fa-74edfecb6806 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] [instance: 8c69967f-adef-4cdf-9db9-e3596d607641] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:19:52.532966 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-68be3dfe-f496-41f0-a8fa-74edfecb6806 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:52.533410 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-68be3dfe-f496-41f0-a8fa-74edfecb6806 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:52.534167 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-68be3dfe-f496-41f0-a8fa-74edfecb6806 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:52.534650 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-68be3dfe-f496-41f0-a8fa-74edfecb6806 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:52.597276 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-e07281f7-c945-4cd6-9003-191a30dd1d21 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:19:52.598296 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-e07281f7-c945-4cd6-9003-191a30dd1d21 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:19:52.604682 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e07281f7-c945-4cd6-9003-191a30dd1d21 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:52.605326 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e07281f7-c945-4cd6-9003-191a30dd1d21 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:52.606292 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e07281f7-c945-4cd6-9003-191a30dd1d21 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:52.606787 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e07281f7-c945-4cd6-9003-191a30dd1d21 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:52.660251 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-68be3dfe-f496-41f0-a8fa-74edfecb6806 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887cfd0993f448faafa95b4543bf5085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a22541a330f4071a6c2100f2dc47e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:19:52.667500 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-68be3dfe-f496-41f0-a8fa-74edfecb6806 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] 10.222.0.47 "GET /compute/v2.1/servers/8c69967f-adef-4cdf-9db9-e3596d607641" status: 200 len: 1314 microversion: 2.1 time: 0.145663 Nov 01 01:19:52.668058 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 175/369] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:19:52 2021] GET /compute/v2.1/servers/8c69967f-adef-4cdf-9db9-e3596d607641 => generated 1314 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:19:52.903285 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-c1c39690-730c-4142-9608-2400197cec94 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:19:52.903810 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-c1c39690-730c-4142-9608-2400197cec94 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: 5c06a09a-23e3-468c-9a18-d40bd3785c9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:19:52.909715 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c1c39690-730c-4142-9608-2400197cec94 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:52.910153 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c1c39690-730c-4142-9608-2400197cec94 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:52.910941 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c1c39690-730c-4142-9608-2400197cec94 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:52.911362 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c1c39690-730c-4142-9608-2400197cec94 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:53.036299 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-c1c39690-730c-4142-9608-2400197cec94 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:19:53.044931 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-c1c39690-730c-4142-9608-2400197cec94 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/5c06a09a-23e3-468c-9a18-d40bd3785c9d" status: 200 len: 1521 microversion: 2.1 time: 0.145342 Nov 01 01:19:53.045491 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 176/370] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:19:52 2021] GET /compute/v2.1/servers/5c06a09a-23e3-468c-9a18-d40bd3785c9d => generated 1521 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:19:53.684338 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-ab76357e-95d5-4cb8-9722-6f88f0eed17f tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:19:53.684940 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-ab76357e-95d5-4cb8-9722-6f88f0eed17f tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] [instance: 8c69967f-adef-4cdf-9db9-e3596d607641] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:19:53.690852 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ab76357e-95d5-4cb8-9722-6f88f0eed17f tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:53.691300 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ab76357e-95d5-4cb8-9722-6f88f0eed17f tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:53.692057 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ab76357e-95d5-4cb8-9722-6f88f0eed17f tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:53.692490 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ab76357e-95d5-4cb8-9722-6f88f0eed17f tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:53.808483 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-ab76357e-95d5-4cb8-9722-6f88f0eed17f tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887cfd0993f448faafa95b4543bf5085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a22541a330f4071a6c2100f2dc47e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:19:53.815616 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-ab76357e-95d5-4cb8-9722-6f88f0eed17f tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] 10.222.0.47 "GET /compute/v2.1/servers/8c69967f-adef-4cdf-9db9-e3596d607641" status: 200 len: 1314 microversion: 2.1 time: 0.134913 Nov 01 01:19:53.816177 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 177/371] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:19:53 2021] GET /compute/v2.1/servers/8c69967f-adef-4cdf-9db9-e3596d607641 => generated 1314 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:19:54.062253 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-06b2289d-e739-4860-80df-21634ef2ea7f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:19:54.062960 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-06b2289d-e739-4860-80df-21634ef2ea7f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: 5c06a09a-23e3-468c-9a18-d40bd3785c9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:19:54.069136 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-06b2289d-e739-4860-80df-21634ef2ea7f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:54.069582 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-06b2289d-e739-4860-80df-21634ef2ea7f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:54.070349 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-06b2289d-e739-4860-80df-21634ef2ea7f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:54.070825 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-06b2289d-e739-4860-80df-21634ef2ea7f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:54.191378 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-06b2289d-e739-4860-80df-21634ef2ea7f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:19:54.198445 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-06b2289d-e739-4860-80df-21634ef2ea7f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/5c06a09a-23e3-468c-9a18-d40bd3785c9d" status: 200 len: 1521 microversion: 2.1 time: 0.139831 Nov 01 01:19:54.199002 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 178/372] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:19:54 2021] GET /compute/v2.1/servers/5c06a09a-23e3-468c-9a18-d40bd3785c9d => generated 1521 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:19:54.831520 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-6f3f3afe-e8d6-431e-adf7-9af3f72bbe26 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:19:54.832148 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-6f3f3afe-e8d6-431e-adf7-9af3f72bbe26 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] [instance: 8c69967f-adef-4cdf-9db9-e3596d607641] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:19:54.838390 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-6f3f3afe-e8d6-431e-adf7-9af3f72bbe26 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:54.838855 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-6f3f3afe-e8d6-431e-adf7-9af3f72bbe26 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:54.839596 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-6f3f3afe-e8d6-431e-adf7-9af3f72bbe26 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:54.840026 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-6f3f3afe-e8d6-431e-adf7-9af3f72bbe26 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:54.963154 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-6f3f3afe-e8d6-431e-adf7-9af3f72bbe26 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887cfd0993f448faafa95b4543bf5085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a22541a330f4071a6c2100f2dc47e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:19:54.970261 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-6f3f3afe-e8d6-431e-adf7-9af3f72bbe26 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] 10.222.0.47 "GET /compute/v2.1/servers/8c69967f-adef-4cdf-9db9-e3596d607641" status: 200 len: 1314 microversion: 2.1 time: 0.142370 Nov 01 01:19:54.970917 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 179/373] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:19:54 2021] GET /compute/v2.1/servers/8c69967f-adef-4cdf-9db9-e3596d607641 => generated 1314 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:19:55.215032 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-6d256fac-e153-4844-961d-bc855521d595 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:19:55.215823 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-6d256fac-e153-4844-961d-bc855521d595 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: 5c06a09a-23e3-468c-9a18-d40bd3785c9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:19:55.221831 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-6d256fac-e153-4844-961d-bc855521d595 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:55.222267 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-6d256fac-e153-4844-961d-bc855521d595 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:55.223070 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-6d256fac-e153-4844-961d-bc855521d595 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:55.223504 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-6d256fac-e153-4844-961d-bc855521d595 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:55.345564 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-6d256fac-e153-4844-961d-bc855521d595 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:19:55.353323 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-6d256fac-e153-4844-961d-bc855521d595 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/5c06a09a-23e3-468c-9a18-d40bd3785c9d" status: 200 len: 1521 microversion: 2.1 time: 0.141950 Nov 01 01:19:55.353878 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 180/374] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:19:55 2021] GET /compute/v2.1/servers/5c06a09a-23e3-468c-9a18-d40bd3785c9d => generated 1521 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:19:55.993372 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-074242af-0305-49e9-806b-da63f3fd04e5 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:19:55.993978 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-074242af-0305-49e9-806b-da63f3fd04e5 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] [instance: 8c69967f-adef-4cdf-9db9-e3596d607641] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:19:55.999828 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-074242af-0305-49e9-806b-da63f3fd04e5 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:56.000265 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-074242af-0305-49e9-806b-da63f3fd04e5 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:56.001008 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-074242af-0305-49e9-806b-da63f3fd04e5 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:56.001427 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-074242af-0305-49e9-806b-da63f3fd04e5 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:56.118835 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-074242af-0305-49e9-806b-da63f3fd04e5 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887cfd0993f448faafa95b4543bf5085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a22541a330f4071a6c2100f2dc47e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:19:56.126008 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-074242af-0305-49e9-806b-da63f3fd04e5 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] 10.222.0.47 "GET /compute/v2.1/servers/8c69967f-adef-4cdf-9db9-e3596d607641" status: 200 len: 1314 microversion: 2.1 time: 0.137147 Nov 01 01:19:56.126578 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 181/375] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:19:55 2021] GET /compute/v2.1/servers/8c69967f-adef-4cdf-9db9-e3596d607641 => generated 1314 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:19:56.370033 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-07e83616-8e17-43bd-ba7c-84ad8834b0ef tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:19:56.370694 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-07e83616-8e17-43bd-ba7c-84ad8834b0ef tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: 5c06a09a-23e3-468c-9a18-d40bd3785c9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:19:56.376848 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-07e83616-8e17-43bd-ba7c-84ad8834b0ef tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:56.377283 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-07e83616-8e17-43bd-ba7c-84ad8834b0ef tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:56.378030 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-07e83616-8e17-43bd-ba7c-84ad8834b0ef tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:56.378476 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-07e83616-8e17-43bd-ba7c-84ad8834b0ef tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:56.498411 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-07e83616-8e17-43bd-ba7c-84ad8834b0ef tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:19:56.505527 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-07e83616-8e17-43bd-ba7c-84ad8834b0ef tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/5c06a09a-23e3-468c-9a18-d40bd3785c9d" status: 200 len: 1521 microversion: 2.1 time: 0.139404 Nov 01 01:19:56.506086 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 182/376] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:19:56 2021] GET /compute/v2.1/servers/5c06a09a-23e3-468c-9a18-d40bd3785c9d => generated 1521 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:19:57.142187 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-124aa910-6ef4-4ad2-b327-e8555a216a5d tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:19:57.142800 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-124aa910-6ef4-4ad2-b327-e8555a216a5d tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] [instance: 8c69967f-adef-4cdf-9db9-e3596d607641] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:19:57.148660 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-124aa910-6ef4-4ad2-b327-e8555a216a5d tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:57.149094 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-124aa910-6ef4-4ad2-b327-e8555a216a5d tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:57.149835 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-124aa910-6ef4-4ad2-b327-e8555a216a5d tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:57.150255 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-124aa910-6ef4-4ad2-b327-e8555a216a5d tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:57.269098 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-124aa910-6ef4-4ad2-b327-e8555a216a5d tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887cfd0993f448faafa95b4543bf5085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a22541a330f4071a6c2100f2dc47e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:19:57.277103 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-124aa910-6ef4-4ad2-b327-e8555a216a5d tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] 10.222.0.47 "GET /compute/v2.1/servers/8c69967f-adef-4cdf-9db9-e3596d607641" status: 200 len: 1314 microversion: 2.1 time: 0.138250 Nov 01 01:19:57.277666 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 183/377] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:19:57 2021] GET /compute/v2.1/servers/8c69967f-adef-4cdf-9db9-e3596d607641 => generated 1314 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:19:57.522057 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-6581fe59-ac6c-4050-9697-ac5ee1cee30f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:19:57.523335 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-6581fe59-ac6c-4050-9697-ac5ee1cee30f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: 5c06a09a-23e3-468c-9a18-d40bd3785c9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:19:57.529481 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-6581fe59-ac6c-4050-9697-ac5ee1cee30f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:57.529920 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-6581fe59-ac6c-4050-9697-ac5ee1cee30f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:57.530703 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-6581fe59-ac6c-4050-9697-ac5ee1cee30f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:57.531133 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-6581fe59-ac6c-4050-9697-ac5ee1cee30f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:57.648444 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-6581fe59-ac6c-4050-9697-ac5ee1cee30f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:19:57.656256 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-6581fe59-ac6c-4050-9697-ac5ee1cee30f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/5c06a09a-23e3-468c-9a18-d40bd3785c9d" status: 200 len: 1521 microversion: 2.1 time: 0.137866 Nov 01 01:19:57.656814 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 184/378] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:19:57 2021] GET /compute/v2.1/servers/5c06a09a-23e3-468c-9a18-d40bd3785c9d => generated 1521 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:19:58.293155 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-648646fb-2405-4cf6-a1bc-391bcd72eecc tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:19:58.293762 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-648646fb-2405-4cf6-a1bc-391bcd72eecc tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] [instance: 8c69967f-adef-4cdf-9db9-e3596d607641] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:19:58.299570 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-648646fb-2405-4cf6-a1bc-391bcd72eecc tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:58.300014 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-648646fb-2405-4cf6-a1bc-391bcd72eecc tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:58.300771 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-648646fb-2405-4cf6-a1bc-391bcd72eecc tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:58.301201 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-648646fb-2405-4cf6-a1bc-391bcd72eecc tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:58.424525 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-648646fb-2405-4cf6-a1bc-391bcd72eecc tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887cfd0993f448faafa95b4543bf5085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a22541a330f4071a6c2100f2dc47e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:19:58.432231 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-648646fb-2405-4cf6-a1bc-391bcd72eecc tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] 10.222.0.47 "GET /compute/v2.1/servers/8c69967f-adef-4cdf-9db9-e3596d607641" status: 200 len: 1314 microversion: 2.1 time: 0.142675 Nov 01 01:19:58.432797 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 185/379] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:19:58 2021] GET /compute/v2.1/servers/8c69967f-adef-4cdf-9db9-e3596d607641 => generated 1314 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:19:58.672638 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-c8029057-633f-444f-b303-7ddc28e141fc tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:19:58.673155 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-c8029057-633f-444f-b303-7ddc28e141fc tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: 5c06a09a-23e3-468c-9a18-d40bd3785c9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:19:58.679252 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c8029057-633f-444f-b303-7ddc28e141fc tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:58.679686 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c8029057-633f-444f-b303-7ddc28e141fc tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:58.680428 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c8029057-633f-444f-b303-7ddc28e141fc tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:58.680849 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c8029057-633f-444f-b303-7ddc28e141fc tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:58.797665 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-c8029057-633f-444f-b303-7ddc28e141fc tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:19:58.804799 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-c8029057-633f-444f-b303-7ddc28e141fc tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/5c06a09a-23e3-468c-9a18-d40bd3785c9d" status: 200 len: 1521 microversion: 2.1 time: 0.135787 Nov 01 01:19:58.805354 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 186/380] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:19:58 2021] GET /compute/v2.1/servers/5c06a09a-23e3-468c-9a18-d40bd3785c9d => generated 1521 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:19:59.448264 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-7a5e086e-4cf1-42a4-8704-5cf02afa251d tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:19:59.448861 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-7a5e086e-4cf1-42a4-8704-5cf02afa251d tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] [instance: 8c69967f-adef-4cdf-9db9-e3596d607641] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:19:59.454774 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-7a5e086e-4cf1-42a4-8704-5cf02afa251d tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:59.455209 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-7a5e086e-4cf1-42a4-8704-5cf02afa251d tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:59.455949 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-7a5e086e-4cf1-42a4-8704-5cf02afa251d tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:59.456366 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-7a5e086e-4cf1-42a4-8704-5cf02afa251d tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:59.576452 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-7a5e086e-4cf1-42a4-8704-5cf02afa251d tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887cfd0993f448faafa95b4543bf5085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a22541a330f4071a6c2100f2dc47e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:19:59.583663 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-7a5e086e-4cf1-42a4-8704-5cf02afa251d tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] 10.222.0.47 "GET /compute/v2.1/servers/8c69967f-adef-4cdf-9db9-e3596d607641" status: 200 len: 1314 microversion: 2.1 time: 0.139724 Nov 01 01:19:59.584222 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 187/381] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:19:59 2021] GET /compute/v2.1/servers/8c69967f-adef-4cdf-9db9-e3596d607641 => generated 1314 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:19:59.703941 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-e07281f7-c945-4cd6-9003-191a30dd1d21 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "POST /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/action" status: 200 len: 28683 microversion: 2.1 time: 7.110244 Nov 01 01:19:59.704694 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 195/382] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Nov 1 01:19:52 2021] POST /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/action => generated 28683 bytes in 7112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 01 01:19:59.821807 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-e2b2d038-2c00-4bc1-a0bd-404b8cce0cd7 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:19:59.822411 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-e2b2d038-2c00-4bc1-a0bd-404b8cce0cd7 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: 5c06a09a-23e3-468c-9a18-d40bd3785c9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:19:59.828642 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e2b2d038-2c00-4bc1-a0bd-404b8cce0cd7 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:59.829087 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e2b2d038-2c00-4bc1-a0bd-404b8cce0cd7 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:59.829857 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e2b2d038-2c00-4bc1-a0bd-404b8cce0cd7 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:19:59.830286 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e2b2d038-2c00-4bc1-a0bd-404b8cce0cd7 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:19:59.955346 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-e2b2d038-2c00-4bc1-a0bd-404b8cce0cd7 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:19:59.963102 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-e2b2d038-2c00-4bc1-a0bd-404b8cce0cd7 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/5c06a09a-23e3-468c-9a18-d40bd3785c9d" status: 200 len: 1521 microversion: 2.1 time: 0.144924 Nov 01 01:19:59.963666 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 188/383] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:19:59 2021] GET /compute/v2.1/servers/5c06a09a-23e3-468c-9a18-d40bd3785c9d => generated 1521 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:20:00.600943 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-5ec45ea6-cb08-434a-b9d4-6f59460b04b7 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:20:00.601632 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-5ec45ea6-cb08-434a-b9d4-6f59460b04b7 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] [instance: 8c69967f-adef-4cdf-9db9-e3596d607641] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:20:00.610102 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5ec45ea6-cb08-434a-b9d4-6f59460b04b7 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:20:00.610603 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5ec45ea6-cb08-434a-b9d4-6f59460b04b7 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:20:00.611426 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5ec45ea6-cb08-434a-b9d4-6f59460b04b7 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:20:00.611864 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5ec45ea6-cb08-434a-b9d4-6f59460b04b7 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:20:00.715465 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-b3d95521-c9b0-457c-bc15-cbaf39afe4d6 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:20:00.716477 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-b3d95521-c9b0-457c-bc15-cbaf39afe4d6 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:20:00.722121 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b3d95521-c9b0-457c-bc15-cbaf39afe4d6 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:20:00.722594 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b3d95521-c9b0-457c-bc15-cbaf39afe4d6 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:20:00.723343 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b3d95521-c9b0-457c-bc15-cbaf39afe4d6 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:20:00.723761 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b3d95521-c9b0-457c-bc15-cbaf39afe4d6 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:20:00.737410 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-5ec45ea6-cb08-434a-b9d4-6f59460b04b7 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887cfd0993f448faafa95b4543bf5085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a22541a330f4071a6c2100f2dc47e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:20:00.745581 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-5ec45ea6-cb08-434a-b9d4-6f59460b04b7 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] 10.222.0.47 "GET /compute/v2.1/servers/8c69967f-adef-4cdf-9db9-e3596d607641" status: 200 len: 1314 microversion: 2.1 time: 0.148772 Nov 01 01:20:00.746144 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 196/384] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:20:00 2021] GET /compute/v2.1/servers/8c69967f-adef-4cdf-9db9-e3596d607641 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:20:00.870062 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-b3d95521-c9b0-457c-bc15-cbaf39afe4d6 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "POST /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/action" status: 200 len: 28683 microversion: 2.1 time: 0.157993 Nov 01 01:20:00.870757 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 189/385] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Nov 1 01:20:00 2021] POST /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/action => generated 28683 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 01 01:20:00.986675 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-c1d24aa4-bdd2-4aa3-8c0b-0e53abf3fbe8 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:20:00.987206 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-c1d24aa4-bdd2-4aa3-8c0b-0e53abf3fbe8 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: 5c06a09a-23e3-468c-9a18-d40bd3785c9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:20:00.994293 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c1d24aa4-bdd2-4aa3-8c0b-0e53abf3fbe8 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:20:00.994755 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c1d24aa4-bdd2-4aa3-8c0b-0e53abf3fbe8 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:20:00.995549 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c1d24aa4-bdd2-4aa3-8c0b-0e53abf3fbe8 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:20:00.995979 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c1d24aa4-bdd2-4aa3-8c0b-0e53abf3fbe8 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:20:01.123347 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-c1d24aa4-bdd2-4aa3-8c0b-0e53abf3fbe8 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:20:01.130590 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-c1d24aa4-bdd2-4aa3-8c0b-0e53abf3fbe8 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/5c06a09a-23e3-468c-9a18-d40bd3785c9d" status: 200 len: 1521 microversion: 2.1 time: 0.147801 Nov 01 01:20:01.131155 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 197/386] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:20:00 2021] GET /compute/v2.1/servers/5c06a09a-23e3-468c-9a18-d40bd3785c9d => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:20:01.762522 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-61193de9-a44c-4b00-bd44-eaaa84f4f185 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:20:01.763223 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-61193de9-a44c-4b00-bd44-eaaa84f4f185 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] [instance: 8c69967f-adef-4cdf-9db9-e3596d607641] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:20:01.770010 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-61193de9-a44c-4b00-bd44-eaaa84f4f185 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:20:01.770487 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-61193de9-a44c-4b00-bd44-eaaa84f4f185 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:20:01.771248 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-61193de9-a44c-4b00-bd44-eaaa84f4f185 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:20:01.771676 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-61193de9-a44c-4b00-bd44-eaaa84f4f185 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:20:01.880924 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-6d7d5b72-e43f-42a3-8ca2-500269ed7518 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:20:01.882479 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-6d7d5b72-e43f-42a3-8ca2-500269ed7518 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:20:01.888615 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6d7d5b72-e43f-42a3-8ca2-500269ed7518 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:20:01.889059 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6d7d5b72-e43f-42a3-8ca2-500269ed7518 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:20:01.889827 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6d7d5b72-e43f-42a3-8ca2-500269ed7518 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:20:01.890256 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6d7d5b72-e43f-42a3-8ca2-500269ed7518 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:20:01.895516 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-61193de9-a44c-4b00-bd44-eaaa84f4f185 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887cfd0993f448faafa95b4543bf5085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a22541a330f4071a6c2100f2dc47e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:20:01.903919 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-61193de9-a44c-4b00-bd44-eaaa84f4f185 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] 10.222.0.47 "GET /compute/v2.1/servers/8c69967f-adef-4cdf-9db9-e3596d607641" status: 200 len: 1497 microversion: 2.1 time: 0.145431 Nov 01 01:20:01.904480 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 190/387] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:20:01 2021] GET /compute/v2.1/servers/8c69967f-adef-4cdf-9db9-e3596d607641 => generated 1497 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:20:01.981526 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-6d7d5b72-e43f-42a3-8ca2-500269ed7518 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "POST /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/action" status: 200 len: 28683 microversion: 2.1 time: 0.100914 Nov 01 01:20:01.982146 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 198/388] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Nov 1 01:20:01 2021] POST /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/action => generated 28683 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 01 01:20:02.147053 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-1b75478e-7668-4c54-b6b8-8e4fa65f1526 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:20:02.148344 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-1b75478e-7668-4c54-b6b8-8e4fa65f1526 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: 5c06a09a-23e3-468c-9a18-d40bd3785c9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:20:02.154559 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-1b75478e-7668-4c54-b6b8-8e4fa65f1526 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:20:02.155003 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-1b75478e-7668-4c54-b6b8-8e4fa65f1526 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:20:02.155757 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-1b75478e-7668-4c54-b6b8-8e4fa65f1526 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:20:02.156187 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-1b75478e-7668-4c54-b6b8-8e4fa65f1526 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:20:02.274858 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-1b75478e-7668-4c54-b6b8-8e4fa65f1526 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:20:02.282125 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-1b75478e-7668-4c54-b6b8-8e4fa65f1526 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/5c06a09a-23e3-468c-9a18-d40bd3785c9d" status: 200 len: 1521 microversion: 2.1 time: 0.138690 Nov 01 01:20:02.282717 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 191/389] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:20:02 2021] GET /compute/v2.1/servers/5c06a09a-23e3-468c-9a18-d40bd3785c9d => generated 1521 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:20:02.999238 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-b4a6321d-8a1f-464a-b1de-b1151e3781df tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:20:03.000156 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-b4a6321d-8a1f-464a-b1de-b1151e3781df tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:20:03.007712 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b4a6321d-8a1f-464a-b1de-b1151e3781df tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:20:03.008269 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b4a6321d-8a1f-464a-b1de-b1151e3781df tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:20:03.009080 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b4a6321d-8a1f-464a-b1de-b1151e3781df tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:20:03.009515 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b4a6321d-8a1f-464a-b1de-b1151e3781df tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:20:03.229712 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-b4a6321d-8a1f-464a-b1de-b1151e3781df tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "POST /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/action" status: 200 len: 28683 microversion: 2.1 time: 0.234462 Nov 01 01:20:03.230502 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 199/390] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Nov 1 01:20:02 2021] POST /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/action => generated 28683 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 01 01:20:03.299098 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-f805b21f-6dea-4454-bdc2-1465a46aeaf7 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:20:03.299732 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-f805b21f-6dea-4454-bdc2-1465a46aeaf7 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: 5c06a09a-23e3-468c-9a18-d40bd3785c9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:20:03.308028 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f805b21f-6dea-4454-bdc2-1465a46aeaf7 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:20:03.308743 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f805b21f-6dea-4454-bdc2-1465a46aeaf7 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:20:03.309737 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f805b21f-6dea-4454-bdc2-1465a46aeaf7 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:20:03.310346 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f805b21f-6dea-4454-bdc2-1465a46aeaf7 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:20:03.435099 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-f805b21f-6dea-4454-bdc2-1465a46aeaf7 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:20:03.442698 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-f805b21f-6dea-4454-bdc2-1465a46aeaf7 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/5c06a09a-23e3-468c-9a18-d40bd3785c9d" status: 200 len: 1521 microversion: 2.1 time: 0.147786 Nov 01 01:20:03.448860 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 192/391] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:20:03 2021] GET /compute/v2.1/servers/5c06a09a-23e3-468c-9a18-d40bd3785c9d => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:20:03.783277 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-c3f3a53e-f8be-41f5-82bb-415efa435194 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:20:03.783886 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-c3f3a53e-f8be-41f5-82bb-415efa435194 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] [instance: 8c69967f-adef-4cdf-9db9-e3596d607641] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:20:03.791619 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c3f3a53e-f8be-41f5-82bb-415efa435194 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:20:03.792057 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c3f3a53e-f8be-41f5-82bb-415efa435194 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:20:03.792823 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c3f3a53e-f8be-41f5-82bb-415efa435194 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:20:03.793243 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c3f3a53e-f8be-41f5-82bb-415efa435194 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:20:03.820420 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-c3f3a53e-f8be-41f5-82bb-415efa435194 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] [instance: 8c69967f-adef-4cdf-9db9-e3596d607641] Going to try to terminate instance {{(pid=116266) delete /opt/stack/nova/nova/compute/api.py:2612}} Nov 01 01:20:04.172314 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-c3f3a53e-f8be-41f5-82bb-415efa435194 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] 10.222.0.47 "DELETE /compute/v2.1/servers/8c69967f-adef-4cdf-9db9-e3596d607641" status: 204 len: 0 microversion: 2.1 time: 0.392938 Nov 01 01:20:04.172979 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 200/392] 10.222.0.47 () {58 vars in 1238 bytes} [Mon Nov 1 01:20:03 2021] DELETE /compute/v2.1/servers/8c69967f-adef-4cdf-9db9-e3596d607641 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 01 01:20:04.181718 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-4f52cae1-0f62-4d5f-a730-d9f21f603bee tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:20:04.182761 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-4f52cae1-0f62-4d5f-a730-d9f21f603bee tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] [instance: 8c69967f-adef-4cdf-9db9-e3596d607641] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:20:04.189209 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4f52cae1-0f62-4d5f-a730-d9f21f603bee tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:20:04.189650 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4f52cae1-0f62-4d5f-a730-d9f21f603bee tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:20:04.190416 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4f52cae1-0f62-4d5f-a730-d9f21f603bee tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:20:04.191027 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4f52cae1-0f62-4d5f-a730-d9f21f603bee tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:20:04.242018 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-6123ab73-3b59-4f91-8dc3-8e8531430b03 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:20:04.243059 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-6123ab73-3b59-4f91-8dc3-8e8531430b03 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:20:04.249583 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6123ab73-3b59-4f91-8dc3-8e8531430b03 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:20:04.251458 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6123ab73-3b59-4f91-8dc3-8e8531430b03 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:20:04.251458 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6123ab73-3b59-4f91-8dc3-8e8531430b03 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:20:04.251458 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6123ab73-3b59-4f91-8dc3-8e8531430b03 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:20:04.368586 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-6123ab73-3b59-4f91-8dc3-8e8531430b03 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "POST /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/action" status: 200 len: 28683 microversion: 2.1 time: 0.130164 Nov 01 01:20:04.368703 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 201/393] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Nov 1 01:20:04 2021] POST /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/action => generated 28683 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 01 01:20:04.384862 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-4f52cae1-0f62-4d5f-a730-d9f21f603bee tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887cfd0993f448faafa95b4543bf5085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a22541a330f4071a6c2100f2dc47e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:20:04.392388 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-4f52cae1-0f62-4d5f-a730-d9f21f603bee tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] 10.222.0.47 "GET /compute/v2.1/servers/8c69967f-adef-4cdf-9db9-e3596d607641" status: 200 len: 1503 microversion: 2.1 time: 0.214925 Nov 01 01:20:04.392941 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 193/394] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:20:04 2021] GET /compute/v2.1/servers/8c69967f-adef-4cdf-9db9-e3596d607641 => generated 1503 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:20:04.464396 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-09db2488-5ba0-4d35-9921-7acdfaf1e878 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:20:04.465181 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-09db2488-5ba0-4d35-9921-7acdfaf1e878 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: 5c06a09a-23e3-468c-9a18-d40bd3785c9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:20:04.473377 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-09db2488-5ba0-4d35-9921-7acdfaf1e878 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:20:04.473831 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-09db2488-5ba0-4d35-9921-7acdfaf1e878 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:20:04.474681 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-09db2488-5ba0-4d35-9921-7acdfaf1e878 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:20:04.475115 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-09db2488-5ba0-4d35-9921-7acdfaf1e878 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:20:04.614387 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-09db2488-5ba0-4d35-9921-7acdfaf1e878 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:20:04.625179 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-09db2488-5ba0-4d35-9921-7acdfaf1e878 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/5c06a09a-23e3-468c-9a18-d40bd3785c9d" status: 200 len: 1521 microversion: 2.1 time: 0.164701 Nov 01 01:20:04.625814 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 202/395] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:20:04 2021] GET /compute/v2.1/servers/5c06a09a-23e3-468c-9a18-d40bd3785c9d => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:20:05.379668 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-b646d6a2-5a1e-4359-815b-70ff3b732d1d tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:20:05.380985 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-b646d6a2-5a1e-4359-815b-70ff3b732d1d tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:20:05.389405 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b646d6a2-5a1e-4359-815b-70ff3b732d1d tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:20:05.389944 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b646d6a2-5a1e-4359-815b-70ff3b732d1d tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:20:05.391447 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b646d6a2-5a1e-4359-815b-70ff3b732d1d tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:20:05.391447 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b646d6a2-5a1e-4359-815b-70ff3b732d1d tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:20:05.410473 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-17b4cbc1-f5ab-430c-8235-277f06128857 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:20:05.411431 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-17b4cbc1-f5ab-430c-8235-277f06128857 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] [instance: 8c69967f-adef-4cdf-9db9-e3596d607641] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:20:05.418441 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-17b4cbc1-f5ab-430c-8235-277f06128857 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:20:05.418976 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-17b4cbc1-f5ab-430c-8235-277f06128857 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:20:05.419831 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-17b4cbc1-f5ab-430c-8235-277f06128857 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:20:05.420342 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-17b4cbc1-f5ab-430c-8235-277f06128857 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:20:05.528677 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-b646d6a2-5a1e-4359-815b-70ff3b732d1d tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "POST /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/action" status: 200 len: 28683 microversion: 2.1 time: 0.152579 Nov 01 01:20:05.529324 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 194/396] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Nov 1 01:20:05 2021] POST /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/action => generated 28683 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 01 01:20:05.567443 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-17b4cbc1-f5ab-430c-8235-277f06128857 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887cfd0993f448faafa95b4543bf5085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a22541a330f4071a6c2100f2dc47e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:20:05.575144 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-17b4cbc1-f5ab-430c-8235-277f06128857 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] 10.222.0.47 "GET /compute/v2.1/servers/8c69967f-adef-4cdf-9db9-e3596d607641" status: 200 len: 1503 microversion: 2.1 time: 0.168398 Nov 01 01:20:05.575801 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 203/397] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:20:05 2021] GET /compute/v2.1/servers/8c69967f-adef-4cdf-9db9-e3596d607641 => generated 1503 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:20:05.642885 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-c64d434a-f3a0-48cf-912d-3ee2749ef0c7 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:20:05.643583 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-c64d434a-f3a0-48cf-912d-3ee2749ef0c7 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: 5c06a09a-23e3-468c-9a18-d40bd3785c9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:20:05.650293 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c64d434a-f3a0-48cf-912d-3ee2749ef0c7 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:20:05.657485 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c64d434a-f3a0-48cf-912d-3ee2749ef0c7 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:20:05.657485 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c64d434a-f3a0-48cf-912d-3ee2749ef0c7 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:20:05.657485 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c64d434a-f3a0-48cf-912d-3ee2749ef0c7 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:20:05.837278 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-c64d434a-f3a0-48cf-912d-3ee2749ef0c7 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:20:05.844503 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-c64d434a-f3a0-48cf-912d-3ee2749ef0c7 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/5c06a09a-23e3-468c-9a18-d40bd3785c9d" status: 200 len: 1521 microversion: 2.1 time: 0.205576 Nov 01 01:20:05.845064 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 195/398] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:20:05 2021] GET /compute/v2.1/servers/5c06a09a-23e3-468c-9a18-d40bd3785c9d => generated 1521 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:20:06.540458 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-9ed53c36-30b9-4d3d-bc66-5c16aeaee274 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:20:06.541294 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-9ed53c36-30b9-4d3d-bc66-5c16aeaee274 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:20:06.547571 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9ed53c36-30b9-4d3d-bc66-5c16aeaee274 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:20:06.548513 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9ed53c36-30b9-4d3d-bc66-5c16aeaee274 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:20:06.548765 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9ed53c36-30b9-4d3d-bc66-5c16aeaee274 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:20:06.549196 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9ed53c36-30b9-4d3d-bc66-5c16aeaee274 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:20:06.592163 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-4aebd700-c80c-45ca-af49-20ff8d114bee tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:20:06.594409 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-4aebd700-c80c-45ca-af49-20ff8d114bee tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] [instance: 8c69967f-adef-4cdf-9db9-e3596d607641] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:20:06.599494 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4aebd700-c80c-45ca-af49-20ff8d114bee tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:20:06.599936 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4aebd700-c80c-45ca-af49-20ff8d114bee tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:20:06.601045 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4aebd700-c80c-45ca-af49-20ff8d114bee tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:20:06.601935 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4aebd700-c80c-45ca-af49-20ff8d114bee tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:20:06.700437 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-9ed53c36-30b9-4d3d-bc66-5c16aeaee274 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "POST /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/action" status: 200 len: 28683 microversion: 2.1 time: 0.163723 Nov 01 01:20:06.701370 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 204/399] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Nov 1 01:20:06 2021] POST /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/action => generated 28683 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 01 01:20:06.729570 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-4aebd700-c80c-45ca-af49-20ff8d114bee tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887cfd0993f448faafa95b4543bf5085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a22541a330f4071a6c2100f2dc47e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:20:06.737911 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-4aebd700-c80c-45ca-af49-20ff8d114bee tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] 10.222.0.47 "GET /compute/v2.1/servers/8c69967f-adef-4cdf-9db9-e3596d607641" status: 200 len: 1503 microversion: 2.1 time: 0.149726 Nov 01 01:20:06.738574 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 196/400] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:20:06 2021] GET /compute/v2.1/servers/8c69967f-adef-4cdf-9db9-e3596d607641 => generated 1503 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:20:06.861646 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-7029f241-aff6-44b8-b850-0a3dc4d7935a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:20:06.862453 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-7029f241-aff6-44b8-b850-0a3dc4d7935a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: 5c06a09a-23e3-468c-9a18-d40bd3785c9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:20:06.870413 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7029f241-aff6-44b8-b850-0a3dc4d7935a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:20:06.870973 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7029f241-aff6-44b8-b850-0a3dc4d7935a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:20:06.871820 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7029f241-aff6-44b8-b850-0a3dc4d7935a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:20:06.872317 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7029f241-aff6-44b8-b850-0a3dc4d7935a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:20:07.011634 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-7029f241-aff6-44b8-b850-0a3dc4d7935a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:20:07.019316 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-7029f241-aff6-44b8-b850-0a3dc4d7935a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/5c06a09a-23e3-468c-9a18-d40bd3785c9d" status: 200 len: 1501 microversion: 2.1 time: 0.161682 Nov 01 01:20:07.026712 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 205/401] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:20:06 2021] GET /compute/v2.1/servers/5c06a09a-23e3-468c-9a18-d40bd3785c9d => generated 1501 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:20:07.035001 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-b2816c8b-3ee8-4377-8b69-220c2ad4db63 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:20:07.035605 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-b2816c8b-3ee8-4377-8b69-220c2ad4db63 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:20:07.042676 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b2816c8b-3ee8-4377-8b69-220c2ad4db63 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:20:07.043042 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b2816c8b-3ee8-4377-8b69-220c2ad4db63 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:20:07.043799 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b2816c8b-3ee8-4377-8b69-220c2ad4db63 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:20:07.044479 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b2816c8b-3ee8-4377-8b69-220c2ad4db63 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:20:07.186807 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-b2816c8b-3ee8-4377-8b69-220c2ad4db63 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:20:07.194348 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-b2816c8b-3ee8-4377-8b69-220c2ad4db63 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1517 microversion: 2.1 time: 0.162892 Nov 01 01:20:07.194949 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 197/402] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:20:07 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1517 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:20:07.424898 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [req-9763ad8d-c45f-49d2-af6f-f2224e30e97a req-8f97a851-74a3-4595-969a-c5193e4ee547 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c69967f-adef-4cdf-9db9-e3596d607641", "name": "network-vif-deleted", "tag": "e5a085ab-aefa-4bb0-8f93-856a427e17b3"}]} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:20:07.426414 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 01 01:20:07.426414 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: warnings.warn(msg) Nov 01 01:20:07.434849 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [req-9763ad8d-c45f-49d2-af6f-f2224e30e97a req-8f97a851-74a3-4595-969a-c5193e4ee547 service nova] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:20:07.435536 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [req-9763ad8d-c45f-49d2-af6f-f2224e30e97a req-8f97a851-74a3-4595-969a-c5193e4ee547 service nova] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:20:07.448515 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.compute.server_external_events [req-9763ad8d-c45f-49d2-af6f-f2224e30e97a req-8f97a851-74a3-4595-969a-c5193e4ee547 service nova] Creating event network-vif-deleted:e5a085ab-aefa-4bb0-8f93-856a427e17b3 for instance 8c69967f-adef-4cdf-9db9-e3596d607641 on hv-cinder-81561 Nov 01 01:20:07.454165 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [req-9763ad8d-c45f-49d2-af6f-f2224e30e97a req-8f97a851-74a3-4595-969a-c5193e4ee547 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033503 Nov 01 01:20:07.454917 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 206/403] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Nov 1 01:20:07 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:20:07.717026 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-59322f03-60ef-4b0f-984e-04f9c5bdb3a9 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:20:07.718935 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-59322f03-60ef-4b0f-984e-04f9c5bdb3a9 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:20:07.726723 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-59322f03-60ef-4b0f-984e-04f9c5bdb3a9 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:20:07.727381 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-59322f03-60ef-4b0f-984e-04f9c5bdb3a9 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:20:07.728697 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-59322f03-60ef-4b0f-984e-04f9c5bdb3a9 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:20:07.738686 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-59322f03-60ef-4b0f-984e-04f9c5bdb3a9 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:20:07.757759 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-d51dbf07-0e35-40c9-986e-86b4683ef52a tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:20:07.758685 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-d51dbf07-0e35-40c9-986e-86b4683ef52a tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] [instance: 8c69967f-adef-4cdf-9db9-e3596d607641] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:20:07.777001 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d51dbf07-0e35-40c9-986e-86b4683ef52a tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:20:07.779061 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d51dbf07-0e35-40c9-986e-86b4683ef52a tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:20:07.779875 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d51dbf07-0e35-40c9-986e-86b4683ef52a tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:20:07.780315 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d51dbf07-0e35-40c9-986e-86b4683ef52a tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:20:07.837780 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-59322f03-60ef-4b0f-984e-04f9c5bdb3a9 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "POST /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/action" status: 200 len: 28683 microversion: 2.1 time: 0.123062 Nov 01 01:20:07.838918 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 198/404] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Nov 1 01:20:07 2021] POST /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/action => generated 28683 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 01 01:20:07.854317 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-d51dbf07-0e35-40c9-986e-86b4683ef52a tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887cfd0993f448faafa95b4543bf5085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a22541a330f4071a6c2100f2dc47e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:20:07.862337 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-d51dbf07-0e35-40c9-986e-86b4683ef52a tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] 10.222.0.47 "GET /compute/v2.1/servers/8c69967f-adef-4cdf-9db9-e3596d607641" status: 200 len: 1299 microversion: 2.1 time: 0.110232 Nov 01 01:20:07.863095 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 207/405] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:20:07 2021] GET /compute/v2.1/servers/8c69967f-adef-4cdf-9db9-e3596d607641 => generated 1299 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:20:08.849203 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-11096e99-6b4a-46f1-9220-6fedf30bd508 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:20:08.850208 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-11096e99-6b4a-46f1-9220-6fedf30bd508 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:20:08.857207 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-11096e99-6b4a-46f1-9220-6fedf30bd508 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:20:08.857661 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-11096e99-6b4a-46f1-9220-6fedf30bd508 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:20:08.858439 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-11096e99-6b4a-46f1-9220-6fedf30bd508 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:20:08.858873 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-11096e99-6b4a-46f1-9220-6fedf30bd508 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:20:08.879168 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-0815c4a9-e34a-4a50-9517-9fd96a9b1cd2 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:20:08.879927 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-0815c4a9-e34a-4a50-9517-9fd96a9b1cd2 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] [instance: 8c69967f-adef-4cdf-9db9-e3596d607641] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:20:08.889296 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0815c4a9-e34a-4a50-9517-9fd96a9b1cd2 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:20:08.890777 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0815c4a9-e34a-4a50-9517-9fd96a9b1cd2 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:20:08.890777 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0815c4a9-e34a-4a50-9517-9fd96a9b1cd2 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:20:08.891083 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0815c4a9-e34a-4a50-9517-9fd96a9b1cd2 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:20:08.904819 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.wsgi [None req-0815c4a9-e34a-4a50-9517-9fd96a9b1cd2 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] HTTP exception thrown: Instance 8c69967f-adef-4cdf-9db9-e3596d607641 could not be found. Nov 01 01:20:08.905423 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-0815c4a9-e34a-4a50-9517-9fd96a9b1cd2 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] Returning 404 to user: Instance 8c69967f-adef-4cdf-9db9-e3596d607641 could not be found. {{(pid=116266) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 01 01:20:08.906244 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-0815c4a9-e34a-4a50-9517-9fd96a9b1cd2 tempest-VolumesActionsTest-1431833570 tempest-VolumesActionsTest-1431833570-project] 10.222.0.47 "GET /compute/v2.1/servers/8c69967f-adef-4cdf-9db9-e3596d607641" status: 404 len: 111 microversion: 2.1 time: 0.030706 Nov 01 01:20:08.906825 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 208/406] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:20:08 2021] GET /compute/v2.1/servers/8c69967f-adef-4cdf-9db9-e3596d607641 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 01:20:09.260302 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-11096e99-6b4a-46f1-9220-6fedf30bd508 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "POST /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/action" status: 200 len: 28683 microversion: 2.1 time: 0.414741 Nov 01 01:20:09.260949 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 199/407] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Nov 1 01:20:08 2021] POST /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/action => generated 28683 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 01 01:20:10.272738 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-89491d96-c3b2-4251-8e2c-d66819cf8dc9 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:20:10.273771 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-89491d96-c3b2-4251-8e2c-d66819cf8dc9 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:20:10.281731 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-89491d96-c3b2-4251-8e2c-d66819cf8dc9 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:20:10.282308 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-89491d96-c3b2-4251-8e2c-d66819cf8dc9 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:20:10.283352 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-89491d96-c3b2-4251-8e2c-d66819cf8dc9 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:20:10.283841 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-89491d96-c3b2-4251-8e2c-d66819cf8dc9 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:20:14.387277 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-89491d96-c3b2-4251-8e2c-d66819cf8dc9 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "POST /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/action" status: 200 len: 32446 microversion: 2.1 time: 4.118560 Nov 01 01:20:14.387972 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 209/408] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Nov 1 01:20:10 2021] POST /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/action => generated 32446 bytes in 4121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 01 01:20:15.399436 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-07dd53a5-8dbe-4701-9478-0b1d23987b60 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:20:15.400615 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-07dd53a5-8dbe-4701-9478-0b1d23987b60 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:20:15.407946 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-07dd53a5-8dbe-4701-9478-0b1d23987b60 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:20:15.408386 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-07dd53a5-8dbe-4701-9478-0b1d23987b60 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:20:15.409250 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-07dd53a5-8dbe-4701-9478-0b1d23987b60 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:20:15.409598 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-07dd53a5-8dbe-4701-9478-0b1d23987b60 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:20:15.564395 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-07dd53a5-8dbe-4701-9478-0b1d23987b60 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "POST /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/action" status: 200 len: 33609 microversion: 2.1 time: 0.169141 Nov 01 01:20:15.565013 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 200/409] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Nov 1 01:20:15 2021] POST /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/action => generated 33609 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 01 01:20:16.578045 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-c34f1724-e962-45cf-abb9-bab8e3243364 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:20:16.579243 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-c34f1724-e962-45cf-abb9-bab8e3243364 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:20:16.586073 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c34f1724-e962-45cf-abb9-bab8e3243364 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:20:16.586547 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c34f1724-e962-45cf-abb9-bab8e3243364 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:20:16.587335 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c34f1724-e962-45cf-abb9-bab8e3243364 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:20:16.587764 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c34f1724-e962-45cf-abb9-bab8e3243364 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:20:16.721230 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-c34f1724-e962-45cf-abb9-bab8e3243364 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "POST /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/action" status: 200 len: 34536 microversion: 2.1 time: 0.148339 Nov 01 01:20:16.725426 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 210/410] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Nov 1 01:20:16 2021] POST /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/action => generated 34536 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 01 01:20:17.646670 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-57df84db-98e9-45d8-b79e-2884bfe4564f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:20:17.647762 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-57df84db-98e9-45d8-b79e-2884bfe4564f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:20:17.655126 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-57df84db-98e9-45d8-b79e-2884bfe4564f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:20:17.655566 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-57df84db-98e9-45d8-b79e-2884bfe4564f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:20:17.656308 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-57df84db-98e9-45d8-b79e-2884bfe4564f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:20:17.656728 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-57df84db-98e9-45d8-b79e-2884bfe4564f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:20:17.678738 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.objects.instance [None req-57df84db-98e9-45d8-b79e-2884bfe4564f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lazy-loading 'flavor' on Instance uuid f02098be-ed15-45a0-a599-941cb0e1eebb {{(pid=116267) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 01 01:20:17.733591 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-6abf09a9-55b7-43cc-923a-4eff25be3059 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:20:17.734715 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-6abf09a9-55b7-43cc-923a-4eff25be3059 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:20:17.741828 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6abf09a9-55b7-43cc-923a-4eff25be3059 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:20:17.742269 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6abf09a9-55b7-43cc-923a-4eff25be3059 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:20:17.743062 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6abf09a9-55b7-43cc-923a-4eff25be3059 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:20:17.743493 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6abf09a9-55b7-43cc-923a-4eff25be3059 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:20:17.874042 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-6abf09a9-55b7-43cc-923a-4eff25be3059 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "POST /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/action" status: 200 len: 35607 microversion: 2.1 time: 0.144178 Nov 01 01:20:17.875288 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 211/411] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Nov 1 01:20:17 2021] POST /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/action => generated 35607 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 01 01:20:17.985040 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-57df84db-98e9-45d8-b79e-2884bfe4564f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "POST /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/action" status: 200 len: 32 microversion: 2.1 time: 0.342962 Nov 01 01:20:17.985661 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 201/412] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Nov 1 01:20:17 2021] POST /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/action => generated 32 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 01 01:20:17.996012 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-06cec430-e2ba-4822-a55a-04fe2241da4c tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:20:17.996725 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-06cec430-e2ba-4822-a55a-04fe2241da4c tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:20:18.003828 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-06cec430-e2ba-4822-a55a-04fe2241da4c tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:20:18.004274 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-06cec430-e2ba-4822-a55a-04fe2241da4c tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:20:18.007282 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-06cec430-e2ba-4822-a55a-04fe2241da4c tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:20:18.007282 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-06cec430-e2ba-4822-a55a-04fe2241da4c tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:20:18.145402 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-06cec430-e2ba-4822-a55a-04fe2241da4c tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:20:18.150580 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-06cec430-e2ba-4822-a55a-04fe2241da4c tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1523 microversion: 2.1 time: 0.159461 Nov 01 01:20:18.151135 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 212/413] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:20:17 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1523 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:20:18.886131 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-36e5e32c-28bc-41bb-ae71-64ba482c9938 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:20:18.887267 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-36e5e32c-28bc-41bb-ae71-64ba482c9938 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:20:18.894572 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-36e5e32c-28bc-41bb-ae71-64ba482c9938 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:20:18.895010 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-36e5e32c-28bc-41bb-ae71-64ba482c9938 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:20:18.895789 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-36e5e32c-28bc-41bb-ae71-64ba482c9938 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:20:18.896192 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-36e5e32c-28bc-41bb-ae71-64ba482c9938 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:20:19.167400 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-590e732c-0104-4cec-ac03-8895358896b9 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:20:19.168031 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-590e732c-0104-4cec-ac03-8895358896b9 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:20:19.174237 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-590e732c-0104-4cec-ac03-8895358896b9 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:20:19.174732 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-590e732c-0104-4cec-ac03-8895358896b9 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:20:19.175499 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-590e732c-0104-4cec-ac03-8895358896b9 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:20:19.175933 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-590e732c-0104-4cec-ac03-8895358896b9 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:20:19.325056 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-590e732c-0104-4cec-ac03-8895358896b9 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:20:19.325056 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-590e732c-0104-4cec-ac03-8895358896b9 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1523 microversion: 2.1 time: 0.135999 Nov 01 01:20:19.325056 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 213/414] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:20:19 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1523 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:20:20.331513 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-1e767b30-4715-47c3-b630-4400a64998c8 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:20:20.332147 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-1e767b30-4715-47c3-b630-4400a64998c8 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:20:20.338980 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1e767b30-4715-47c3-b630-4400a64998c8 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:20:20.339427 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1e767b30-4715-47c3-b630-4400a64998c8 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:20:20.340198 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1e767b30-4715-47c3-b630-4400a64998c8 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:20:20.340618 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1e767b30-4715-47c3-b630-4400a64998c8 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:20:20.464932 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-1e767b30-4715-47c3-b630-4400a64998c8 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:20:20.472529 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-1e767b30-4715-47c3-b630-4400a64998c8 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1523 microversion: 2.1 time: 0.144714 Nov 01 01:20:20.473818 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 214/415] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:20:20 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1523 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:20:21.489617 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-6e6b27cb-dab8-4028-a285-30586ea65e8b tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:20:21.490277 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-6e6b27cb-dab8-4028-a285-30586ea65e8b tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:20:21.497185 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6e6b27cb-dab8-4028-a285-30586ea65e8b tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:20:21.497627 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6e6b27cb-dab8-4028-a285-30586ea65e8b tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:20:21.498379 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6e6b27cb-dab8-4028-a285-30586ea65e8b tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:20:21.498895 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6e6b27cb-dab8-4028-a285-30586ea65e8b tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:20:21.619760 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-6e6b27cb-dab8-4028-a285-30586ea65e8b tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:20:21.627021 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-6e6b27cb-dab8-4028-a285-30586ea65e8b tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1523 microversion: 2.1 time: 0.140965 Nov 01 01:20:21.627568 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 215/416] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:20:21 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1523 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:20:22.577145 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-36e5e32c-28bc-41bb-ae71-64ba482c9938 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "POST /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/action" status: 200 len: 38212 microversion: 2.1 time: 3.694750 Nov 01 01:20:22.581904 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 202/417] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Nov 1 01:20:18 2021] POST /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/action => generated 38212 bytes in 3697 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 01 01:20:22.642939 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-a77cbeea-9064-43fc-bb34-0af459e2fe64 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:20:22.644248 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-a77cbeea-9064-43fc-bb34-0af459e2fe64 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:20:22.650669 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a77cbeea-9064-43fc-bb34-0af459e2fe64 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:20:22.651115 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a77cbeea-9064-43fc-bb34-0af459e2fe64 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:20:22.651877 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a77cbeea-9064-43fc-bb34-0af459e2fe64 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:20:22.652647 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a77cbeea-9064-43fc-bb34-0af459e2fe64 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:20:22.778037 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-a77cbeea-9064-43fc-bb34-0af459e2fe64 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:20:22.785762 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-a77cbeea-9064-43fc-bb34-0af459e2fe64 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1523 microversion: 2.1 time: 0.146340 Nov 01 01:20:22.786328 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 216/418] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:20:22 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1523 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:20:23.589395 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-a6553857-0a88-4020-979f-d73f544acd0a tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:20:23.590389 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-a6553857-0a88-4020-979f-d73f544acd0a tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:20:23.597771 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a6553857-0a88-4020-979f-d73f544acd0a tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:20:23.598207 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a6553857-0a88-4020-979f-d73f544acd0a tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:20:23.598978 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a6553857-0a88-4020-979f-d73f544acd0a tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:20:23.599400 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a6553857-0a88-4020-979f-d73f544acd0a tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:20:23.725656 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-a6553857-0a88-4020-979f-d73f544acd0a tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "POST /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/action" status: 200 len: 38212 microversion: 2.1 time: 0.140084 Nov 01 01:20:23.726302 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 203/419] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Nov 1 01:20:23 2021] POST /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/action => generated 38212 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 01 01:20:23.804547 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-b99874f2-0813-4ecd-bb55-958740a76264 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:20:23.805059 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-b99874f2-0813-4ecd-bb55-958740a76264 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:20:23.811625 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b99874f2-0813-4ecd-bb55-958740a76264 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:20:23.812065 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b99874f2-0813-4ecd-bb55-958740a76264 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:20:23.812819 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b99874f2-0813-4ecd-bb55-958740a76264 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:20:23.813243 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b99874f2-0813-4ecd-bb55-958740a76264 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:20:23.937267 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-b99874f2-0813-4ecd-bb55-958740a76264 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:20:23.944503 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-b99874f2-0813-4ecd-bb55-958740a76264 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1523 microversion: 2.1 time: 0.143617 Nov 01 01:20:23.945068 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 217/420] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:20:23 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1523 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:20:24.738217 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-e434187e-3e86-4368-ba22-4299c3a1b2ac tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:20:24.739561 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-e434187e-3e86-4368-ba22-4299c3a1b2ac tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:20:24.746850 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e434187e-3e86-4368-ba22-4299c3a1b2ac tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:20:24.747299 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e434187e-3e86-4368-ba22-4299c3a1b2ac tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:20:24.748067 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e434187e-3e86-4368-ba22-4299c3a1b2ac tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:20:24.748608 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e434187e-3e86-4368-ba22-4299c3a1b2ac tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:20:24.845051 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-e434187e-3e86-4368-ba22-4299c3a1b2ac tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "POST /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/action" status: 200 len: 38212 microversion: 2.1 time: 0.110558 Nov 01 01:20:24.845653 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 204/421] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Nov 1 01:20:24 2021] POST /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/action => generated 38212 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 01 01:20:24.962854 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-b221dfec-5fec-4b71-a74c-bb90075c893f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:20:24.963455 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-b221dfec-5fec-4b71-a74c-bb90075c893f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:20:24.973827 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b221dfec-5fec-4b71-a74c-bb90075c893f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:20:24.974268 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b221dfec-5fec-4b71-a74c-bb90075c893f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:20:24.978526 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b221dfec-5fec-4b71-a74c-bb90075c893f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:20:24.978526 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b221dfec-5fec-4b71-a74c-bb90075c893f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:20:25.106260 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-b221dfec-5fec-4b71-a74c-bb90075c893f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:20:25.116655 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-b221dfec-5fec-4b71-a74c-bb90075c893f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1523 microversion: 2.1 time: 0.155038 Nov 01 01:20:25.116655 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 218/422] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:20:24 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1523 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:20:25.857252 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-f411c47a-0aa6-44c4-b77e-91e6b95656a1 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:20:25.858281 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-f411c47a-0aa6-44c4-b77e-91e6b95656a1 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:20:25.865068 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f411c47a-0aa6-44c4-b77e-91e6b95656a1 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:20:25.876032 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f411c47a-0aa6-44c4-b77e-91e6b95656a1 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:20:25.876032 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f411c47a-0aa6-44c4-b77e-91e6b95656a1 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:20:25.876032 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f411c47a-0aa6-44c4-b77e-91e6b95656a1 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:20:25.973993 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-f411c47a-0aa6-44c4-b77e-91e6b95656a1 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "POST /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/action" status: 200 len: 38341 microversion: 2.1 time: 0.120533 Nov 01 01:20:25.974925 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 205/423] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Nov 1 01:20:25 2021] POST /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/action => generated 38341 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 01 01:20:25.984794 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-bb7020f4-66fb-4fba-ab89-574e36aee3ea tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:20:25.990819 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-bb7020f4-66fb-4fba-ab89-574e36aee3ea tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:20:25.991910 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-bb7020f4-66fb-4fba-ab89-574e36aee3ea tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:20:25.992354 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-bb7020f4-66fb-4fba-ab89-574e36aee3ea tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:20:25.993112 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-bb7020f4-66fb-4fba-ab89-574e36aee3ea tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:20:25.993537 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-bb7020f4-66fb-4fba-ab89-574e36aee3ea tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:20:26.017224 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-bb7020f4-66fb-4fba-ab89-574e36aee3ea tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/ips" status: 200 len: 144 microversion: 2.1 time: 0.036402 Nov 01 01:20:26.017780 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 219/424] 10.222.0.47 () {58 vars in 1247 bytes} [Mon Nov 1 01:20:25 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/ips => generated 144 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:20:26.134873 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-1e1aaac7-1a3a-45e9-a1e5-eab060dd26fc tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:20:26.135562 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-1e1aaac7-1a3a-45e9-a1e5-eab060dd26fc tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:20:26.143067 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-1e1aaac7-1a3a-45e9-a1e5-eab060dd26fc tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:20:26.143509 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-1e1aaac7-1a3a-45e9-a1e5-eab060dd26fc tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:20:26.144274 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-1e1aaac7-1a3a-45e9-a1e5-eab060dd26fc tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:20:26.144700 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-1e1aaac7-1a3a-45e9-a1e5-eab060dd26fc tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:20:26.268464 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-1e1aaac7-1a3a-45e9-a1e5-eab060dd26fc tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:20:26.275838 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-1e1aaac7-1a3a-45e9-a1e5-eab060dd26fc tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1523 microversion: 2.1 time: 0.145016 Nov 01 01:20:26.276390 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 206/425] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:20:26 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1523 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:20:27.292540 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-e2ae2017-5b32-429e-852f-6c4b89a96611 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:20:27.293849 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-e2ae2017-5b32-429e-852f-6c4b89a96611 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:20:27.304587 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e2ae2017-5b32-429e-852f-6c4b89a96611 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:20:27.305588 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e2ae2017-5b32-429e-852f-6c4b89a96611 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:20:27.307011 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e2ae2017-5b32-429e-852f-6c4b89a96611 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:20:27.308132 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e2ae2017-5b32-429e-852f-6c4b89a96611 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:20:27.481152 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-e2ae2017-5b32-429e-852f-6c4b89a96611 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:20:27.490087 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-e2ae2017-5b32-429e-852f-6c4b89a96611 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1523 microversion: 2.1 time: 0.201153 Nov 01 01:20:27.491528 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 220/426] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:20:27 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1523 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:20:28.511042 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-73f4a957-d1f2-4440-9f14-f37e19a23b53 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:20:28.512291 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-73f4a957-d1f2-4440-9f14-f37e19a23b53 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:20:28.523727 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-73f4a957-d1f2-4440-9f14-f37e19a23b53 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:20:28.524205 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-73f4a957-d1f2-4440-9f14-f37e19a23b53 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:20:28.524985 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-73f4a957-d1f2-4440-9f14-f37e19a23b53 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:20:28.525419 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-73f4a957-d1f2-4440-9f14-f37e19a23b53 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:20:28.670700 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-73f4a957-d1f2-4440-9f14-f37e19a23b53 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:20:28.679434 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-73f4a957-d1f2-4440-9f14-f37e19a23b53 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1523 microversion: 2.1 time: 0.172174 Nov 01 01:20:28.680324 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 207/427] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:20:28 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1523 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:20:29.696066 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-f0948773-baa1-41d2-a607-6cb17d25ea96 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:20:29.696648 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-f0948773-baa1-41d2-a607-6cb17d25ea96 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:20:29.702829 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f0948773-baa1-41d2-a607-6cb17d25ea96 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:20:29.703273 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f0948773-baa1-41d2-a607-6cb17d25ea96 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:20:29.704030 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f0948773-baa1-41d2-a607-6cb17d25ea96 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:20:29.704829 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f0948773-baa1-41d2-a607-6cb17d25ea96 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:20:29.828725 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-f0948773-baa1-41d2-a607-6cb17d25ea96 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:20:29.835942 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-f0948773-baa1-41d2-a607-6cb17d25ea96 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1523 microversion: 2.1 time: 0.143558 Nov 01 01:20:29.836436 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 221/428] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:20:29 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1523 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:20:30.852757 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-b568b3a5-b0f4-494b-b54f-4d858a2096aa tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:20:30.853431 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-b568b3a5-b0f4-494b-b54f-4d858a2096aa tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:20:30.860873 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b568b3a5-b0f4-494b-b54f-4d858a2096aa tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:20:30.861584 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b568b3a5-b0f4-494b-b54f-4d858a2096aa tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:20:30.862085 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b568b3a5-b0f4-494b-b54f-4d858a2096aa tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:20:30.862545 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b568b3a5-b0f4-494b-b54f-4d858a2096aa tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:20:30.995266 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-b568b3a5-b0f4-494b-b54f-4d858a2096aa tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:20:31.003293 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-b568b3a5-b0f4-494b-b54f-4d858a2096aa tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1523 microversion: 2.1 time: 0.154254 Nov 01 01:20:31.003856 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 208/429] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:20:30 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1523 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:20:32.020023 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-148c347d-371c-40c4-b5c2-11e4d593ecfe tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:20:32.020626 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-148c347d-371c-40c4-b5c2-11e4d593ecfe tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:20:32.026907 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-148c347d-371c-40c4-b5c2-11e4d593ecfe tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:20:32.027352 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-148c347d-371c-40c4-b5c2-11e4d593ecfe tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:20:32.028116 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-148c347d-371c-40c4-b5c2-11e4d593ecfe tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:20:32.028546 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-148c347d-371c-40c4-b5c2-11e4d593ecfe tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:20:32.147282 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-148c347d-371c-40c4-b5c2-11e4d593ecfe tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:20:32.154473 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-148c347d-371c-40c4-b5c2-11e4d593ecfe tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1523 microversion: 2.1 time: 0.137967 Nov 01 01:20:32.155032 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 222/430] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:20:32 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1523 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:20:32.535223 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 01 01:20:32.535730 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: Mon Nov 1 01:20:32 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 01 01:20:33.175253 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-ff100132-1088-42d6-a7df-d956c473fd05 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:20:33.176532 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-ff100132-1088-42d6-a7df-d956c473fd05 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:20:33.187561 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ff100132-1088-42d6-a7df-d956c473fd05 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:20:33.188262 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ff100132-1088-42d6-a7df-d956c473fd05 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:20:33.189521 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ff100132-1088-42d6-a7df-d956c473fd05 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:20:33.190150 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ff100132-1088-42d6-a7df-d956c473fd05 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:20:33.362735 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-ff100132-1088-42d6-a7df-d956c473fd05 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:20:33.371858 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-ff100132-1088-42d6-a7df-d956c473fd05 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1523 microversion: 2.1 time: 0.203398 Nov 01 01:20:33.372504 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 209/431] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:20:33 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1523 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:20:34.192116 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 01 01:20:34.192668 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: Mon Nov 1 01:20:34 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 01 01:20:34.388773 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-dac6cb47-5ca6-4a94-a913-cc8f78fa70ee tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:20:34.389368 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-dac6cb47-5ca6-4a94-a913-cc8f78fa70ee tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:20:34.395532 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-dac6cb47-5ca6-4a94-a913-cc8f78fa70ee tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:20:34.396004 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-dac6cb47-5ca6-4a94-a913-cc8f78fa70ee tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:20:34.396753 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-dac6cb47-5ca6-4a94-a913-cc8f78fa70ee tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:20:34.397173 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-dac6cb47-5ca6-4a94-a913-cc8f78fa70ee tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:20:34.513979 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-dac6cb47-5ca6-4a94-a913-cc8f78fa70ee tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:20:34.521164 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-dac6cb47-5ca6-4a94-a913-cc8f78fa70ee tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1523 microversion: 2.1 time: 0.136063 Nov 01 01:20:34.521718 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 223/432] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:20:34 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1523 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:20:35.538322 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-0493a8a6-5efb-422a-b9c3-84170f704ca1 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:20:35.538955 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-0493a8a6-5efb-422a-b9c3-84170f704ca1 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:20:35.546270 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0493a8a6-5efb-422a-b9c3-84170f704ca1 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:20:35.546813 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0493a8a6-5efb-422a-b9c3-84170f704ca1 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:20:35.553359 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0493a8a6-5efb-422a-b9c3-84170f704ca1 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:20:35.553788 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0493a8a6-5efb-422a-b9c3-84170f704ca1 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:20:35.673979 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-0493a8a6-5efb-422a-b9c3-84170f704ca1 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:20:35.681308 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-0493a8a6-5efb-422a-b9c3-84170f704ca1 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1523 microversion: 2.1 time: 0.146664 Nov 01 01:20:35.681857 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 210/433] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:20:35 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1523 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:20:36.698190 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-6a245e33-b01e-4dd3-88bb-37433f6505c2 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:20:36.698839 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-6a245e33-b01e-4dd3-88bb-37433f6505c2 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:20:36.705713 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6a245e33-b01e-4dd3-88bb-37433f6505c2 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:20:36.706153 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6a245e33-b01e-4dd3-88bb-37433f6505c2 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:20:36.706950 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6a245e33-b01e-4dd3-88bb-37433f6505c2 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:20:36.707380 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6a245e33-b01e-4dd3-88bb-37433f6505c2 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:20:36.830308 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-6a245e33-b01e-4dd3-88bb-37433f6505c2 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:20:36.837463 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-6a245e33-b01e-4dd3-88bb-37433f6505c2 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1523 microversion: 2.1 time: 0.142830 Nov 01 01:20:36.838041 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 224/434] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:20:36 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1523 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:20:37.853896 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-b31ca233-de83-49fe-b1fa-2b0ef8f2f8a7 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:20:37.854530 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-b31ca233-de83-49fe-b1fa-2b0ef8f2f8a7 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:20:37.860832 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b31ca233-de83-49fe-b1fa-2b0ef8f2f8a7 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:20:37.861278 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b31ca233-de83-49fe-b1fa-2b0ef8f2f8a7 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:20:37.862036 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b31ca233-de83-49fe-b1fa-2b0ef8f2f8a7 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:20:37.862488 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b31ca233-de83-49fe-b1fa-2b0ef8f2f8a7 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:20:37.985169 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-b31ca233-de83-49fe-b1fa-2b0ef8f2f8a7 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:20:37.992720 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-b31ca233-de83-49fe-b1fa-2b0ef8f2f8a7 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1523 microversion: 2.1 time: 0.142426 Nov 01 01:20:37.993274 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 211/435] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:20:37 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1523 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:20:39.009573 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-aa6ae26b-e4e6-492e-b3ba-968ea311ef28 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:20:39.010176 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-aa6ae26b-e4e6-492e-b3ba-968ea311ef28 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:20:39.017036 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-aa6ae26b-e4e6-492e-b3ba-968ea311ef28 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:20:39.017481 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-aa6ae26b-e4e6-492e-b3ba-968ea311ef28 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:20:39.018251 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-aa6ae26b-e4e6-492e-b3ba-968ea311ef28 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:20:39.018791 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-aa6ae26b-e4e6-492e-b3ba-968ea311ef28 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:20:39.187489 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-aa6ae26b-e4e6-492e-b3ba-968ea311ef28 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:20:39.198296 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-aa6ae26b-e4e6-492e-b3ba-968ea311ef28 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1523 microversion: 2.1 time: 0.192205 Nov 01 01:20:39.199449 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 225/436] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:20:39 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1523 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:20:40.215789 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-03831b94-0194-4337-9172-c4cf89be8639 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:20:40.217617 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-03831b94-0194-4337-9172-c4cf89be8639 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:20:40.223594 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-03831b94-0194-4337-9172-c4cf89be8639 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:20:40.224325 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-03831b94-0194-4337-9172-c4cf89be8639 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:20:40.225174 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-03831b94-0194-4337-9172-c4cf89be8639 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:20:40.225658 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-03831b94-0194-4337-9172-c4cf89be8639 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:20:40.365444 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-03831b94-0194-4337-9172-c4cf89be8639 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:20:40.374690 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-03831b94-0194-4337-9172-c4cf89be8639 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1523 microversion: 2.1 time: 0.162621 Nov 01 01:20:40.375265 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 212/437] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:20:40 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1523 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:20:41.391773 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-cd04f334-0d7e-4fcb-bbeb-96a1ef5bfb9c tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:20:41.393001 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-cd04f334-0d7e-4fcb-bbeb-96a1ef5bfb9c tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:20:41.399824 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-cd04f334-0d7e-4fcb-bbeb-96a1ef5bfb9c tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:20:41.400274 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-cd04f334-0d7e-4fcb-bbeb-96a1ef5bfb9c tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:20:41.401232 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-cd04f334-0d7e-4fcb-bbeb-96a1ef5bfb9c tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:20:41.401822 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-cd04f334-0d7e-4fcb-bbeb-96a1ef5bfb9c tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:20:41.532687 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-cd04f334-0d7e-4fcb-bbeb-96a1ef5bfb9c tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:20:41.542041 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-cd04f334-0d7e-4fcb-bbeb-96a1ef5bfb9c tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1523 microversion: 2.1 time: 0.153880 Nov 01 01:20:41.554652 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 226/438] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:20:41 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1523 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:20:42.562460 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-0b8c5ea2-6cc4-4413-9138-ac19c25cc4e6 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:20:42.564614 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-0b8c5ea2-6cc4-4413-9138-ac19c25cc4e6 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:20:42.583201 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0b8c5ea2-6cc4-4413-9138-ac19c25cc4e6 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:20:42.583201 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0b8c5ea2-6cc4-4413-9138-ac19c25cc4e6 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:20:42.583679 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0b8c5ea2-6cc4-4413-9138-ac19c25cc4e6 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:20:42.584860 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0b8c5ea2-6cc4-4413-9138-ac19c25cc4e6 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:20:42.719056 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-0b8c5ea2-6cc4-4413-9138-ac19c25cc4e6 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:20:42.726324 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-0b8c5ea2-6cc4-4413-9138-ac19c25cc4e6 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1523 microversion: 2.1 time: 0.169129 Nov 01 01:20:42.726924 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 213/439] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:20:42 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1523 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:20:43.743432 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-70cbe4a9-7937-4909-84b9-b5badc69d9c2 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:20:43.744037 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-70cbe4a9-7937-4909-84b9-b5badc69d9c2 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:20:43.760393 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-70cbe4a9-7937-4909-84b9-b5badc69d9c2 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:20:43.760849 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-70cbe4a9-7937-4909-84b9-b5badc69d9c2 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:20:43.761636 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-70cbe4a9-7937-4909-84b9-b5badc69d9c2 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:20:43.762130 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-70cbe4a9-7937-4909-84b9-b5badc69d9c2 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:20:43.921115 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-70cbe4a9-7937-4909-84b9-b5badc69d9c2 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:20:43.932253 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-70cbe4a9-7937-4909-84b9-b5badc69d9c2 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1523 microversion: 2.1 time: 0.192072 Nov 01 01:20:43.933330 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 227/440] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:20:43 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1523 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:20:44.952797 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-fe6fb48a-fb10-4307-9d3f-fc40657cd5b3 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:20:44.953406 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-fe6fb48a-fb10-4307-9d3f-fc40657cd5b3 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:20:44.959875 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-fe6fb48a-fb10-4307-9d3f-fc40657cd5b3 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:20:44.960554 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-fe6fb48a-fb10-4307-9d3f-fc40657cd5b3 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:20:44.961379 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-fe6fb48a-fb10-4307-9d3f-fc40657cd5b3 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:20:44.961750 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-fe6fb48a-fb10-4307-9d3f-fc40657cd5b3 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:20:45.143070 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-fe6fb48a-fb10-4307-9d3f-fc40657cd5b3 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:20:45.153961 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-fe6fb48a-fb10-4307-9d3f-fc40657cd5b3 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1523 microversion: 2.1 time: 0.206560 Nov 01 01:20:45.154992 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 214/441] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:20:44 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1523 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:20:45.252578 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-9337a1d6-29e3-4060-9c97-a8ff024c65cb tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "85e71fcf-6447-4fd3-99b6-ce736067cd6e"}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:20:45.255030 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-9337a1d6-29e3-4060-9c97-a8ff024c65cb tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:20:45.262748 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9337a1d6-29e3-4060-9c97-a8ff024c65cb tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:20:45.263374 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9337a1d6-29e3-4060-9c97-a8ff024c65cb tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:20:45.264613 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9337a1d6-29e3-4060-9c97-a8ff024c65cb tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:20:45.265183 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9337a1d6-29e3-4060-9c97-a8ff024c65cb tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:20:46.176621 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-c41b648e-22a1-4524-a192-16a5e80e2880 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:20:46.177243 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-c41b648e-22a1-4524-a192-16a5e80e2880 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:20:46.183851 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c41b648e-22a1-4524-a192-16a5e80e2880 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:20:46.184347 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c41b648e-22a1-4524-a192-16a5e80e2880 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:20:46.185132 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c41b648e-22a1-4524-a192-16a5e80e2880 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:20:46.185552 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c41b648e-22a1-4524-a192-16a5e80e2880 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:20:46.381913 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-c41b648e-22a1-4524-a192-16a5e80e2880 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:20:46.390178 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-c41b648e-22a1-4524-a192-16a5e80e2880 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1523 microversion: 2.1 time: 0.217425 Nov 01 01:20:46.394475 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 215/442] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:20:46 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1523 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:20:46.495337 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-9337a1d6-29e3-4060-9c97-a8ff024c65cb tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "POST /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.247387 Nov 01 01:20:46.499523 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 228/443] 10.222.0.47 () {60 vars in 1322 bytes} [Mon Nov 1 01:20:45 2021] POST /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/os-volume_attachments => generated 194 bytes in 1249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:20:47.406892 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-f5a4d5f4-eccb-4c4e-bc0b-fe009a14ff13 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:20:47.407495 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-f5a4d5f4-eccb-4c4e-bc0b-fe009a14ff13 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:20:47.413707 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f5a4d5f4-eccb-4c4e-bc0b-fe009a14ff13 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:20:47.414149 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f5a4d5f4-eccb-4c4e-bc0b-fe009a14ff13 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:20:47.414922 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f5a4d5f4-eccb-4c4e-bc0b-fe009a14ff13 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:20:47.415507 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f5a4d5f4-eccb-4c4e-bc0b-fe009a14ff13 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:20:47.600360 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-f5a4d5f4-eccb-4c4e-bc0b-fe009a14ff13 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:20:47.622366 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-f5a4d5f4-eccb-4c4e-bc0b-fe009a14ff13 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1523 microversion: 2.1 time: 0.217999 Nov 01 01:20:47.626513 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 216/444] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:20:47 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1523 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:20:48.647078 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-201ced56-f134-46de-b881-f67841019092 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:20:48.648386 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-201ced56-f134-46de-b881-f67841019092 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:20:48.654831 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-201ced56-f134-46de-b881-f67841019092 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:20:48.655277 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-201ced56-f134-46de-b881-f67841019092 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:20:48.656041 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-201ced56-f134-46de-b881-f67841019092 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:20:48.656468 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-201ced56-f134-46de-b881-f67841019092 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:20:48.804640 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-201ced56-f134-46de-b881-f67841019092 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:20:48.812771 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-201ced56-f134-46de-b881-f67841019092 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1503 microversion: 2.1 time: 0.170375 Nov 01 01:20:48.813336 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 229/445] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:20:48 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1503 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:20:48.832725 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-f724b7ad-2f89-4a3c-899a-5eab887b89d1 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f6be5de7-6ea9-4d73-b0ff-fc4dba604d37"}} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:20:48.834070 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-f724b7ad-2f89-4a3c-899a-5eab887b89d1 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:20:48.841787 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f724b7ad-2f89-4a3c-899a-5eab887b89d1 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:20:48.842275 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f724b7ad-2f89-4a3c-899a-5eab887b89d1 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:20:48.845146 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f724b7ad-2f89-4a3c-899a-5eab887b89d1 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:20:48.845602 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f724b7ad-2f89-4a3c-899a-5eab887b89d1 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:20:48.872608 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.wsgi [None req-f724b7ad-2f89-4a3c-899a-5eab887b89d1 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] HTTP exception thrown: Cannot 'attach_volume' instance f02098be-ed15-45a0-a599-941cb0e1eebb while it is in vm_state rescued Nov 01 01:20:48.873218 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-f724b7ad-2f89-4a3c-899a-5eab887b89d1 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Returning 409 to user: Cannot 'attach_volume' instance f02098be-ed15-45a0-a599-941cb0e1eebb while it is in vm_state rescued {{(pid=116267) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 01 01:20:48.879026 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-f724b7ad-2f89-4a3c-899a-5eab887b89d1 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "POST /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.046134 Nov 01 01:20:48.879616 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 217/446] 10.222.0.47 () {60 vars in 1322 bytes} [Mon Nov 1 01:20:48 2021] POST /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 152 bytes in 51 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 01 01:20:48.886487 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-4c6460bf-3d1a-483d-8483-d56c753c7314 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:20:48.887276 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-4c6460bf-3d1a-483d-8483-d56c753c7314 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:20:48.898109 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4c6460bf-3d1a-483d-8483-d56c753c7314 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:20:48.899919 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4c6460bf-3d1a-483d-8483-d56c753c7314 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:20:48.902485 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4c6460bf-3d1a-483d-8483-d56c753c7314 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:20:48.903839 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4c6460bf-3d1a-483d-8483-d56c753c7314 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:20:49.187223 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-4c6460bf-3d1a-483d-8483-d56c753c7314 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "POST /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/action" status: 202 len: 0 microversion: 2.1 time: 0.305921 Nov 01 01:20:49.200520 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-22ef59da-51eb-4900-b739-b42903644a8b tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:20:49.202784 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-22ef59da-51eb-4900-b739-b42903644a8b tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:20:49.204173 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 230/447] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Nov 1 01:20:48 2021] POST /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/action => generated 0 bytes in 309 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 01 01:20:49.220649 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-22ef59da-51eb-4900-b739-b42903644a8b tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:20:49.221955 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-22ef59da-51eb-4900-b739-b42903644a8b tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:20:49.225662 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-22ef59da-51eb-4900-b739-b42903644a8b tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:20:49.229437 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-22ef59da-51eb-4900-b739-b42903644a8b tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:20:49.439387 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-22ef59da-51eb-4900-b739-b42903644a8b tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:20:49.450160 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-22ef59da-51eb-4900-b739-b42903644a8b tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1511 microversion: 2.1 time: 0.254186 Nov 01 01:20:49.450160 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 218/448] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:20:49 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1511 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:20:50.478637 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-c186a9a8-870d-4b4d-a64d-973f4bc95922 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:20:50.479942 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-c186a9a8-870d-4b4d-a64d-973f4bc95922 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:20:50.492427 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c186a9a8-870d-4b4d-a64d-973f4bc95922 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:20:50.495639 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c186a9a8-870d-4b4d-a64d-973f4bc95922 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:20:50.508135 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c186a9a8-870d-4b4d-a64d-973f4bc95922 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:20:50.508592 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c186a9a8-870d-4b4d-a64d-973f4bc95922 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:20:50.675262 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-c186a9a8-870d-4b4d-a64d-973f4bc95922 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:20:50.682402 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-c186a9a8-870d-4b4d-a64d-973f4bc95922 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1511 microversion: 2.1 time: 0.208201 Nov 01 01:20:50.682988 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 231/449] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:20:50 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1511 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:20:51.699188 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-a110c43d-929e-412b-b471-14e5767d0621 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:20:51.699892 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-a110c43d-929e-412b-b471-14e5767d0621 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:20:51.706522 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a110c43d-929e-412b-b471-14e5767d0621 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:20:51.707161 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a110c43d-929e-412b-b471-14e5767d0621 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:20:51.707937 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a110c43d-929e-412b-b471-14e5767d0621 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:20:51.708367 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a110c43d-929e-412b-b471-14e5767d0621 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:20:51.829968 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-a110c43d-929e-412b-b471-14e5767d0621 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:20:51.837446 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-a110c43d-929e-412b-b471-14e5767d0621 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1511 microversion: 2.1 time: 0.142003 Nov 01 01:20:51.838382 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 219/450] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:20:51 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1511 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:20:52.856300 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-d22640a2-4d76-4bda-9ace-6cd85eb7a858 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:20:52.857454 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-d22640a2-4d76-4bda-9ace-6cd85eb7a858 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:20:52.865994 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d22640a2-4d76-4bda-9ace-6cd85eb7a858 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:20:52.866457 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d22640a2-4d76-4bda-9ace-6cd85eb7a858 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:20:52.867376 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d22640a2-4d76-4bda-9ace-6cd85eb7a858 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:20:52.867811 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d22640a2-4d76-4bda-9ace-6cd85eb7a858 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:20:52.995057 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-d22640a2-4d76-4bda-9ace-6cd85eb7a858 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:20:53.002556 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-d22640a2-4d76-4bda-9ace-6cd85eb7a858 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1511 microversion: 2.1 time: 0.151352 Nov 01 01:20:53.003371 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 232/451] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:20:52 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1511 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:20:54.023163 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-0897c89c-3d0c-4946-88a4-b78402977f51 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:20:54.023163 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-0897c89c-3d0c-4946-88a4-b78402977f51 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:20:54.040752 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0897c89c-3d0c-4946-88a4-b78402977f51 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:20:54.041434 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0897c89c-3d0c-4946-88a4-b78402977f51 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:20:54.042379 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0897c89c-3d0c-4946-88a4-b78402977f51 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:20:54.043628 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0897c89c-3d0c-4946-88a4-b78402977f51 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:20:54.195087 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-0897c89c-3d0c-4946-88a4-b78402977f51 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:20:54.195561 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-0897c89c-3d0c-4946-88a4-b78402977f51 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1511 microversion: 2.1 time: 0.177148 Nov 01 01:20:54.196119 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 220/452] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:20:54 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1511 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:20:55.213076 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-a7b02fe0-09b3-47b9-acdd-9b934890faa5 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:20:55.213682 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-a7b02fe0-09b3-47b9-acdd-9b934890faa5 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:20:55.220536 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a7b02fe0-09b3-47b9-acdd-9b934890faa5 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:20:55.221631 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a7b02fe0-09b3-47b9-acdd-9b934890faa5 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:20:55.222505 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a7b02fe0-09b3-47b9-acdd-9b934890faa5 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:20:55.222880 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a7b02fe0-09b3-47b9-acdd-9b934890faa5 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:20:55.352979 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-a7b02fe0-09b3-47b9-acdd-9b934890faa5 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:20:55.360800 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-a7b02fe0-09b3-47b9-acdd-9b934890faa5 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1511 microversion: 2.1 time: 0.151203 Nov 01 01:20:55.364791 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 233/453] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:20:55 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1511 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:20:56.377921 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-710f3881-76dc-431b-9eb5-20ec23e364b6 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:20:56.378550 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-710f3881-76dc-431b-9eb5-20ec23e364b6 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:20:56.384832 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-710f3881-76dc-431b-9eb5-20ec23e364b6 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:20:56.385277 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-710f3881-76dc-431b-9eb5-20ec23e364b6 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:20:56.386038 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-710f3881-76dc-431b-9eb5-20ec23e364b6 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:20:56.386489 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-710f3881-76dc-431b-9eb5-20ec23e364b6 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:20:56.505652 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-710f3881-76dc-431b-9eb5-20ec23e364b6 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:20:56.512895 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-710f3881-76dc-431b-9eb5-20ec23e364b6 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1511 microversion: 2.1 time: 0.138592 Nov 01 01:20:56.513683 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 221/454] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:20:56 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1511 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:20:57.530732 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-268182d8-ce23-4799-aec4-b3c9287c5e4a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:20:57.531328 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-268182d8-ce23-4799-aec4-b3c9287c5e4a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:20:57.537226 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-268182d8-ce23-4799-aec4-b3c9287c5e4a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:20:57.540141 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-268182d8-ce23-4799-aec4-b3c9287c5e4a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:20:57.540141 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-268182d8-ce23-4799-aec4-b3c9287c5e4a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:20:57.540141 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-268182d8-ce23-4799-aec4-b3c9287c5e4a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:20:57.690225 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-268182d8-ce23-4799-aec4-b3c9287c5e4a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:20:57.698872 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-268182d8-ce23-4799-aec4-b3c9287c5e4a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1511 microversion: 2.1 time: 0.172200 Nov 01 01:20:57.699442 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 234/455] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:20:57 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1511 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:20:58.699072 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-d691b497-46c4-48f4-a8d6-1198ec1fe9c8 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:20:58.707729 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d691b497-46c4-48f4-a8d6-1198ec1fe9c8 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:20:58.708179 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d691b497-46c4-48f4-a8d6-1198ec1fe9c8 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:20:58.715623 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-b08c6536-c3b2-4b9d-839e-68510119a788 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:20:58.716231 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-b08c6536-c3b2-4b9d-839e-68510119a788 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:20:58.722739 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b08c6536-c3b2-4b9d-839e-68510119a788 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:20:58.723358 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b08c6536-c3b2-4b9d-839e-68510119a788 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:20:58.724126 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b08c6536-c3b2-4b9d-839e-68510119a788 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:20:58.724556 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b08c6536-c3b2-4b9d-839e-68510119a788 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:20:58.786823 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-d691b497-46c4-48f4-a8d6-1198ec1fe9c8 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Going to try to stop instance {{(pid=116267) force_stop /opt/stack/nova/nova/compute/api.py:2652}} Nov 01 01:20:58.893554 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-b08c6536-c3b2-4b9d-839e-68510119a788 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:20:58.916979 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-b08c6536-c3b2-4b9d-839e-68510119a788 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1517 microversion: 2.1 time: 0.189503 Nov 01 01:20:58.916979 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 235/456] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:20:58 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1517 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:20:58.916979 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-796907a2-574c-4f78-9bfc-728c4bda20e8 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1938177364", "imageRef": "b9068d8d-b02d-4043-9f0c-3d774cb372b3", "flavorRef": "452", "networks": [{"uuid": "440f0e53-d165-4c61-9245-e254f1d4e308"}]}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:20:58.970917 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.network.neutron [None req-796907a2-574c-4f78-9bfc-728c4bda20e8 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] validate_networks() for [('440f0e53-d165-4c61-9245-e254f1d4e308', None, None, None, None, None)] {{(pid=116266) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Nov 01 01:20:59.244635 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-d691b497-46c4-48f4-a8d6-1198ec1fe9c8 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "POST /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/action" status: 202 len: 0 microversion: 2.1 time: 0.549302 Nov 01 01:20:59.245634 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 222/457] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Nov 1 01:20:58 2021] POST /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/action => generated 0 bytes in 552 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 01 01:20:59.255213 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-d4e0a423-1cc8-410d-9c68-06e714479693 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:20:59.256120 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-d4e0a423-1cc8-410d-9c68-06e714479693 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:20:59.262642 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d4e0a423-1cc8-410d-9c68-06e714479693 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:20:59.263173 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d4e0a423-1cc8-410d-9c68-06e714479693 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:20:59.264278 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d4e0a423-1cc8-410d-9c68-06e714479693 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:20:59.264724 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d4e0a423-1cc8-410d-9c68-06e714479693 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:20:59.349591 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.virt.hardware [None req-796907a2-574c-4f78-9bfc-728c4bda20e8 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Flavor limits 0:0:0 {{(pid=116266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 01 01:20:59.350795 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.virt.hardware [None req-796907a2-574c-4f78-9bfc-728c4bda20e8 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Image limits 0:0:0 {{(pid=116266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 01 01:20:59.351273 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.virt.hardware [None req-796907a2-574c-4f78-9bfc-728c4bda20e8 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Flavor pref 0:0:0 {{(pid=116266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 01 01:20:59.351969 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.virt.hardware [None req-796907a2-574c-4f78-9bfc-728c4bda20e8 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Image pref 0:0:0 {{(pid=116266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 01 01:20:59.352388 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.virt.hardware [None req-796907a2-574c-4f78-9bfc-728c4bda20e8 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 01 01:20:59.363493 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-796907a2-574c-4f78-9bfc-728c4bda20e8 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:20:59.363920 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-796907a2-574c-4f78-9bfc-728c4bda20e8 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:20:59.364743 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-796907a2-574c-4f78-9bfc-728c4bda20e8 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:20:59.365432 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-796907a2-574c-4f78-9bfc-728c4bda20e8 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:20:59.384284 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.quota [None req-796907a2-574c-4f78-9bfc-728c4bda20e8 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Getting quotas for project 7795ef4656624d11a3adb196fe6c9681. Resources: {'instances', 'cores', 'ram'} {{(pid=116266) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 01 01:20:59.388880 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.quota [None req-796907a2-574c-4f78-9bfc-728c4bda20e8 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Getting quotas for user ca4329fdd4b147af8b18f26b0656abd6 and project 7795ef4656624d11a3adb196fe6c9681. Resources: {'instances', 'cores', 'ram'} {{(pid=116266) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 01 01:20:59.399639 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-796907a2-574c-4f78-9bfc-728c4bda20e8 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Going to run 1 instances... {{(pid=116266) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 01 01:20:59.402762 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-796907a2-574c-4f78-9bfc-728c4bda20e8 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b9068d8d-b02d-4043-9f0c-3d774cb372b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116266) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 01 01:20:59.417499 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-d4e0a423-1cc8-410d-9c68-06e714479693 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:20:59.428724 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-d4e0a423-1cc8-410d-9c68-06e714479693 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1721 microversion: 2.1 time: 0.178272 Nov 01 01:20:59.429809 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 223/458] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:20:59 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1721 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:20:59.652963 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-796907a2-574c-4f78-9bfc-728c4bda20e8 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.744343 Nov 01 01:20:59.652963 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 236/459] 10.222.0.47 () {60 vars in 1146 bytes} [Mon Nov 1 01:20:58 2021] POST /compute/v2.1/servers => generated 380 bytes in 746 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 01 01:20:59.660154 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-af6a2280-89a1-4bf8-891c-1856bd3d26b9 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:20:59.660771 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-af6a2280-89a1-4bf8-891c-1856bd3d26b9 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:20:59.723811 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-af6a2280-89a1-4bf8-891c-1856bd3d26b9 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:20:59.732133 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-af6a2280-89a1-4bf8-891c-1856bd3d26b9 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1219 microversion: 2.1 time: 0.077545 Nov 01 01:20:59.743906 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 224/460] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:20:59 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1219 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:21:00.447094 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-a4c9f079-b1e8-4d1a-adff-04a54e6de6d6 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:21:00.447644 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-a4c9f079-b1e8-4d1a-adff-04a54e6de6d6 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:21:00.453943 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a4c9f079-b1e8-4d1a-adff-04a54e6de6d6 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:21:00.454392 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a4c9f079-b1e8-4d1a-adff-04a54e6de6d6 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:21:00.455198 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a4c9f079-b1e8-4d1a-adff-04a54e6de6d6 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:21:00.455632 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a4c9f079-b1e8-4d1a-adff-04a54e6de6d6 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:21:00.576295 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-a4c9f079-b1e8-4d1a-adff-04a54e6de6d6 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:21:00.584088 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-a4c9f079-b1e8-4d1a-adff-04a54e6de6d6 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1721 microversion: 2.1 time: 0.140764 Nov 01 01:21:00.584658 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 237/461] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:21:00 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1721 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:21:00.749033 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-f86b1bc2-fb07-452c-b950-9d98c3a8a386 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:21:00.749642 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-f86b1bc2-fb07-452c-b950-9d98c3a8a386 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:21:00.813197 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-f86b1bc2-fb07-452c-b950-9d98c3a8a386 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:21:00.819625 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-f86b1bc2-fb07-452c-b950-9d98c3a8a386 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1219 microversion: 2.1 time: 0.074219 Nov 01 01:21:00.829590 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 225/462] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:21:00 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1219 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:21:01.601034 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-01e3ea13-981e-456d-a74f-a61421f564ee tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:21:01.601656 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-01e3ea13-981e-456d-a74f-a61421f564ee tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:21:01.608288 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-01e3ea13-981e-456d-a74f-a61421f564ee tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:21:01.608743 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-01e3ea13-981e-456d-a74f-a61421f564ee tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:21:01.609700 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-01e3ea13-981e-456d-a74f-a61421f564ee tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:21:01.610008 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-01e3ea13-981e-456d-a74f-a61421f564ee tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:21:01.750201 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-01e3ea13-981e-456d-a74f-a61421f564ee tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:21:01.760003 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-01e3ea13-981e-456d-a74f-a61421f564ee tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1721 microversion: 2.1 time: 0.162571 Nov 01 01:21:01.761100 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 238/463] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:21:01 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1721 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:21:01.836495 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-e83d3cf7-094a-479e-a28a-7f4bf5b7f210 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:21:01.837102 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-e83d3cf7-094a-479e-a28a-7f4bf5b7f210 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:21:01.847867 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e83d3cf7-094a-479e-a28a-7f4bf5b7f210 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:21:01.848318 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e83d3cf7-094a-479e-a28a-7f4bf5b7f210 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:21:01.858580 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e83d3cf7-094a-479e-a28a-7f4bf5b7f210 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:21:01.858580 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e83d3cf7-094a-479e-a28a-7f4bf5b7f210 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:21:01.859871 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-f4314ab6-618e-4b51-b0c7-5cd5789f1b95 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:21:01.860479 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-f4314ab6-618e-4b51-b0c7-5cd5789f1b95 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:21:01.867867 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f4314ab6-618e-4b51-b0c7-5cd5789f1b95 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:21:01.868309 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f4314ab6-618e-4b51-b0c7-5cd5789f1b95 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:21:01.872910 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f4314ab6-618e-4b51-b0c7-5cd5789f1b95 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:21:01.873355 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f4314ab6-618e-4b51-b0c7-5cd5789f1b95 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:21:01.938892 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-e83d3cf7-094a-479e-a28a-7f4bf5b7f210 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:21:01.946551 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-e83d3cf7-094a-479e-a28a-7f4bf5b7f210 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1215 microversion: 2.1 time: 0.114054 Nov 01 01:21:01.947559 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 226/464] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:21:01 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1215 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:21:02.041490 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-f4314ab6-618e-4b51-b0c7-5cd5789f1b95 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:21:02.049551 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-f4314ab6-618e-4b51-b0c7-5cd5789f1b95 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1517 microversion: 2.1 time: 0.193181 Nov 01 01:21:02.050362 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 239/465] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:21:01 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1517 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:21:02.066746 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-aa80d23b-710e-4ab9-819e-e2124a45b878 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "527828b0-9121-4b41-b5b3-d25799e058da"}} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:21:02.068087 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-aa80d23b-710e-4ab9-819e-e2124a45b878 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:21:02.075646 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-aa80d23b-710e-4ab9-819e-e2124a45b878 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:21:02.075646 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-aa80d23b-710e-4ab9-819e-e2124a45b878 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:21:02.075839 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-aa80d23b-710e-4ab9-819e-e2124a45b878 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:21:02.076197 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-aa80d23b-710e-4ab9-819e-e2124a45b878 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:21:02.777262 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-00b17e8a-9bc9-4e94-ae85-a7df5fa847c2 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:21:02.777859 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-00b17e8a-9bc9-4e94-ae85-a7df5fa847c2 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:21:02.784155 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-00b17e8a-9bc9-4e94-ae85-a7df5fa847c2 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:21:02.784595 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-00b17e8a-9bc9-4e94-ae85-a7df5fa847c2 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:21:02.785391 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-00b17e8a-9bc9-4e94-ae85-a7df5fa847c2 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:21:02.785816 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-00b17e8a-9bc9-4e94-ae85-a7df5fa847c2 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:21:02.990450 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-00b17e8a-9bc9-4e94-ae85-a7df5fa847c2 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:21:03.005730 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-00b17e8a-9bc9-4e94-ae85-a7df5fa847c2 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1721 microversion: 2.1 time: 0.232160 Nov 01 01:21:03.007239 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 240/466] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:21:02 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1721 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:21:03.010605 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-2480205c-6fb9-4a73-9b4c-96754aa10c1a tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:21:03.012472 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-2480205c-6fb9-4a73-9b4c-96754aa10c1a tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:21:03.018943 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2480205c-6fb9-4a73-9b4c-96754aa10c1a tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:21:03.019394 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2480205c-6fb9-4a73-9b4c-96754aa10c1a tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:21:03.020174 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2480205c-6fb9-4a73-9b4c-96754aa10c1a tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:21:03.020609 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2480205c-6fb9-4a73-9b4c-96754aa10c1a tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:21:03.086242 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-2480205c-6fb9-4a73-9b4c-96754aa10c1a tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:21:03.093616 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-2480205c-6fb9-4a73-9b4c-96754aa10c1a tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1271 microversion: 2.1 time: 0.086332 Nov 01 01:21:03.094212 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 241/467] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:21:03 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1271 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:21:03.360719 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-aa80d23b-710e-4ab9-819e-e2124a45b878 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "POST /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.297775 Nov 01 01:21:03.365955 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 227/468] 10.222.0.47 () {60 vars in 1322 bytes} [Mon Nov 1 01:21:02 2021] POST /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 194 bytes in 1300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:21:04.022398 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-ecebc744-4190-423a-918b-7f17af8da703 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:21:04.023027 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-ecebc744-4190-423a-918b-7f17af8da703 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:21:04.033649 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ecebc744-4190-423a-918b-7f17af8da703 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:21:04.034109 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ecebc744-4190-423a-918b-7f17af8da703 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:21:04.036141 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ecebc744-4190-423a-918b-7f17af8da703 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:21:04.036589 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ecebc744-4190-423a-918b-7f17af8da703 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:21:04.111261 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-c54a6e84-f881-4337-a3c8-233b4482b54f tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:21:04.111957 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-c54a6e84-f881-4337-a3c8-233b4482b54f tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:21:04.119957 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c54a6e84-f881-4337-a3c8-233b4482b54f tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:21:04.120403 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c54a6e84-f881-4337-a3c8-233b4482b54f tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:21:04.121192 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c54a6e84-f881-4337-a3c8-233b4482b54f tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:21:04.121598 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c54a6e84-f881-4337-a3c8-233b4482b54f tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:21:04.214408 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-c54a6e84-f881-4337-a3c8-233b4482b54f tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:21:04.225594 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-c54a6e84-f881-4337-a3c8-233b4482b54f tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1277 microversion: 2.1 time: 0.119977 Nov 01 01:21:04.226933 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 228/469] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:21:04 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1277 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:21:04.254780 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-ecebc744-4190-423a-918b-7f17af8da703 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:21:04.262591 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-ecebc744-4190-423a-918b-7f17af8da703 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1721 microversion: 2.1 time: 0.243737 Nov 01 01:21:04.263162 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 242/470] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:21:04 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1721 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:21:05.250880 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-ee505bb2-6af2-46e4-aad0-b9835c2d3278 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:21:05.252176 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-ee505bb2-6af2-46e4-aad0-b9835c2d3278 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:21:05.260555 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ee505bb2-6af2-46e4-aad0-b9835c2d3278 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:21:05.261265 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ee505bb2-6af2-46e4-aad0-b9835c2d3278 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:21:05.262700 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ee505bb2-6af2-46e4-aad0-b9835c2d3278 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:21:05.263561 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ee505bb2-6af2-46e4-aad0-b9835c2d3278 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:21:05.283726 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-c0d8c4c1-1798-46f1-a2dc-e0b9e7a9cce5 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:21:05.283726 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-c0d8c4c1-1798-46f1-a2dc-e0b9e7a9cce5 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:21:05.290140 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c0d8c4c1-1798-46f1-a2dc-e0b9e7a9cce5 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:21:05.293479 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c0d8c4c1-1798-46f1-a2dc-e0b9e7a9cce5 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:21:05.294322 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c0d8c4c1-1798-46f1-a2dc-e0b9e7a9cce5 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:21:05.297702 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c0d8c4c1-1798-46f1-a2dc-e0b9e7a9cce5 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:21:05.533972 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-ee505bb2-6af2-46e4-aad0-b9835c2d3278 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:21:05.542169 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-ee505bb2-6af2-46e4-aad0-b9835c2d3278 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1319 microversion: 2.1 time: 0.296031 Nov 01 01:21:05.546942 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 229/471] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:21:05 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1319 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:21:05.587134 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-c0d8c4c1-1798-46f1-a2dc-e0b9e7a9cce5 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:21:05.596352 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-c0d8c4c1-1798-46f1-a2dc-e0b9e7a9cce5 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1721 microversion: 2.1 time: 0.320484 Nov 01 01:21:05.596921 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 243/472] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:21:05 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1721 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:21:05.638800 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [req-2100195c-3d5e-47dc-8e81-cf1072bd4f2b req-b2c0694c-0919-4b1f-b0c3-686848c17623 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0eb63a66-7e46-40fb-9087-543fbf9cad4b", "tag": "28667542-04d5-40d8-bfae-df6a7f6e3a3e"}]} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:21:05.642002 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 01 01:21:05.642002 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: warnings.warn(msg) Nov 01 01:21:05.659714 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [req-2100195c-3d5e-47dc-8e81-cf1072bd4f2b req-b2c0694c-0919-4b1f-b0c3-686848c17623 service nova] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:21:05.659714 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [req-2100195c-3d5e-47dc-8e81-cf1072bd4f2b req-b2c0694c-0919-4b1f-b0c3-686848c17623 service nova] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:21:05.665329 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.compute.server_external_events [req-2100195c-3d5e-47dc-8e81-cf1072bd4f2b req-b2c0694c-0919-4b1f-b0c3-686848c17623 service nova] Creating event network-changed:28667542-04d5-40d8-bfae-df6a7f6e3a3e for instance 0eb63a66-7e46-40fb-9087-543fbf9cad4b on hv-cinder-81561 Nov 01 01:21:05.670111 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [req-2100195c-3d5e-47dc-8e81-cf1072bd4f2b req-b2c0694c-0919-4b1f-b0c3-686848c17623 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036909 Nov 01 01:21:05.670756 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 230/473] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Nov 1 01:21:05 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:21:06.564450 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-b59ddf8c-415e-4e81-bc05-d93e5a103a79 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:21:06.565783 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-b59ddf8c-415e-4e81-bc05-d93e5a103a79 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:21:06.576770 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b59ddf8c-415e-4e81-bc05-d93e5a103a79 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:21:06.577297 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b59ddf8c-415e-4e81-bc05-d93e5a103a79 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:21:06.580671 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b59ddf8c-415e-4e81-bc05-d93e5a103a79 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:21:06.581436 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b59ddf8c-415e-4e81-bc05-d93e5a103a79 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:21:06.615414 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-4e8ac110-dba7-42a4-8d1c-32d1515a9888 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:21:06.616309 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-4e8ac110-dba7-42a4-8d1c-32d1515a9888 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:21:06.623497 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4e8ac110-dba7-42a4-8d1c-32d1515a9888 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:21:06.629006 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4e8ac110-dba7-42a4-8d1c-32d1515a9888 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:21:06.630551 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4e8ac110-dba7-42a4-8d1c-32d1515a9888 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:21:06.630551 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4e8ac110-dba7-42a4-8d1c-32d1515a9888 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:21:06.836003 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-b59ddf8c-415e-4e81-bc05-d93e5a103a79 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:21:06.853022 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-b59ddf8c-415e-4e81-bc05-d93e5a103a79 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1319 microversion: 2.1 time: 0.293391 Nov 01 01:21:06.854353 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 244/474] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:21:06 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1319 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:21:06.884572 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-4e8ac110-dba7-42a4-8d1c-32d1515a9888 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:21:06.892451 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-4e8ac110-dba7-42a4-8d1c-32d1515a9888 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1721 microversion: 2.1 time: 0.282340 Nov 01 01:21:06.893231 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 231/475] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:21:06 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1721 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:21:07.870883 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-4c0ce11b-1116-4caa-9695-4bbd00080fa3 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:21:07.872055 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-4c0ce11b-1116-4caa-9695-4bbd00080fa3 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:21:07.879167 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4c0ce11b-1116-4caa-9695-4bbd00080fa3 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:21:07.879826 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4c0ce11b-1116-4caa-9695-4bbd00080fa3 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:21:07.880771 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4c0ce11b-1116-4caa-9695-4bbd00080fa3 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:21:07.881380 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4c0ce11b-1116-4caa-9695-4bbd00080fa3 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:21:07.912410 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-b11edbbf-035c-43c4-860a-546023a11be6 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:21:07.913630 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-b11edbbf-035c-43c4-860a-546023a11be6 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:21:07.921436 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b11edbbf-035c-43c4-860a-546023a11be6 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:21:07.922896 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b11edbbf-035c-43c4-860a-546023a11be6 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:21:07.923752 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b11edbbf-035c-43c4-860a-546023a11be6 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:21:07.924243 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b11edbbf-035c-43c4-860a-546023a11be6 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:21:08.185892 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-4c0ce11b-1116-4caa-9695-4bbd00080fa3 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:21:08.200466 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-4c0ce11b-1116-4caa-9695-4bbd00080fa3 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1319 microversion: 2.1 time: 0.333122 Nov 01 01:21:08.201043 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 245/476] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:21:07 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1319 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:21:08.237621 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-b11edbbf-035c-43c4-860a-546023a11be6 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:21:08.246575 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-b11edbbf-035c-43c4-860a-546023a11be6 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1721 microversion: 2.1 time: 0.339984 Nov 01 01:21:08.247262 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 232/477] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:21:07 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1721 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:21:09.219572 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-9ad26db1-2abe-4551-9093-32b660710823 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:21:09.220529 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-9ad26db1-2abe-4551-9093-32b660710823 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:21:09.227052 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9ad26db1-2abe-4551-9093-32b660710823 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:21:09.227621 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9ad26db1-2abe-4551-9093-32b660710823 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:21:09.228546 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9ad26db1-2abe-4551-9093-32b660710823 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:21:09.229048 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9ad26db1-2abe-4551-9093-32b660710823 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:21:09.268879 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-4cf96fc5-1cdb-4fe4-9fb3-3ebf9cc1fce0 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:21:09.269485 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-4cf96fc5-1cdb-4fe4-9fb3-3ebf9cc1fce0 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:21:09.276888 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4cf96fc5-1cdb-4fe4-9fb3-3ebf9cc1fce0 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:21:09.277333 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4cf96fc5-1cdb-4fe4-9fb3-3ebf9cc1fce0 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:21:09.278128 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4cf96fc5-1cdb-4fe4-9fb3-3ebf9cc1fce0 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:21:09.278571 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4cf96fc5-1cdb-4fe4-9fb3-3ebf9cc1fce0 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:21:09.440349 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-9ad26db1-2abe-4551-9093-32b660710823 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:21:09.450920 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-9ad26db1-2abe-4551-9093-32b660710823 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1319 microversion: 2.1 time: 0.234519 Nov 01 01:21:09.459612 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 246/478] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:21:09 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1319 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:21:09.478488 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-4cf96fc5-1cdb-4fe4-9fb3-3ebf9cc1fce0 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:21:09.486486 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-4cf96fc5-1cdb-4fe4-9fb3-3ebf9cc1fce0 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1721 microversion: 2.1 time: 0.221993 Nov 01 01:21:09.487452 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 233/479] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:21:09 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1721 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:21:10.470112 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-664eaa87-7ca9-417e-a1a8-d3a1d00ee2db tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:21:10.471441 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-664eaa87-7ca9-417e-a1a8-d3a1d00ee2db tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:21:10.480901 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-664eaa87-7ca9-417e-a1a8-d3a1d00ee2db tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:21:10.481889 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-664eaa87-7ca9-417e-a1a8-d3a1d00ee2db tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:21:10.483684 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-664eaa87-7ca9-417e-a1a8-d3a1d00ee2db tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:21:10.484630 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-664eaa87-7ca9-417e-a1a8-d3a1d00ee2db tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:21:10.506440 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-d592e06d-198c-467d-9b55-aab75046e239 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:21:10.508554 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-d592e06d-198c-467d-9b55-aab75046e239 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:21:10.516775 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d592e06d-198c-467d-9b55-aab75046e239 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:21:10.517576 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d592e06d-198c-467d-9b55-aab75046e239 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:21:10.518866 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d592e06d-198c-467d-9b55-aab75046e239 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:21:10.519630 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d592e06d-198c-467d-9b55-aab75046e239 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:21:10.737476 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-664eaa87-7ca9-417e-a1a8-d3a1d00ee2db tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:21:10.748099 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-664eaa87-7ca9-417e-a1a8-d3a1d00ee2db tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1319 microversion: 2.1 time: 0.281620 Nov 01 01:21:10.752113 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 247/480] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:21:10 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1319 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:21:10.790770 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-d592e06d-198c-467d-9b55-aab75046e239 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:21:10.802746 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-d592e06d-198c-467d-9b55-aab75046e239 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1698 microversion: 2.1 time: 0.302583 Nov 01 01:21:10.803808 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 234/481] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:21:10 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1698 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:21:10.828649 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-313c405a-443e-4a18-8f0c-8bdc40a6df8f tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:21:10.845250 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-313c405a-443e-4a18-8f0c-8bdc40a6df8f tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:21:10.845953 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-313c405a-443e-4a18-8f0c-8bdc40a6df8f tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:21:10.949747 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-313c405a-443e-4a18-8f0c-8bdc40a6df8f tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Going to try to start instance {{(pid=116266) start /opt/stack/nova/nova/compute/api.py:2675}} Nov 01 01:21:11.197187 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-313c405a-443e-4a18-8f0c-8bdc40a6df8f tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "POST /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/action" status: 202 len: 0 microversion: 2.1 time: 0.377206 Nov 01 01:21:11.207376 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 248/482] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Nov 1 01:21:10 2021] POST /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/action => generated 0 bytes in 388 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 01 01:21:11.213445 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-4f73a9a3-1968-4ce7-a054-e2400094fada tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:21:11.214962 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-4f73a9a3-1968-4ce7-a054-e2400094fada tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:21:11.226011 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4f73a9a3-1968-4ce7-a054-e2400094fada tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:21:11.229949 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4f73a9a3-1968-4ce7-a054-e2400094fada tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:21:11.231585 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4f73a9a3-1968-4ce7-a054-e2400094fada tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:21:11.234909 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4f73a9a3-1968-4ce7-a054-e2400094fada tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:21:11.555280 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-4f73a9a3-1968-4ce7-a054-e2400094fada tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:21:11.565107 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-4f73a9a3-1968-4ce7-a054-e2400094fada tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1707 microversion: 2.1 time: 0.357813 Nov 01 01:21:11.569265 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 235/483] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:21:11 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1707 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:21:11.809919 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-8da4811e-65ff-4a60-8800-c8a38fbd6bbc tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:21:11.815724 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-8da4811e-65ff-4a60-8800-c8a38fbd6bbc tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:21:11.843357 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8da4811e-65ff-4a60-8800-c8a38fbd6bbc tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:21:11.843357 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8da4811e-65ff-4a60-8800-c8a38fbd6bbc tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:21:11.844809 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8da4811e-65ff-4a60-8800-c8a38fbd6bbc tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:21:11.845401 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8da4811e-65ff-4a60-8800-c8a38fbd6bbc tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:21:12.089642 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-8da4811e-65ff-4a60-8800-c8a38fbd6bbc tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:21:12.102949 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-8da4811e-65ff-4a60-8800-c8a38fbd6bbc tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1319 microversion: 2.1 time: 0.331947 Nov 01 01:21:12.103783 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 249/484] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:21:11 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1319 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:21:12.427360 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-7ae3fc89-1f3a-4563-af6f-4ea4b9f735b4 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:21:12.428347 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-7ae3fc89-1f3a-4563-af6f-4ea4b9f735b4 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:21:12.434000 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-7ae3fc89-1f3a-4563-af6f-4ea4b9f735b4 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:21:12.434468 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-7ae3fc89-1f3a-4563-af6f-4ea4b9f735b4 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:21:12.435220 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-7ae3fc89-1f3a-4563-af6f-4ea4b9f735b4 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:21:12.439876 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-7ae3fc89-1f3a-4563-af6f-4ea4b9f735b4 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:21:12.475038 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.objects.instance [None req-7ae3fc89-1f3a-4563-af6f-4ea4b9f735b4 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lazy-loading 'flavor' on Instance uuid f02098be-ed15-45a0-a599-941cb0e1eebb {{(pid=116267) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 01 01:21:12.588665 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-d2f17503-469d-42a3-8ddf-148d93d5909d tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:21:12.589458 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-d2f17503-469d-42a3-8ddf-148d93d5909d tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:21:12.596757 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d2f17503-469d-42a3-8ddf-148d93d5909d tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:21:12.597401 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d2f17503-469d-42a3-8ddf-148d93d5909d tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:21:12.598610 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d2f17503-469d-42a3-8ddf-148d93d5909d tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:21:12.599367 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d2f17503-469d-42a3-8ddf-148d93d5909d tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:21:12.776458 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-d2f17503-469d-42a3-8ddf-148d93d5909d tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:21:12.785337 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-d2f17503-469d-42a3-8ddf-148d93d5909d tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1707 microversion: 2.1 time: 0.200163 Nov 01 01:21:12.795340 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 250/485] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:21:12 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1707 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:21:12.896324 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-7ae3fc89-1f3a-4563-af6f-4ea4b9f735b4 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "POST /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/action" status: 200 len: 32 microversion: 2.1 time: 0.471988 Nov 01 01:21:12.898413 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 236/486] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Nov 1 01:21:12 2021] POST /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/action => generated 32 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 01 01:21:12.914523 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-9a3619c2-2f33-4953-ae33-59a5793f5bde tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:21:12.916431 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-9a3619c2-2f33-4953-ae33-59a5793f5bde tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:21:12.929763 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9a3619c2-2f33-4953-ae33-59a5793f5bde tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:21:12.931052 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9a3619c2-2f33-4953-ae33-59a5793f5bde tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:21:12.932026 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9a3619c2-2f33-4953-ae33-59a5793f5bde tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:21:12.932636 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9a3619c2-2f33-4953-ae33-59a5793f5bde tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:21:13.123016 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-9a3619c2-2f33-4953-ae33-59a5793f5bde tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:21:13.129689 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-14d23d24-01f7-4d49-a01e-fae670f7e80e tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:21:13.130405 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-14d23d24-01f7-4d49-a01e-fae670f7e80e tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:21:13.147913 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-9a3619c2-2f33-4953-ae33-59a5793f5bde tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1569 microversion: 2.1 time: 0.245598 Nov 01 01:21:13.149880 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-14d23d24-01f7-4d49-a01e-fae670f7e80e tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:21:13.151359 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 251/487] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:21:12 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1569 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:21:13.151997 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-14d23d24-01f7-4d49-a01e-fae670f7e80e tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:21:13.152961 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-14d23d24-01f7-4d49-a01e-fae670f7e80e tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:21:13.154916 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-14d23d24-01f7-4d49-a01e-fae670f7e80e tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:21:13.380876 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-14d23d24-01f7-4d49-a01e-fae670f7e80e tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:21:13.392988 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-14d23d24-01f7-4d49-a01e-fae670f7e80e tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1319 microversion: 2.1 time: 0.274893 Nov 01 01:21:13.404044 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 237/488] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:21:13 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1319 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:21:13.802866 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-207dd48c-72e0-4edf-b701-981409632353 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:21:13.803379 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-207dd48c-72e0-4edf-b701-981409632353 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:21:13.812396 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-207dd48c-72e0-4edf-b701-981409632353 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:21:13.815531 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-207dd48c-72e0-4edf-b701-981409632353 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:21:13.816785 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-207dd48c-72e0-4edf-b701-981409632353 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:21:13.817569 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-207dd48c-72e0-4edf-b701-981409632353 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:21:14.144080 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-207dd48c-72e0-4edf-b701-981409632353 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:21:14.165905 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-5274642c-5e7f-424c-b89d-c15dc3ec2b2b tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:21:14.167308 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-5274642c-5e7f-424c-b89d-c15dc3ec2b2b tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:21:14.183792 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-5274642c-5e7f-424c-b89d-c15dc3ec2b2b tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:21:14.186034 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-207dd48c-72e0-4edf-b701-981409632353 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1711 microversion: 2.1 time: 0.386822 Nov 01 01:21:14.188341 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 252/489] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:21:13 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1711 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:21:14.190599 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-5274642c-5e7f-424c-b89d-c15dc3ec2b2b tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:21:14.190599 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-5274642c-5e7f-424c-b89d-c15dc3ec2b2b tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:21:14.190599 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-5274642c-5e7f-424c-b89d-c15dc3ec2b2b tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:21:14.414891 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-b6d6103b-c597-40f7-a6dc-e610a83ed735 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:21:14.416072 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-b6d6103b-c597-40f7-a6dc-e610a83ed735 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:21:14.441567 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b6d6103b-c597-40f7-a6dc-e610a83ed735 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:21:14.442551 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b6d6103b-c597-40f7-a6dc-e610a83ed735 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:21:14.444572 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b6d6103b-c597-40f7-a6dc-e610a83ed735 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:21:14.446150 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b6d6103b-c597-40f7-a6dc-e610a83ed735 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:21:14.470954 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-5274642c-5e7f-424c-b89d-c15dc3ec2b2b tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:21:14.480472 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-5274642c-5e7f-424c-b89d-c15dc3ec2b2b tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1569 microversion: 2.1 time: 0.318561 Nov 01 01:21:14.483167 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 238/490] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:21:14 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1569 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:21:14.663172 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-b6d6103b-c597-40f7-a6dc-e610a83ed735 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:21:14.672605 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-b6d6103b-c597-40f7-a6dc-e610a83ed735 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1319 microversion: 2.1 time: 0.265062 Nov 01 01:21:14.679910 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 253/491] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:21:14 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1319 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:21:15.081851 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [req-c632c38b-2f78-4251-9687-13a76c8bc547 req-dedce4f7-f2ba-4d49-8a7c-fd70fa86f425 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0eb63a66-7e46-40fb-9087-543fbf9cad4b", "name": "network-vif-plugged", "status": "completed", "tag": "28667542-04d5-40d8-bfae-df6a7f6e3a3e"}]} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:21:15.083733 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 01 01:21:15.083733 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: warnings.warn(msg) Nov 01 01:21:15.126647 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [req-c632c38b-2f78-4251-9687-13a76c8bc547 req-dedce4f7-f2ba-4d49-8a7c-fd70fa86f425 service nova] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:21:15.140967 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [req-c632c38b-2f78-4251-9687-13a76c8bc547 req-dedce4f7-f2ba-4d49-8a7c-fd70fa86f425 service nova] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:21:15.158650 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.compute.server_external_events [req-c632c38b-2f78-4251-9687-13a76c8bc547 req-dedce4f7-f2ba-4d49-8a7c-fd70fa86f425 service nova] Creating event network-vif-plugged:28667542-04d5-40d8-bfae-df6a7f6e3a3e for instance 0eb63a66-7e46-40fb-9087-543fbf9cad4b on hv-cinder-81561 Nov 01 01:21:15.165560 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [req-c632c38b-2f78-4251-9687-13a76c8bc547 req-dedce4f7-f2ba-4d49-8a7c-fd70fa86f425 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087326 Nov 01 01:21:15.166970 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 239/492] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Nov 1 01:21:15 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:21:15.501103 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-c468a563-dbf2-4171-b576-de659a552e2d tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:21:15.501770 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-c468a563-dbf2-4171-b576-de659a552e2d tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:21:15.508762 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c468a563-dbf2-4171-b576-de659a552e2d tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:21:15.509212 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c468a563-dbf2-4171-b576-de659a552e2d tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:21:15.509987 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c468a563-dbf2-4171-b576-de659a552e2d tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:21:15.510410 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c468a563-dbf2-4171-b576-de659a552e2d tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:21:15.691225 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-a3015f3a-6c3c-4b4c-8910-7cd0ca346cc3 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:21:15.692423 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-a3015f3a-6c3c-4b4c-8910-7cd0ca346cc3 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:21:15.700238 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a3015f3a-6c3c-4b4c-8910-7cd0ca346cc3 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:21:15.700980 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a3015f3a-6c3c-4b4c-8910-7cd0ca346cc3 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:21:15.701769 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a3015f3a-6c3c-4b4c-8910-7cd0ca346cc3 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:21:15.702206 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a3015f3a-6c3c-4b4c-8910-7cd0ca346cc3 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:21:15.742179 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-c468a563-dbf2-4171-b576-de659a552e2d tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:21:15.750630 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-c468a563-dbf2-4171-b576-de659a552e2d tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1569 microversion: 2.1 time: 0.254123 Nov 01 01:21:15.756092 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 254/493] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:21:15 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1569 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:21:15.884655 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-a3015f3a-6c3c-4b4c-8910-7cd0ca346cc3 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:21:15.895872 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-a3015f3a-6c3c-4b4c-8910-7cd0ca346cc3 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1319 microversion: 2.1 time: 0.209811 Nov 01 01:21:15.896448 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 240/494] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:21:15 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1319 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:21:16.173527 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-fbeb4ed0-5ad5-4bf4-89f5-464e8527b1ef tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-513783490", "imageRef": "b9068d8d-b02d-4043-9f0c-3d774cb372b3", "flavorRef": "452"}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:21:16.240180 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.network.neutron [None req-fbeb4ed0-5ad5-4bf4-89f5-464e8527b1ef tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] validate_networks() for None {{(pid=116266) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Nov 01 01:21:16.588013 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.virt.hardware [None req-fbeb4ed0-5ad5-4bf4-89f5-464e8527b1ef tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Flavor limits 0:0:0 {{(pid=116266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 01 01:21:16.588930 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.virt.hardware [None req-fbeb4ed0-5ad5-4bf4-89f5-464e8527b1ef tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Image limits 0:0:0 {{(pid=116266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 01 01:21:16.589670 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.virt.hardware [None req-fbeb4ed0-5ad5-4bf4-89f5-464e8527b1ef tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Flavor pref 0:0:0 {{(pid=116266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 01 01:21:16.595340 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.virt.hardware [None req-fbeb4ed0-5ad5-4bf4-89f5-464e8527b1ef tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Image pref 0:0:0 {{(pid=116266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 01 01:21:16.595340 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.virt.hardware [None req-fbeb4ed0-5ad5-4bf4-89f5-464e8527b1ef tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 01 01:21:16.601779 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-fbeb4ed0-5ad5-4bf4-89f5-464e8527b1ef tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:21:16.602749 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-fbeb4ed0-5ad5-4bf4-89f5-464e8527b1ef tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:21:16.603759 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-fbeb4ed0-5ad5-4bf4-89f5-464e8527b1ef tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:21:16.604465 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-fbeb4ed0-5ad5-4bf4-89f5-464e8527b1ef tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:21:16.625123 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.quota [None req-fbeb4ed0-5ad5-4bf4-89f5-464e8527b1ef tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Getting quotas for project 70abf79c702a4ab09f0a25c3dd9800a9. Resources: {'instances', 'cores', 'ram'} {{(pid=116266) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 01 01:21:16.631432 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.quota [None req-fbeb4ed0-5ad5-4bf4-89f5-464e8527b1ef tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Getting quotas for user ff78d19b078b41f88a713bcaf706fe87 and project 70abf79c702a4ab09f0a25c3dd9800a9. Resources: {'instances', 'cores', 'ram'} {{(pid=116266) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 01 01:21:16.648024 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-fbeb4ed0-5ad5-4bf4-89f5-464e8527b1ef tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Going to run 1 instances... {{(pid=116266) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 01 01:21:16.650229 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-fbeb4ed0-5ad5-4bf4-89f5-464e8527b1ef tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] [instance: f086994d-4512-4375-b734-2a35ffe21378] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b9068d8d-b02d-4043-9f0c-3d774cb372b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116266) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 01 01:21:16.772223 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-a194f972-916f-48c4-9fa1-4ac9c1da80f9 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:21:16.772821 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-a194f972-916f-48c4-9fa1-4ac9c1da80f9 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:21:16.775495 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-fbeb4ed0-5ad5-4bf4-89f5-464e8527b1ef tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.607155 Nov 01 01:21:16.781751 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 255/495] 10.222.0.47 () {60 vars in 1146 bytes} [Mon Nov 1 01:21:16 2021] POST /compute/v2.1/servers => generated 380 bytes in 608 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 01 01:21:16.789861 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-3ee6bfce-c00b-43b2-9d97-e8c0bf70d512 tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:21:16.790498 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-3ee6bfce-c00b-43b2-9d97-e8c0bf70d512 tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] [instance: f086994d-4512-4375-b734-2a35ffe21378] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:21:16.793663 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a194f972-916f-48c4-9fa1-4ac9c1da80f9 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:21:16.794124 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a194f972-916f-48c4-9fa1-4ac9c1da80f9 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:21:16.795042 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a194f972-916f-48c4-9fa1-4ac9c1da80f9 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:21:16.795891 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a194f972-916f-48c4-9fa1-4ac9c1da80f9 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:21:16.879160 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-3ee6bfce-c00b-43b2-9d97-e8c0bf70d512 tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff78d19b078b41f88a713bcaf706fe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70abf79c702a4ab09f0a25c3dd9800a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:21:16.884991 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-3ee6bfce-c00b-43b2-9d97-e8c0bf70d512 tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] 10.222.0.47 "GET /compute/v2.1/servers/f086994d-4512-4375-b734-2a35ffe21378" status: 200 len: 1214 microversion: 2.1 time: 0.098672 Nov 01 01:21:16.896097 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 256/496] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:21:16 2021] GET /compute/v2.1/servers/f086994d-4512-4375-b734-2a35ffe21378 => generated 1214 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:21:16.926892 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-c47e8135-21eb-42a0-a927-5c2df83d7034 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:21:16.927518 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-c47e8135-21eb-42a0-a927-5c2df83d7034 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:21:16.934258 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c47e8135-21eb-42a0-a927-5c2df83d7034 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:21:16.934745 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c47e8135-21eb-42a0-a927-5c2df83d7034 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:21:16.935535 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c47e8135-21eb-42a0-a927-5c2df83d7034 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:21:16.935974 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c47e8135-21eb-42a0-a927-5c2df83d7034 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:21:16.987668 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-a194f972-916f-48c4-9fa1-4ac9c1da80f9 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:21:16.996837 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-a194f972-916f-48c4-9fa1-4ac9c1da80f9 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1569 microversion: 2.1 time: 0.228068 Nov 01 01:21:16.997857 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 241/497] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:21:16 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1569 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:21:17.087886 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-c47e8135-21eb-42a0-a927-5c2df83d7034 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:21:17.095486 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-c47e8135-21eb-42a0-a927-5c2df83d7034 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1319 microversion: 2.1 time: 0.176984 Nov 01 01:21:17.096067 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 257/498] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:21:16 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1319 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:21:17.902152 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-b9b3bd21-546e-4e25-9f14-a2fd06e58219 tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:21:17.903590 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-b9b3bd21-546e-4e25-9f14-a2fd06e58219 tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] [instance: f086994d-4512-4375-b734-2a35ffe21378] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:21:17.995838 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-b9b3bd21-546e-4e25-9f14-a2fd06e58219 tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff78d19b078b41f88a713bcaf706fe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70abf79c702a4ab09f0a25c3dd9800a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:21:18.004712 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-b9b3bd21-546e-4e25-9f14-a2fd06e58219 tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] 10.222.0.47 "GET /compute/v2.1/servers/f086994d-4512-4375-b734-2a35ffe21378" status: 200 len: 1214 microversion: 2.1 time: 0.105974 Nov 01 01:21:18.005689 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 242/499] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:21:17 2021] GET /compute/v2.1/servers/f086994d-4512-4375-b734-2a35ffe21378 => generated 1214 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:21:18.015051 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-a7ee45f3-485c-4541-a5fe-ab6fc9e456bc tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:21:18.016366 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-a7ee45f3-485c-4541-a5fe-ab6fc9e456bc tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:21:18.023861 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a7ee45f3-485c-4541-a5fe-ab6fc9e456bc tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:21:18.026886 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a7ee45f3-485c-4541-a5fe-ab6fc9e456bc tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:21:18.028260 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a7ee45f3-485c-4541-a5fe-ab6fc9e456bc tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:21:18.028756 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a7ee45f3-485c-4541-a5fe-ab6fc9e456bc tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:21:18.116400 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-f3c3d0c3-23fb-426a-9205-e2d936dcdb84 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:21:18.117291 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-f3c3d0c3-23fb-426a-9205-e2d936dcdb84 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:21:18.141206 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f3c3d0c3-23fb-426a-9205-e2d936dcdb84 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:21:18.142746 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f3c3d0c3-23fb-426a-9205-e2d936dcdb84 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:21:18.143969 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f3c3d0c3-23fb-426a-9205-e2d936dcdb84 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:21:18.144919 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f3c3d0c3-23fb-426a-9205-e2d936dcdb84 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:21:18.183637 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-a7ee45f3-485c-4541-a5fe-ab6fc9e456bc tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:21:18.198964 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-a7ee45f3-485c-4541-a5fe-ab6fc9e456bc tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1569 microversion: 2.1 time: 0.187987 Nov 01 01:21:18.200780 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 258/500] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:21:18 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1569 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:21:18.281593 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-f3c3d0c3-23fb-426a-9205-e2d936dcdb84 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:21:18.289023 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-f3c3d0c3-23fb-426a-9205-e2d936dcdb84 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1507 microversion: 2.1 time: 0.180682 Nov 01 01:21:18.289584 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 243/501] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:21:18 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1507 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:21:19.021851 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-0ad25fac-6951-4c50-b78a-e061bcc9d16c tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:21:19.022463 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-0ad25fac-6951-4c50-b78a-e061bcc9d16c tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] [instance: f086994d-4512-4375-b734-2a35ffe21378] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:21:19.028804 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0ad25fac-6951-4c50-b78a-e061bcc9d16c tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:21:19.029243 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0ad25fac-6951-4c50-b78a-e061bcc9d16c tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:21:19.030094 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0ad25fac-6951-4c50-b78a-e061bcc9d16c tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:21:19.030596 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0ad25fac-6951-4c50-b78a-e061bcc9d16c tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:21:19.156768 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-0ad25fac-6951-4c50-b78a-e061bcc9d16c tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff78d19b078b41f88a713bcaf706fe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70abf79c702a4ab09f0a25c3dd9800a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:21:19.167091 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-0ad25fac-6951-4c50-b78a-e061bcc9d16c tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] 10.222.0.47 "GET /compute/v2.1/servers/f086994d-4512-4375-b734-2a35ffe21378" status: 200 len: 1218 microversion: 2.1 time: 0.149729 Nov 01 01:21:19.167663 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 259/502] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:21:19 2021] GET /compute/v2.1/servers/f086994d-4512-4375-b734-2a35ffe21378 => generated 1218 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:21:19.217056 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-021d6d6b-4375-4a6f-8f8f-8d4b3a9fb6be tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:21:19.221260 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-021d6d6b-4375-4a6f-8f8f-8d4b3a9fb6be tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:21:19.227974 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-021d6d6b-4375-4a6f-8f8f-8d4b3a9fb6be tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:21:19.228908 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-021d6d6b-4375-4a6f-8f8f-8d4b3a9fb6be tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:21:19.231209 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-021d6d6b-4375-4a6f-8f8f-8d4b3a9fb6be tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:21:19.231748 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-021d6d6b-4375-4a6f-8f8f-8d4b3a9fb6be tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:21:19.589031 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-021d6d6b-4375-4a6f-8f8f-8d4b3a9fb6be tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:21:19.615937 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-021d6d6b-4375-4a6f-8f8f-8d4b3a9fb6be tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1569 microversion: 2.1 time: 0.402528 Nov 01 01:21:19.623689 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 244/503] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:21:19 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1569 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:21:20.184320 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-ddfc9735-f0bb-45fe-b6f5-7b2f8c015a64 tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:21:20.185721 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-ddfc9735-f0bb-45fe-b6f5-7b2f8c015a64 tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] [instance: f086994d-4512-4375-b734-2a35ffe21378] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:21:20.193050 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ddfc9735-f0bb-45fe-b6f5-7b2f8c015a64 tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:21:20.193719 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ddfc9735-f0bb-45fe-b6f5-7b2f8c015a64 tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:21:20.194699 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ddfc9735-f0bb-45fe-b6f5-7b2f8c015a64 tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:21:20.195527 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ddfc9735-f0bb-45fe-b6f5-7b2f8c015a64 tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:21:20.610804 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-ddfc9735-f0bb-45fe-b6f5-7b2f8c015a64 tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff78d19b078b41f88a713bcaf706fe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70abf79c702a4ab09f0a25c3dd9800a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:21:20.623836 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-ddfc9735-f0bb-45fe-b6f5-7b2f8c015a64 tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] 10.222.0.47 "GET /compute/v2.1/servers/f086994d-4512-4375-b734-2a35ffe21378" status: 200 len: 1210 microversion: 2.1 time: 0.439531 Nov 01 01:21:20.629185 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 260/504] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:21:20 2021] GET /compute/v2.1/servers/f086994d-4512-4375-b734-2a35ffe21378 => generated 1210 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:21:20.644780 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-0932a72e-7a9c-4472-8500-bcfbf6a1e981 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:21:20.646635 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-0932a72e-7a9c-4472-8500-bcfbf6a1e981 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:21:20.656711 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0932a72e-7a9c-4472-8500-bcfbf6a1e981 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:21:20.657360 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0932a72e-7a9c-4472-8500-bcfbf6a1e981 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:21:20.659239 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0932a72e-7a9c-4472-8500-bcfbf6a1e981 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:21:20.660020 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0932a72e-7a9c-4472-8500-bcfbf6a1e981 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:21:20.959332 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-0932a72e-7a9c-4472-8500-bcfbf6a1e981 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:21:20.970278 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-0932a72e-7a9c-4472-8500-bcfbf6a1e981 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1569 microversion: 2.1 time: 0.338539 Nov 01 01:21:20.970910 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 245/505] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:21:20 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1569 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:21:21.649902 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-935267e9-f6ae-4eb1-9b95-f6084e2167a3 tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:21:21.651342 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-935267e9-f6ae-4eb1-9b95-f6084e2167a3 tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] [instance: f086994d-4512-4375-b734-2a35ffe21378] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:21:21.677816 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-935267e9-f6ae-4eb1-9b95-f6084e2167a3 tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:21:21.678409 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-935267e9-f6ae-4eb1-9b95-f6084e2167a3 tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:21:21.679282 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-935267e9-f6ae-4eb1-9b95-f6084e2167a3 tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:21:21.680640 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-935267e9-f6ae-4eb1-9b95-f6084e2167a3 tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:21:21.926077 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-935267e9-f6ae-4eb1-9b95-f6084e2167a3 tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff78d19b078b41f88a713bcaf706fe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70abf79c702a4ab09f0a25c3dd9800a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:21:21.935751 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-935267e9-f6ae-4eb1-9b95-f6084e2167a3 tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] 10.222.0.47 "GET /compute/v2.1/servers/f086994d-4512-4375-b734-2a35ffe21378" status: 200 len: 1210 microversion: 2.1 time: 0.289715 Nov 01 01:21:21.938717 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 261/506] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:21:21 2021] GET /compute/v2.1/servers/f086994d-4512-4375-b734-2a35ffe21378 => generated 1210 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:21:21.987736 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-73b2ee59-7dea-4de0-8b39-e0161cab195d tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:21:21.988685 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-73b2ee59-7dea-4de0-8b39-e0161cab195d tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:21:22.007117 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-73b2ee59-7dea-4de0-8b39-e0161cab195d tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:21:22.007688 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-73b2ee59-7dea-4de0-8b39-e0161cab195d tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:21:22.009955 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-73b2ee59-7dea-4de0-8b39-e0161cab195d tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:21:22.010404 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-73b2ee59-7dea-4de0-8b39-e0161cab195d tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:21:22.959873 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-ff303e97-9623-420f-9a3e-27159804b998 tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:21:22.960502 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-ff303e97-9623-420f-9a3e-27159804b998 tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] [instance: f086994d-4512-4375-b734-2a35ffe21378] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:21:22.976899 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ff303e97-9623-420f-9a3e-27159804b998 tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:21:22.977936 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ff303e97-9623-420f-9a3e-27159804b998 tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:21:22.981929 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ff303e97-9623-420f-9a3e-27159804b998 tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:21:22.982364 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ff303e97-9623-420f-9a3e-27159804b998 tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:21:23.043517 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-73b2ee59-7dea-4de0-8b39-e0161cab195d tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:21:23.057084 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-73b2ee59-7dea-4de0-8b39-e0161cab195d tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1569 microversion: 2.1 time: 1.073425 Nov 01 01:21:23.067332 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 246/507] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:21:21 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1569 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:21:23.185257 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-ff303e97-9623-420f-9a3e-27159804b998 tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff78d19b078b41f88a713bcaf706fe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70abf79c702a4ab09f0a25c3dd9800a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:21:23.204128 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-ff303e97-9623-420f-9a3e-27159804b998 tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] 10.222.0.47 "GET /compute/v2.1/servers/f086994d-4512-4375-b734-2a35ffe21378" status: 200 len: 1266 microversion: 2.1 time: 0.252606 Nov 01 01:21:23.209948 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 262/508] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:21:22 2021] GET /compute/v2.1/servers/f086994d-4512-4375-b734-2a35ffe21378 => generated 1266 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:21:24.074148 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-1e80ddcd-f791-4fab-b87a-dc4b7b0f4b6d tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:21:24.075553 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-1e80ddcd-f791-4fab-b87a-dc4b7b0f4b6d tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:21:24.084354 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-1e80ddcd-f791-4fab-b87a-dc4b7b0f4b6d tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:21:24.085109 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-1e80ddcd-f791-4fab-b87a-dc4b7b0f4b6d tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:21:24.090691 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-1e80ddcd-f791-4fab-b87a-dc4b7b0f4b6d tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:21:24.090691 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-1e80ddcd-f791-4fab-b87a-dc4b7b0f4b6d tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:21:24.223001 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-929d4580-d33b-4bf4-9f16-ecb64a9568e9 tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:21:24.223770 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-929d4580-d33b-4bf4-9f16-ecb64a9568e9 tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] [instance: f086994d-4512-4375-b734-2a35ffe21378] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:21:24.229799 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-929d4580-d33b-4bf4-9f16-ecb64a9568e9 tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:21:24.231874 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-929d4580-d33b-4bf4-9f16-ecb64a9568e9 tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:21:24.233425 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-929d4580-d33b-4bf4-9f16-ecb64a9568e9 tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:21:24.235065 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-929d4580-d33b-4bf4-9f16-ecb64a9568e9 tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:21:24.398075 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-929d4580-d33b-4bf4-9f16-ecb64a9568e9 tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff78d19b078b41f88a713bcaf706fe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70abf79c702a4ab09f0a25c3dd9800a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:21:24.407292 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-929d4580-d33b-4bf4-9f16-ecb64a9568e9 tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] 10.222.0.47 "GET /compute/v2.1/servers/f086994d-4512-4375-b734-2a35ffe21378" status: 200 len: 1272 microversion: 2.1 time: 0.188571 Nov 01 01:21:24.415437 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 263/509] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:21:24 2021] GET /compute/v2.1/servers/f086994d-4512-4375-b734-2a35ffe21378 => generated 1272 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:21:24.946387 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-1e80ddcd-f791-4fab-b87a-dc4b7b0f4b6d tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:21:24.955635 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-1e80ddcd-f791-4fab-b87a-dc4b7b0f4b6d tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1569 microversion: 2.1 time: 0.885179 Nov 01 01:21:24.959649 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 247/510] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:21:24 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1569 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:21:25.434374 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-cd584269-cae6-45cb-812c-41c1a8ed4c16 tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:21:25.435183 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-cd584269-cae6-45cb-812c-41c1a8ed4c16 tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] [instance: f086994d-4512-4375-b734-2a35ffe21378] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:21:25.469842 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-cd584269-cae6-45cb-812c-41c1a8ed4c16 tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:21:25.472417 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-cd584269-cae6-45cb-812c-41c1a8ed4c16 tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:21:25.473274 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-cd584269-cae6-45cb-812c-41c1a8ed4c16 tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:21:25.474826 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-cd584269-cae6-45cb-812c-41c1a8ed4c16 tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:21:25.613110 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-cd584269-cae6-45cb-812c-41c1a8ed4c16 tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff78d19b078b41f88a713bcaf706fe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70abf79c702a4ab09f0a25c3dd9800a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:21:25.622573 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-cd584269-cae6-45cb-812c-41c1a8ed4c16 tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] 10.222.0.47 "GET /compute/v2.1/servers/f086994d-4512-4375-b734-2a35ffe21378" status: 200 len: 1272 microversion: 2.1 time: 0.197722 Nov 01 01:21:25.623925 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 264/511] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:21:25 2021] GET /compute/v2.1/servers/f086994d-4512-4375-b734-2a35ffe21378 => generated 1272 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:21:25.979011 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-73ea836b-4dc3-4b39-b4ab-31d18b84bcd9 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:21:25.979608 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-73ea836b-4dc3-4b39-b4ab-31d18b84bcd9 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:21:25.989977 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-73ea836b-4dc3-4b39-b4ab-31d18b84bcd9 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:21:25.990790 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-73ea836b-4dc3-4b39-b4ab-31d18b84bcd9 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:21:25.991744 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-73ea836b-4dc3-4b39-b4ab-31d18b84bcd9 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:21:25.992424 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-73ea836b-4dc3-4b39-b4ab-31d18b84bcd9 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:21:26.504976 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-73ea836b-4dc3-4b39-b4ab-31d18b84bcd9 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:21:26.516978 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-73ea836b-4dc3-4b39-b4ab-31d18b84bcd9 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1569 microversion: 2.1 time: 0.541432 Nov 01 01:21:26.516978 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 248/512] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:21:25 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1569 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:21:26.640912 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-c60321c2-94c7-4eb8-a0e9-91b4b30eb8ff tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:21:26.641854 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-c60321c2-94c7-4eb8-a0e9-91b4b30eb8ff tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] [instance: f086994d-4512-4375-b734-2a35ffe21378] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:21:26.653372 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c60321c2-94c7-4eb8-a0e9-91b4b30eb8ff tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:21:26.658097 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c60321c2-94c7-4eb8-a0e9-91b4b30eb8ff tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:21:26.659311 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c60321c2-94c7-4eb8-a0e9-91b4b30eb8ff tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:21:26.659981 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c60321c2-94c7-4eb8-a0e9-91b4b30eb8ff tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:21:27.301341 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-c60321c2-94c7-4eb8-a0e9-91b4b30eb8ff tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff78d19b078b41f88a713bcaf706fe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70abf79c702a4ab09f0a25c3dd9800a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:21:27.336146 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-c60321c2-94c7-4eb8-a0e9-91b4b30eb8ff tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] 10.222.0.47 "GET /compute/v2.1/servers/f086994d-4512-4375-b734-2a35ffe21378" status: 200 len: 1314 microversion: 2.1 time: 0.699292 Nov 01 01:21:27.340517 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 265/513] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:21:26 2021] GET /compute/v2.1/servers/f086994d-4512-4375-b734-2a35ffe21378 => generated 1314 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:21:27.533386 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-816db14c-e955-4110-99b4-e7a144a97e04 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:21:27.533973 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-816db14c-e955-4110-99b4-e7a144a97e04 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:21:27.544167 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-816db14c-e955-4110-99b4-e7a144a97e04 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:21:27.551321 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-816db14c-e955-4110-99b4-e7a144a97e04 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:21:27.552485 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-816db14c-e955-4110-99b4-e7a144a97e04 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:21:27.553105 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-816db14c-e955-4110-99b4-e7a144a97e04 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:21:28.332973 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-816db14c-e955-4110-99b4-e7a144a97e04 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:21:28.355843 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-0559cff3-6819-4dee-95d1-f5924a46e29b tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:21:28.357479 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-0559cff3-6819-4dee-95d1-f5924a46e29b tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] [instance: f086994d-4512-4375-b734-2a35ffe21378] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:21:28.367389 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-816db14c-e955-4110-99b4-e7a144a97e04 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1569 microversion: 2.1 time: 0.837824 Nov 01 01:21:28.377828 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0559cff3-6819-4dee-95d1-f5924a46e29b tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:21:28.377828 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0559cff3-6819-4dee-95d1-f5924a46e29b tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:21:28.377828 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0559cff3-6819-4dee-95d1-f5924a46e29b tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:21:28.377828 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0559cff3-6819-4dee-95d1-f5924a46e29b tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:21:28.381032 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 249/514] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:21:27 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1569 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:21:28.829728 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-0559cff3-6819-4dee-95d1-f5924a46e29b tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff78d19b078b41f88a713bcaf706fe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70abf79c702a4ab09f0a25c3dd9800a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:21:28.841794 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-0559cff3-6819-4dee-95d1-f5924a46e29b tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] 10.222.0.47 "GET /compute/v2.1/servers/f086994d-4512-4375-b734-2a35ffe21378" status: 200 len: 1314 microversion: 2.1 time: 0.490277 Nov 01 01:21:28.852264 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 266/515] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:21:28 2021] GET /compute/v2.1/servers/f086994d-4512-4375-b734-2a35ffe21378 => generated 1314 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:21:29.388061 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-4cbf6ce8-c2d4-424c-a20c-befd4f0e18e4 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:21:29.388816 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-4cbf6ce8-c2d4-424c-a20c-befd4f0e18e4 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:21:29.397237 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4cbf6ce8-c2d4-424c-a20c-befd4f0e18e4 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:21:29.398057 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4cbf6ce8-c2d4-424c-a20c-befd4f0e18e4 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:21:29.400485 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4cbf6ce8-c2d4-424c-a20c-befd4f0e18e4 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:21:29.400485 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4cbf6ce8-c2d4-424c-a20c-befd4f0e18e4 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:21:29.868901 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-c2abf7b5-bc2c-4d69-863e-c73d46e6b77c tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:21:29.870172 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-c2abf7b5-bc2c-4d69-863e-c73d46e6b77c tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] [instance: f086994d-4512-4375-b734-2a35ffe21378] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:21:29.912612 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c2abf7b5-bc2c-4d69-863e-c73d46e6b77c tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:21:29.918710 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c2abf7b5-bc2c-4d69-863e-c73d46e6b77c tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:21:29.920443 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c2abf7b5-bc2c-4d69-863e-c73d46e6b77c tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:21:29.920443 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c2abf7b5-bc2c-4d69-863e-c73d46e6b77c tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:21:29.963076 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-4cbf6ce8-c2d4-424c-a20c-befd4f0e18e4 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:21:29.975740 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-4cbf6ce8-c2d4-424c-a20c-befd4f0e18e4 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1569 microversion: 2.1 time: 0.593725 Nov 01 01:21:29.978836 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 250/516] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:21:29 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1569 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:21:30.328592 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-c2abf7b5-bc2c-4d69-863e-c73d46e6b77c tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff78d19b078b41f88a713bcaf706fe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70abf79c702a4ab09f0a25c3dd9800a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:21:30.340050 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-c2abf7b5-bc2c-4d69-863e-c73d46e6b77c tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] 10.222.0.47 "GET /compute/v2.1/servers/f086994d-4512-4375-b734-2a35ffe21378" status: 200 len: 1314 microversion: 2.1 time: 0.480786 Nov 01 01:21:30.344813 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 267/517] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:21:29 2021] GET /compute/v2.1/servers/f086994d-4512-4375-b734-2a35ffe21378 => generated 1314 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:21:30.998899 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-21095a36-ecc5-4307-bc29-43f083d64d21 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:21:31.001132 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-21095a36-ecc5-4307-bc29-43f083d64d21 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:21:31.016999 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-21095a36-ecc5-4307-bc29-43f083d64d21 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:21:31.017682 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-21095a36-ecc5-4307-bc29-43f083d64d21 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:21:31.018840 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-21095a36-ecc5-4307-bc29-43f083d64d21 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:21:31.019457 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-21095a36-ecc5-4307-bc29-43f083d64d21 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:21:31.364272 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-84e37504-19eb-484a-bd94-72c1be402a21 tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:21:31.366170 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-84e37504-19eb-484a-bd94-72c1be402a21 tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] [instance: f086994d-4512-4375-b734-2a35ffe21378] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:21:31.376497 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-84e37504-19eb-484a-bd94-72c1be402a21 tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:21:31.377158 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-84e37504-19eb-484a-bd94-72c1be402a21 tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:21:31.380154 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-84e37504-19eb-484a-bd94-72c1be402a21 tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:21:31.380814 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-84e37504-19eb-484a-bd94-72c1be402a21 tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:21:31.857340 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-21095a36-ecc5-4307-bc29-43f083d64d21 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:21:31.865970 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-21095a36-ecc5-4307-bc29-43f083d64d21 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1569 microversion: 2.1 time: 0.874550 Nov 01 01:21:31.879742 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 251/518] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:21:30 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1569 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:21:31.879742 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [req-f85087e6-529a-46c2-b760-a27c85830afb req-faf95f53-ebef-46ee-88a6-90bd80510a3e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f086994d-4512-4375-b734-2a35ffe21378", "tag": "3f543a4c-4423-4633-b008-099bea3a18ba"}]} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:21:31.879742 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 01 01:21:31.879742 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: warnings.warn(msg) Nov 01 01:21:31.906471 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [req-f85087e6-529a-46c2-b760-a27c85830afb req-faf95f53-ebef-46ee-88a6-90bd80510a3e service nova] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:21:31.908724 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [req-f85087e6-529a-46c2-b760-a27c85830afb req-faf95f53-ebef-46ee-88a6-90bd80510a3e service nova] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:21:31.941034 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.compute.server_external_events [req-f85087e6-529a-46c2-b760-a27c85830afb req-faf95f53-ebef-46ee-88a6-90bd80510a3e service nova] Creating event network-changed:3f543a4c-4423-4633-b008-099bea3a18ba for instance f086994d-4512-4375-b734-2a35ffe21378 on hv-cinder-81561 Nov 01 01:21:31.964532 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [req-f85087e6-529a-46c2-b760-a27c85830afb req-faf95f53-ebef-46ee-88a6-90bd80510a3e service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092015 Nov 01 01:21:31.965387 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 252/519] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Nov 1 01:21:31 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:21:32.185592 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-84e37504-19eb-484a-bd94-72c1be402a21 tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff78d19b078b41f88a713bcaf706fe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70abf79c702a4ab09f0a25c3dd9800a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:21:32.194783 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-84e37504-19eb-484a-bd94-72c1be402a21 tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] 10.222.0.47 "GET /compute/v2.1/servers/f086994d-4512-4375-b734-2a35ffe21378" status: 200 len: 1314 microversion: 2.1 time: 0.838983 Nov 01 01:21:32.200292 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 268/520] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:21:31 2021] GET /compute/v2.1/servers/f086994d-4512-4375-b734-2a35ffe21378 => generated 1314 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:21:32.555019 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-9e670293-2304-43d9-a218-fec307cd18a9 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Action: 'create', calling method: .version_select at 0x7fccf63d0820>, body: {"keypair": {"name": "tempest-TestShelveInstance-2122604351"}} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:21:32.600884 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.quota [None req-9e670293-2304-43d9-a218-fec307cd18a9 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Getting quotas for project 89ba2f03280e45b4ad8deab41fffe14f. Resources: {'key_pairs'} {{(pid=116267) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 01 01:21:32.606794 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.quota [None req-9e670293-2304-43d9-a218-fec307cd18a9 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Getting quotas for user b67e821884b248a99caf956b7f3de189 and project 89ba2f03280e45b4ad8deab41fffe14f. Resources: {'key_pairs'} {{(pid=116267) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 01 01:21:32.886540 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-28192226-a695-415b-8810-1426c94836b7 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:21:32.887934 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-28192226-a695-415b-8810-1426c94836b7 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:21:32.908060 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-28192226-a695-415b-8810-1426c94836b7 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:21:32.908658 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-28192226-a695-415b-8810-1426c94836b7 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:21:32.909560 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-28192226-a695-415b-8810-1426c94836b7 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:21:32.910103 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-28192226-a695-415b-8810-1426c94836b7 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:21:33.327761 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.quota [None req-9e670293-2304-43d9-a218-fec307cd18a9 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Getting quotas for project 89ba2f03280e45b4ad8deab41fffe14f. Resources: {'key_pairs'} {{(pid=116267) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 01 01:21:33.337901 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.quota [None req-9e670293-2304-43d9-a218-fec307cd18a9 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Getting quotas for user b67e821884b248a99caf956b7f3de189 and project 89ba2f03280e45b4ad8deab41fffe14f. Resources: {'key_pairs'} {{(pid=116267) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 01 01:21:33.412991 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-9e670293-2304-43d9-a218-fec307cd18a9 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 2312 microversion: 2.1 time: 1.371524 Nov 01 01:21:33.414997 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 253/521] 10.222.0.47 () {60 vars in 1157 bytes} [Mon Nov 1 01:21:32 2021] POST /compute/v2.1/os-keypairs => generated 2312 bytes in 1377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:21:33.446244 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-d9131d7e-91a4-48a3-a672-81af2868a53e tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:21:33.448330 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-d9131d7e-91a4-48a3-a672-81af2868a53e tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] [instance: f086994d-4512-4375-b734-2a35ffe21378] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:21:33.466696 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d9131d7e-91a4-48a3-a672-81af2868a53e tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:21:33.469460 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d9131d7e-91a4-48a3-a672-81af2868a53e tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:21:33.473438 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d9131d7e-91a4-48a3-a672-81af2868a53e tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:21:33.476929 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d9131d7e-91a4-48a3-a672-81af2868a53e tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:21:33.607734 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-28192226-a695-415b-8810-1426c94836b7 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:21:33.617173 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-28192226-a695-415b-8810-1426c94836b7 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1569 microversion: 2.1 time: 0.734212 Nov 01 01:21:33.621745 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 269/522] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:21:32 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1569 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:21:34.037945 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-d9131d7e-91a4-48a3-a672-81af2868a53e tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff78d19b078b41f88a713bcaf706fe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70abf79c702a4ab09f0a25c3dd9800a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:21:34.047719 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-d9131d7e-91a4-48a3-a672-81af2868a53e tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] 10.222.0.47 "GET /compute/v2.1/servers/f086994d-4512-4375-b734-2a35ffe21378" status: 200 len: 1314 microversion: 2.1 time: 0.628621 Nov 01 01:21:34.049078 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 254/523] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:21:33 2021] GET /compute/v2.1/servers/f086994d-4512-4375-b734-2a35ffe21378 => generated 1314 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:21:34.647745 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-df3f8b7d-8e2f-452a-a886-2a06a325dcea tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:21:34.647745 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-df3f8b7d-8e2f-452a-a886-2a06a325dcea tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:21:34.647745 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-df3f8b7d-8e2f-452a-a886-2a06a325dcea tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:21:34.647745 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-df3f8b7d-8e2f-452a-a886-2a06a325dcea tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:21:34.648534 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-df3f8b7d-8e2f-452a-a886-2a06a325dcea tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:21:34.648534 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-df3f8b7d-8e2f-452a-a886-2a06a325dcea tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:21:34.866491 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-df3f8b7d-8e2f-452a-a886-2a06a325dcea tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:21:34.875749 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-df3f8b7d-8e2f-452a-a886-2a06a325dcea tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1569 microversion: 2.1 time: 0.245027 Nov 01 01:21:34.876502 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 270/524] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:21:34 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1569 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:21:35.077610 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-182d3f08-f7f0-4d93-8468-3ac9a922d9db tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:21:35.080765 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-182d3f08-f7f0-4d93-8468-3ac9a922d9db tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] [instance: f086994d-4512-4375-b734-2a35ffe21378] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:21:35.103419 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-182d3f08-f7f0-4d93-8468-3ac9a922d9db tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:21:35.104687 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-182d3f08-f7f0-4d93-8468-3ac9a922d9db tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:21:35.106122 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-182d3f08-f7f0-4d93-8468-3ac9a922d9db tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:21:35.106925 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-182d3f08-f7f0-4d93-8468-3ac9a922d9db tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:21:35.426374 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-182d3f08-f7f0-4d93-8468-3ac9a922d9db tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff78d19b078b41f88a713bcaf706fe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70abf79c702a4ab09f0a25c3dd9800a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:21:35.436212 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-182d3f08-f7f0-4d93-8468-3ac9a922d9db tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] 10.222.0.47 "GET /compute/v2.1/servers/f086994d-4512-4375-b734-2a35ffe21378" status: 200 len: 1314 microversion: 2.1 time: 0.369768 Nov 01 01:21:35.439424 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 255/525] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:21:35 2021] GET /compute/v2.1/servers/f086994d-4512-4375-b734-2a35ffe21378 => generated 1314 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:21:35.893894 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-de65db63-33ae-4259-8173-dfa2b985dab2 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:21:35.895242 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-de65db63-33ae-4259-8173-dfa2b985dab2 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:21:35.902783 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-de65db63-33ae-4259-8173-dfa2b985dab2 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:21:35.903391 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-de65db63-33ae-4259-8173-dfa2b985dab2 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:21:35.904333 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-de65db63-33ae-4259-8173-dfa2b985dab2 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:21:35.905090 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-de65db63-33ae-4259-8173-dfa2b985dab2 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:21:36.212580 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-de65db63-33ae-4259-8173-dfa2b985dab2 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:21:36.235228 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-de65db63-33ae-4259-8173-dfa2b985dab2 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1569 microversion: 2.1 time: 0.345904 Nov 01 01:21:36.246266 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 271/526] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:21:35 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1569 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:21:36.456201 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-e3fa880e-032d-42d5-be34-2cafebe2cb78 tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:21:36.456811 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-e3fa880e-032d-42d5-be34-2cafebe2cb78 tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] [instance: f086994d-4512-4375-b734-2a35ffe21378] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:21:36.469528 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e3fa880e-032d-42d5-be34-2cafebe2cb78 tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:21:36.470245 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e3fa880e-032d-42d5-be34-2cafebe2cb78 tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:21:36.471224 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e3fa880e-032d-42d5-be34-2cafebe2cb78 tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:21:36.471810 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e3fa880e-032d-42d5-be34-2cafebe2cb78 tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:21:36.709181 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-e3fa880e-032d-42d5-be34-2cafebe2cb78 tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff78d19b078b41f88a713bcaf706fe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70abf79c702a4ab09f0a25c3dd9800a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:21:36.725564 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-e3fa880e-032d-42d5-be34-2cafebe2cb78 tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] 10.222.0.47 "GET /compute/v2.1/servers/f086994d-4512-4375-b734-2a35ffe21378" status: 200 len: 1314 microversion: 2.1 time: 0.273540 Nov 01 01:21:36.726155 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 256/527] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:21:36 2021] GET /compute/v2.1/servers/f086994d-4512-4375-b734-2a35ffe21378 => generated 1314 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:21:37.252722 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-5bbe61be-cbd8-4054-8344-29c0aa676e51 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:21:37.253325 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-5bbe61be-cbd8-4054-8344-29c0aa676e51 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:21:37.263676 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5bbe61be-cbd8-4054-8344-29c0aa676e51 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:21:37.266454 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5bbe61be-cbd8-4054-8344-29c0aa676e51 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:21:37.267455 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5bbe61be-cbd8-4054-8344-29c0aa676e51 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:21:37.269679 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5bbe61be-cbd8-4054-8344-29c0aa676e51 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:21:37.568996 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-5bbe61be-cbd8-4054-8344-29c0aa676e51 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:21:37.582875 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-5bbe61be-cbd8-4054-8344-29c0aa676e51 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1569 microversion: 2.1 time: 0.329697 Nov 01 01:21:37.584789 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 272/528] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:21:37 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1569 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:21:37.753365 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-20d02a1b-a761-46e3-bd67-dad5133b95a3 tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:21:37.755068 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-20d02a1b-a761-46e3-bd67-dad5133b95a3 tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] [instance: f086994d-4512-4375-b734-2a35ffe21378] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:21:37.770147 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-20d02a1b-a761-46e3-bd67-dad5133b95a3 tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:21:37.770984 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-20d02a1b-a761-46e3-bd67-dad5133b95a3 tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:21:37.772077 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-20d02a1b-a761-46e3-bd67-dad5133b95a3 tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:21:37.776317 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-20d02a1b-a761-46e3-bd67-dad5133b95a3 tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:21:37.985309 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-20d02a1b-a761-46e3-bd67-dad5133b95a3 tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff78d19b078b41f88a713bcaf706fe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70abf79c702a4ab09f0a25c3dd9800a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:21:38.002516 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-20d02a1b-a761-46e3-bd67-dad5133b95a3 tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] 10.222.0.47 "GET /compute/v2.1/servers/f086994d-4512-4375-b734-2a35ffe21378" status: 200 len: 1314 microversion: 2.1 time: 0.262215 Nov 01 01:21:38.013924 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 257/529] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:21:37 2021] GET /compute/v2.1/servers/f086994d-4512-4375-b734-2a35ffe21378 => generated 1314 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:21:38.602331 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-5a8441b2-f078-42b5-8a1c-04a0cec412d5 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:21:38.603637 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-5a8441b2-f078-42b5-8a1c-04a0cec412d5 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:21:38.611029 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5a8441b2-f078-42b5-8a1c-04a0cec412d5 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:21:38.611539 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5a8441b2-f078-42b5-8a1c-04a0cec412d5 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:21:38.612576 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5a8441b2-f078-42b5-8a1c-04a0cec412d5 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:21:38.613189 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5a8441b2-f078-42b5-8a1c-04a0cec412d5 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:21:38.776376 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-5a8441b2-f078-42b5-8a1c-04a0cec412d5 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:21:38.788005 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-5a8441b2-f078-42b5-8a1c-04a0cec412d5 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1569 microversion: 2.1 time: 0.190321 Nov 01 01:21:38.803551 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 273/530] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:21:38 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1569 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:21:39.020838 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-d0ac3846-cf03-40ae-887f-2e9fde915e69 tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:21:39.023465 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-d0ac3846-cf03-40ae-887f-2e9fde915e69 tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] [instance: f086994d-4512-4375-b734-2a35ffe21378] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:21:39.031754 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d0ac3846-cf03-40ae-887f-2e9fde915e69 tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:21:39.032556 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d0ac3846-cf03-40ae-887f-2e9fde915e69 tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:21:39.033547 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d0ac3846-cf03-40ae-887f-2e9fde915e69 tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:21:39.034186 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d0ac3846-cf03-40ae-887f-2e9fde915e69 tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:21:39.226234 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-d0ac3846-cf03-40ae-887f-2e9fde915e69 tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff78d19b078b41f88a713bcaf706fe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70abf79c702a4ab09f0a25c3dd9800a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:21:39.235694 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-d0ac3846-cf03-40ae-887f-2e9fde915e69 tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] 10.222.0.47 "GET /compute/v2.1/servers/f086994d-4512-4375-b734-2a35ffe21378" status: 200 len: 1314 microversion: 2.1 time: 0.219202 Nov 01 01:21:39.236269 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 258/531] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:21:39 2021] GET /compute/v2.1/servers/f086994d-4512-4375-b734-2a35ffe21378 => generated 1314 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:21:39.806604 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-f28eceb6-6bf8-40ba-a8d1-5bfb82417df3 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:21:39.807362 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-f28eceb6-6bf8-40ba-a8d1-5bfb82417df3 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:21:39.814197 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f28eceb6-6bf8-40ba-a8d1-5bfb82417df3 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:21:39.823256 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f28eceb6-6bf8-40ba-a8d1-5bfb82417df3 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:21:39.823983 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f28eceb6-6bf8-40ba-a8d1-5bfb82417df3 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:21:39.824415 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f28eceb6-6bf8-40ba-a8d1-5bfb82417df3 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:21:40.233050 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-f28eceb6-6bf8-40ba-a8d1-5bfb82417df3 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:21:40.247601 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-f28eceb6-6bf8-40ba-a8d1-5bfb82417df3 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1569 microversion: 2.1 time: 0.444503 Nov 01 01:21:40.248778 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 274/532] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:21:39 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1569 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:21:40.253248 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-d3b6c1d9-e6c6-4ac7-8cb7-805d3e6350b5 tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:21:40.253856 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-d3b6c1d9-e6c6-4ac7-8cb7-805d3e6350b5 tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] [instance: f086994d-4512-4375-b734-2a35ffe21378] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:21:40.277053 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d3b6c1d9-e6c6-4ac7-8cb7-805d3e6350b5 tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:21:40.277769 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d3b6c1d9-e6c6-4ac7-8cb7-805d3e6350b5 tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:21:40.278966 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d3b6c1d9-e6c6-4ac7-8cb7-805d3e6350b5 tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:21:40.279672 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d3b6c1d9-e6c6-4ac7-8cb7-805d3e6350b5 tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:21:40.604687 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-d3b6c1d9-e6c6-4ac7-8cb7-805d3e6350b5 tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff78d19b078b41f88a713bcaf706fe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70abf79c702a4ab09f0a25c3dd9800a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:21:40.613257 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-d3b6c1d9-e6c6-4ac7-8cb7-805d3e6350b5 tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] 10.222.0.47 "GET /compute/v2.1/servers/f086994d-4512-4375-b734-2a35ffe21378" status: 200 len: 1314 microversion: 2.1 time: 0.363127 Nov 01 01:21:40.616494 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 259/533] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:21:40 2021] GET /compute/v2.1/servers/f086994d-4512-4375-b734-2a35ffe21378 => generated 1314 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:21:41.269905 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-0f29a522-0469-442a-bcd0-541ee7ed6872 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:21:41.271118 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-0f29a522-0469-442a-bcd0-541ee7ed6872 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:21:41.277864 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0f29a522-0469-442a-bcd0-541ee7ed6872 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:21:41.278557 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0f29a522-0469-442a-bcd0-541ee7ed6872 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:21:41.279516 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0f29a522-0469-442a-bcd0-541ee7ed6872 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:21:41.280102 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0f29a522-0469-442a-bcd0-541ee7ed6872 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:21:41.452663 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-0f29a522-0469-442a-bcd0-541ee7ed6872 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:21:41.460937 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-0f29a522-0469-442a-bcd0-541ee7ed6872 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1569 microversion: 2.1 time: 0.196894 Nov 01 01:21:41.465782 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 275/534] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:21:41 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1569 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:21:41.634068 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-fda78a0c-0e08-4d03-91ba-9d5c243fa5c3 tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:21:41.634708 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-fda78a0c-0e08-4d03-91ba-9d5c243fa5c3 tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] [instance: f086994d-4512-4375-b734-2a35ffe21378] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:21:41.642256 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-fda78a0c-0e08-4d03-91ba-9d5c243fa5c3 tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:21:41.654370 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-fda78a0c-0e08-4d03-91ba-9d5c243fa5c3 tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:21:41.655357 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-fda78a0c-0e08-4d03-91ba-9d5c243fa5c3 tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:21:41.656457 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-fda78a0c-0e08-4d03-91ba-9d5c243fa5c3 tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:21:42.301318 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-fda78a0c-0e08-4d03-91ba-9d5c243fa5c3 tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff78d19b078b41f88a713bcaf706fe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70abf79c702a4ab09f0a25c3dd9800a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:21:42.311818 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-fda78a0c-0e08-4d03-91ba-9d5c243fa5c3 tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] 10.222.0.47 "GET /compute/v2.1/servers/f086994d-4512-4375-b734-2a35ffe21378" status: 200 len: 1314 microversion: 2.1 time: 0.684552 Nov 01 01:21:42.315304 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 260/535] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:21:41 2021] GET /compute/v2.1/servers/f086994d-4512-4375-b734-2a35ffe21378 => generated 1314 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:21:42.482805 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-4be04e38-00e3-4c7b-a8d6-5accda67c744 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:21:42.484902 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-4be04e38-00e3-4c7b-a8d6-5accda67c744 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:21:42.501947 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4be04e38-00e3-4c7b-a8d6-5accda67c744 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:21:42.504347 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4be04e38-00e3-4c7b-a8d6-5accda67c744 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:21:42.509374 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4be04e38-00e3-4c7b-a8d6-5accda67c744 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:21:42.510269 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4be04e38-00e3-4c7b-a8d6-5accda67c744 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:21:42.947195 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-4be04e38-00e3-4c7b-a8d6-5accda67c744 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:21:42.958208 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-4be04e38-00e3-4c7b-a8d6-5accda67c744 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1569 microversion: 2.1 time: 0.479362 Nov 01 01:21:42.961492 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 276/536] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:21:42 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1569 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:21:43.329872 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-bc666d30-d930-4726-901e-9992c96fe28a tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:21:43.331493 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-bc666d30-d930-4726-901e-9992c96fe28a tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] [instance: f086994d-4512-4375-b734-2a35ffe21378] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:21:43.354989 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-bc666d30-d930-4726-901e-9992c96fe28a tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:21:43.355578 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-bc666d30-d930-4726-901e-9992c96fe28a tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:21:43.356838 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-bc666d30-d930-4726-901e-9992c96fe28a tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:21:43.357487 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-bc666d30-d930-4726-901e-9992c96fe28a tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:21:43.987124 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-4e3e736f-1bf0-4f99-80bf-4b07ff8a3762 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:21:43.993283 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-4e3e736f-1bf0-4f99-80bf-4b07ff8a3762 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:21:44.021006 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4e3e736f-1bf0-4f99-80bf-4b07ff8a3762 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:21:44.024460 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4e3e736f-1bf0-4f99-80bf-4b07ff8a3762 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:21:44.029730 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4e3e736f-1bf0-4f99-80bf-4b07ff8a3762 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:21:44.030585 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4e3e736f-1bf0-4f99-80bf-4b07ff8a3762 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:21:44.341133 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-bc666d30-d930-4726-901e-9992c96fe28a tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff78d19b078b41f88a713bcaf706fe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70abf79c702a4ab09f0a25c3dd9800a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:21:44.356477 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-bc666d30-d930-4726-901e-9992c96fe28a tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] 10.222.0.47 "GET /compute/v2.1/servers/f086994d-4512-4375-b734-2a35ffe21378" status: 200 len: 1314 microversion: 2.1 time: 1.030877 Nov 01 01:21:44.372754 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 261/537] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:21:43 2021] GET /compute/v2.1/servers/f086994d-4512-4375-b734-2a35ffe21378 => generated 1314 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:21:44.415052 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-4e3e736f-1bf0-4f99-80bf-4b07ff8a3762 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:21:44.426150 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-4e3e736f-1bf0-4f99-80bf-4b07ff8a3762 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1569 microversion: 2.1 time: 0.451885 Nov 01 01:21:44.439271 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 277/538] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:21:43 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1569 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:21:44.921831 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-12a4cb7b-eb76-43ea-9ece-978fecbc19bb tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Action: 'create', calling method: .version_select at 0x7fccf63e1ca0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-36728570"}} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:21:44.954761 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.quota [None req-12a4cb7b-eb76-43ea-9ece-978fecbc19bb tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Getting quotas for project c5ca84d6acd44f8d92713d50ac2e825a. Resources: {'key_pairs'} {{(pid=116267) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 01 01:21:44.960253 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.quota [None req-12a4cb7b-eb76-43ea-9ece-978fecbc19bb tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Getting quotas for user 4897556a37d144428d3b385a5859d724 and project c5ca84d6acd44f8d92713d50ac2e825a. Resources: {'key_pairs'} {{(pid=116267) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 01 01:21:45.392815 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-51353ee0-4bbd-412e-b0d4-46890964755e tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:21:45.394048 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-51353ee0-4bbd-412e-b0d4-46890964755e tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] [instance: f086994d-4512-4375-b734-2a35ffe21378] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:21:45.401870 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-51353ee0-4bbd-412e-b0d4-46890964755e tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:21:45.402613 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-51353ee0-4bbd-412e-b0d4-46890964755e tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:21:45.404821 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-51353ee0-4bbd-412e-b0d4-46890964755e tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:21:45.407346 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-51353ee0-4bbd-412e-b0d4-46890964755e tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:21:45.690003 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-51353ee0-4bbd-412e-b0d4-46890964755e tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff78d19b078b41f88a713bcaf706fe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70abf79c702a4ab09f0a25c3dd9800a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:21:45.697952 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-51353ee0-4bbd-412e-b0d4-46890964755e tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] 10.222.0.47 "GET /compute/v2.1/servers/f086994d-4512-4375-b734-2a35ffe21378" status: 200 len: 1314 microversion: 2.1 time: 0.309605 Nov 01 01:21:45.698540 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 278/539] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:21:45 2021] GET /compute/v2.1/servers/f086994d-4512-4375-b734-2a35ffe21378 => generated 1314 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:21:45.721000 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-bbcc387d-4fd9-49e7-bb57-923b207ce451 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:21:45.722206 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.quota [None req-12a4cb7b-eb76-43ea-9ece-978fecbc19bb tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Getting quotas for project c5ca84d6acd44f8d92713d50ac2e825a. Resources: {'key_pairs'} {{(pid=116267) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 01 01:21:45.724136 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-bbcc387d-4fd9-49e7-bb57-923b207ce451 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:21:45.732230 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.quota [None req-12a4cb7b-eb76-43ea-9ece-978fecbc19bb tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Getting quotas for user 4897556a37d144428d3b385a5859d724 and project c5ca84d6acd44f8d92713d50ac2e825a. Resources: {'key_pairs'} {{(pid=116267) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 01 01:21:45.738694 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-bbcc387d-4fd9-49e7-bb57-923b207ce451 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:21:45.741515 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-bbcc387d-4fd9-49e7-bb57-923b207ce451 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:21:45.743981 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-bbcc387d-4fd9-49e7-bb57-923b207ce451 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:21:45.744635 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-bbcc387d-4fd9-49e7-bb57-923b207ce451 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:21:45.774793 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-12a4cb7b-eb76-43ea-9ece-978fecbc19bb tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 2313 microversion: 2.1 time: 1.186239 Nov 01 01:21:45.777881 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 262/540] 10.222.0.47 () {60 vars in 1157 bytes} [Mon Nov 1 01:21:44 2021] POST /compute/v2.1/os-keypairs => generated 2313 bytes in 1190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:21:46.157481 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-bbcc387d-4fd9-49e7-bb57-923b207ce451 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:21:46.169603 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-bbcc387d-4fd9-49e7-bb57-923b207ce451 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1569 microversion: 2.1 time: 0.462367 Nov 01 01:21:46.172444 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 279/541] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:21:45 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1569 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:21:46.716058 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-93852d48-faae-469b-a83a-2371c1815dbf tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:21:46.720064 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-93852d48-faae-469b-a83a-2371c1815dbf tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] [instance: f086994d-4512-4375-b734-2a35ffe21378] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:21:46.729088 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-93852d48-faae-469b-a83a-2371c1815dbf tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:21:46.730580 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-93852d48-faae-469b-a83a-2371c1815dbf tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:21:46.731700 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-93852d48-faae-469b-a83a-2371c1815dbf tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:21:46.732347 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-93852d48-faae-469b-a83a-2371c1815dbf tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:21:47.046065 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-93852d48-faae-469b-a83a-2371c1815dbf tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff78d19b078b41f88a713bcaf706fe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70abf79c702a4ab09f0a25c3dd9800a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:21:47.056333 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-93852d48-faae-469b-a83a-2371c1815dbf tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] 10.222.0.47 "GET /compute/v2.1/servers/f086994d-4512-4375-b734-2a35ffe21378" status: 200 len: 1314 microversion: 2.1 time: 0.343763 Nov 01 01:21:47.056994 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 263/542] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:21:46 2021] GET /compute/v2.1/servers/f086994d-4512-4375-b734-2a35ffe21378 => generated 1314 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:21:47.196159 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-55adcbd2-6367-4555-8c28-f0bb5e27a8d3 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:21:47.196777 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-55adcbd2-6367-4555-8c28-f0bb5e27a8d3 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:21:47.212775 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-55adcbd2-6367-4555-8c28-f0bb5e27a8d3 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:21:47.225499 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-55adcbd2-6367-4555-8c28-f0bb5e27a8d3 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:21:47.226920 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-55adcbd2-6367-4555-8c28-f0bb5e27a8d3 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:21:47.227960 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-55adcbd2-6367-4555-8c28-f0bb5e27a8d3 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:21:47.556271 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-55adcbd2-6367-4555-8c28-f0bb5e27a8d3 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:21:47.568962 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-55adcbd2-6367-4555-8c28-f0bb5e27a8d3 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1569 microversion: 2.1 time: 0.383215 Nov 01 01:21:47.570029 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 280/543] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:21:47 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1569 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:21:48.079180 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-082451eb-579b-4bbb-830e-d9795e55d88b tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:21:48.081726 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-082451eb-579b-4bbb-830e-d9795e55d88b tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] [instance: f086994d-4512-4375-b734-2a35ffe21378] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:21:48.091690 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-082451eb-579b-4bbb-830e-d9795e55d88b tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:21:48.092958 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-082451eb-579b-4bbb-830e-d9795e55d88b tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:21:48.093928 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-082451eb-579b-4bbb-830e-d9795e55d88b tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:21:48.094604 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-082451eb-579b-4bbb-830e-d9795e55d88b tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:21:48.252538 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-082451eb-579b-4bbb-830e-d9795e55d88b tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff78d19b078b41f88a713bcaf706fe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70abf79c702a4ab09f0a25c3dd9800a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:21:48.260434 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-082451eb-579b-4bbb-830e-d9795e55d88b tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] 10.222.0.47 "GET /compute/v2.1/servers/f086994d-4512-4375-b734-2a35ffe21378" status: 200 len: 1314 microversion: 2.1 time: 0.185819 Nov 01 01:21:48.261021 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 264/544] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:21:48 2021] GET /compute/v2.1/servers/f086994d-4512-4375-b734-2a35ffe21378 => generated 1314 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:21:48.588372 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-97501b14-b28c-4252-9ecf-de3466636858 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:21:48.589116 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-97501b14-b28c-4252-9ecf-de3466636858 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:21:48.602804 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-97501b14-b28c-4252-9ecf-de3466636858 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:21:48.603265 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-97501b14-b28c-4252-9ecf-de3466636858 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:21:48.607990 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-97501b14-b28c-4252-9ecf-de3466636858 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:21:48.610968 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-97501b14-b28c-4252-9ecf-de3466636858 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:21:48.885190 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-97501b14-b28c-4252-9ecf-de3466636858 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:21:48.895600 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-97501b14-b28c-4252-9ecf-de3466636858 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1569 microversion: 2.1 time: 0.312436 Nov 01 01:21:48.906800 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 281/545] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:21:48 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1569 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:21:49.278950 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-05195f83-745a-464b-8ea6-01fb6f046e88 tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:21:49.280146 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-05195f83-745a-464b-8ea6-01fb6f046e88 tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] [instance: f086994d-4512-4375-b734-2a35ffe21378] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:21:49.300307 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-05195f83-745a-464b-8ea6-01fb6f046e88 tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:21:49.303995 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-05195f83-745a-464b-8ea6-01fb6f046e88 tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:21:49.303995 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-05195f83-745a-464b-8ea6-01fb6f046e88 tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:21:49.303995 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-05195f83-745a-464b-8ea6-01fb6f046e88 tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:21:49.716253 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-05195f83-745a-464b-8ea6-01fb6f046e88 tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff78d19b078b41f88a713bcaf706fe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70abf79c702a4ab09f0a25c3dd9800a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:21:49.731497 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-05195f83-745a-464b-8ea6-01fb6f046e88 tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] 10.222.0.47 "GET /compute/v2.1/servers/f086994d-4512-4375-b734-2a35ffe21378" status: 200 len: 1314 microversion: 2.1 time: 0.456390 Nov 01 01:21:49.732679 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 265/546] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:21:49 2021] GET /compute/v2.1/servers/f086994d-4512-4375-b734-2a35ffe21378 => generated 1314 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:21:49.914133 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-90ea62b5-099a-4858-90fb-6d61b78e16ba tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:21:49.915307 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-90ea62b5-099a-4858-90fb-6d61b78e16ba tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:21:49.927239 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-90ea62b5-099a-4858-90fb-6d61b78e16ba tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:21:49.927952 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-90ea62b5-099a-4858-90fb-6d61b78e16ba tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:21:49.928953 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-90ea62b5-099a-4858-90fb-6d61b78e16ba tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:21:49.929614 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-90ea62b5-099a-4858-90fb-6d61b78e16ba tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:21:50.200745 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-90ea62b5-099a-4858-90fb-6d61b78e16ba tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:21:50.213613 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-90ea62b5-099a-4858-90fb-6d61b78e16ba tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1569 microversion: 2.1 time: 0.304111 Nov 01 01:21:50.229537 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 282/547] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:21:49 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1569 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:21:50.632042 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [req-ea39b3ce-49f1-419f-b4ac-8aad8388bb44 req-09cae5b9-f2eb-424f-8d85-52209aee1f94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f086994d-4512-4375-b734-2a35ffe21378", "name": "network-vif-plugged", "status": "completed", "tag": "3f543a4c-4423-4633-b008-099bea3a18ba"}]} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:21:50.634857 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 01 01:21:50.634857 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: warnings.warn(msg) Nov 01 01:21:50.644254 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [req-ea39b3ce-49f1-419f-b4ac-8aad8388bb44 req-09cae5b9-f2eb-424f-8d85-52209aee1f94 service nova] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:21:50.645037 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [req-ea39b3ce-49f1-419f-b4ac-8aad8388bb44 req-09cae5b9-f2eb-424f-8d85-52209aee1f94 service nova] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:21:50.669893 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.compute.server_external_events [req-ea39b3ce-49f1-419f-b4ac-8aad8388bb44 req-09cae5b9-f2eb-424f-8d85-52209aee1f94 service nova] Creating event network-vif-plugged:3f543a4c-4423-4633-b008-099bea3a18ba for instance f086994d-4512-4375-b734-2a35ffe21378 on hv-cinder-81561 Nov 01 01:21:50.699510 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [req-ea39b3ce-49f1-419f-b4ac-8aad8388bb44 req-09cae5b9-f2eb-424f-8d85-52209aee1f94 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072139 Nov 01 01:21:50.700519 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 266/548] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Nov 1 01:21:50 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:21:50.754709 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-1298524c-5db5-4ad1-99d1-d89172388228 tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:21:50.755329 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-1298524c-5db5-4ad1-99d1-d89172388228 tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] [instance: f086994d-4512-4375-b734-2a35ffe21378] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:21:50.767529 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1298524c-5db5-4ad1-99d1-d89172388228 tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:21:50.768188 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1298524c-5db5-4ad1-99d1-d89172388228 tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:21:50.769142 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1298524c-5db5-4ad1-99d1-d89172388228 tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:21:50.771616 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1298524c-5db5-4ad1-99d1-d89172388228 tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:21:51.073366 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-1298524c-5db5-4ad1-99d1-d89172388228 tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff78d19b078b41f88a713bcaf706fe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70abf79c702a4ab09f0a25c3dd9800a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:21:51.086847 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-1298524c-5db5-4ad1-99d1-d89172388228 tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] 10.222.0.47 "GET /compute/v2.1/servers/f086994d-4512-4375-b734-2a35ffe21378" status: 200 len: 1314 microversion: 2.1 time: 0.337011 Nov 01 01:21:51.090631 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 283/549] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:21:50 2021] GET /compute/v2.1/servers/f086994d-4512-4375-b734-2a35ffe21378 => generated 1314 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:21:51.231202 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-f233e28b-a256-4092-bfdc-b67d049b5483 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:21:51.231892 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-f233e28b-a256-4092-bfdc-b67d049b5483 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:21:51.238881 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f233e28b-a256-4092-bfdc-b67d049b5483 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:21:51.239630 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f233e28b-a256-4092-bfdc-b67d049b5483 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:21:51.240403 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f233e28b-a256-4092-bfdc-b67d049b5483 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:21:51.240857 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f233e28b-a256-4092-bfdc-b67d049b5483 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:21:51.438187 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-f233e28b-a256-4092-bfdc-b67d049b5483 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:21:51.454145 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-f233e28b-a256-4092-bfdc-b67d049b5483 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1569 microversion: 2.1 time: 0.226747 Nov 01 01:21:51.455395 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 267/550] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:21:51 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1569 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:21:52.105031 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-0431182f-eafd-4a57-850a-50668d502c98 tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:21:52.105940 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-0431182f-eafd-4a57-850a-50668d502c98 tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] [instance: f086994d-4512-4375-b734-2a35ffe21378] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:21:52.113196 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0431182f-eafd-4a57-850a-50668d502c98 tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:21:52.114301 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0431182f-eafd-4a57-850a-50668d502c98 tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:21:52.115399 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0431182f-eafd-4a57-850a-50668d502c98 tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:21:52.116063 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0431182f-eafd-4a57-850a-50668d502c98 tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:21:52.276514 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-0431182f-eafd-4a57-850a-50668d502c98 tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff78d19b078b41f88a713bcaf706fe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70abf79c702a4ab09f0a25c3dd9800a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:21:52.288259 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-0431182f-eafd-4a57-850a-50668d502c98 tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] 10.222.0.47 "GET /compute/v2.1/servers/f086994d-4512-4375-b734-2a35ffe21378" status: 200 len: 1314 microversion: 2.1 time: 0.186736 Nov 01 01:21:52.288842 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 284/551] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:21:52 2021] GET /compute/v2.1/servers/f086994d-4512-4375-b734-2a35ffe21378 => generated 1314 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:21:52.472525 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-44150a59-860b-4ad3-9126-dd98f444e3e9 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:21:52.473324 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-44150a59-860b-4ad3-9126-dd98f444e3e9 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:21:52.485085 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-44150a59-860b-4ad3-9126-dd98f444e3e9 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:21:52.485534 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-44150a59-860b-4ad3-9126-dd98f444e3e9 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:21:52.486552 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-44150a59-860b-4ad3-9126-dd98f444e3e9 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:21:52.487005 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-44150a59-860b-4ad3-9126-dd98f444e3e9 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:21:52.620347 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-44150a59-860b-4ad3-9126-dd98f444e3e9 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:21:52.628596 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-44150a59-860b-4ad3-9126-dd98f444e3e9 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1569 microversion: 2.1 time: 0.160961 Nov 01 01:21:52.629162 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 268/552] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:21:52 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1569 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:21:53.305117 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-306caa96-113a-4e5b-80bd-b3c68e0c8804 tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:21:53.305742 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-306caa96-113a-4e5b-80bd-b3c68e0c8804 tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] [instance: f086994d-4512-4375-b734-2a35ffe21378] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:21:53.313327 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-306caa96-113a-4e5b-80bd-b3c68e0c8804 tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:21:53.313697 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-306caa96-113a-4e5b-80bd-b3c68e0c8804 tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:21:53.314502 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-306caa96-113a-4e5b-80bd-b3c68e0c8804 tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:21:53.314930 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-306caa96-113a-4e5b-80bd-b3c68e0c8804 tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:21:53.473190 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-306caa96-113a-4e5b-80bd-b3c68e0c8804 tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff78d19b078b41f88a713bcaf706fe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70abf79c702a4ab09f0a25c3dd9800a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:21:53.480909 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-306caa96-113a-4e5b-80bd-b3c68e0c8804 tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] 10.222.0.47 "GET /compute/v2.1/servers/f086994d-4512-4375-b734-2a35ffe21378" status: 200 len: 1464 microversion: 2.1 time: 0.179423 Nov 01 01:21:53.481482 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 285/553] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:21:53 2021] GET /compute/v2.1/servers/f086994d-4512-4375-b734-2a35ffe21378 => generated 1464 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:21:53.526520 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-055135fe-e549-4516-a47b-1d88b2f7fbab tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:21:53.527068 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-055135fe-e549-4516-a47b-1d88b2f7fbab tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] [instance: f086994d-4512-4375-b734-2a35ffe21378] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:21:53.534948 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-055135fe-e549-4516-a47b-1d88b2f7fbab tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:21:53.535397 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-055135fe-e549-4516-a47b-1d88b2f7fbab tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:21:53.536169 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-055135fe-e549-4516-a47b-1d88b2f7fbab tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:21:53.536600 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-055135fe-e549-4516-a47b-1d88b2f7fbab tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:21:53.568334 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-055135fe-e549-4516-a47b-1d88b2f7fbab tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] [instance: f086994d-4512-4375-b734-2a35ffe21378] Going to try to terminate instance {{(pid=116267) delete /opt/stack/nova/nova/compute/api.py:2612}} Nov 01 01:21:53.644976 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-57fe9f10-1eef-4f7c-95d6-11823cec549b tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:21:53.645950 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-57fe9f10-1eef-4f7c-95d6-11823cec549b tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:21:53.652158 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-57fe9f10-1eef-4f7c-95d6-11823cec549b tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:21:53.652689 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-57fe9f10-1eef-4f7c-95d6-11823cec549b tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:21:53.653712 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-57fe9f10-1eef-4f7c-95d6-11823cec549b tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:21:53.654459 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-57fe9f10-1eef-4f7c-95d6-11823cec549b tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:21:53.793882 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-57fe9f10-1eef-4f7c-95d6-11823cec549b tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:21:53.808161 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-57fe9f10-1eef-4f7c-95d6-11823cec549b tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1569 microversion: 2.1 time: 0.166762 Nov 01 01:21:53.810484 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 286/554] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:21:53 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1569 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:21:53.891873 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-055135fe-e549-4516-a47b-1d88b2f7fbab tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] 10.222.0.47 "DELETE /compute/v2.1/servers/f086994d-4512-4375-b734-2a35ffe21378" status: 204 len: 0 microversion: 2.1 time: 0.369002 Nov 01 01:21:53.893058 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 269/555] 10.222.0.47 () {58 vars in 1238 bytes} [Mon Nov 1 01:21:53 2021] DELETE /compute/v2.1/servers/f086994d-4512-4375-b734-2a35ffe21378 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 01 01:21:53.901098 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-2bd466f7-c686-4eee-b183-89d78da7a754 tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:21:53.902497 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-2bd466f7-c686-4eee-b183-89d78da7a754 tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] [instance: f086994d-4512-4375-b734-2a35ffe21378] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:21:53.909752 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2bd466f7-c686-4eee-b183-89d78da7a754 tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:21:53.911008 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2bd466f7-c686-4eee-b183-89d78da7a754 tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:21:53.912188 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2bd466f7-c686-4eee-b183-89d78da7a754 tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:21:53.913281 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2bd466f7-c686-4eee-b183-89d78da7a754 tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:21:54.055650 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-2bd466f7-c686-4eee-b183-89d78da7a754 tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff78d19b078b41f88a713bcaf706fe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70abf79c702a4ab09f0a25c3dd9800a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:21:54.065027 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-2bd466f7-c686-4eee-b183-89d78da7a754 tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] 10.222.0.47 "GET /compute/v2.1/servers/f086994d-4512-4375-b734-2a35ffe21378" status: 200 len: 1470 microversion: 2.1 time: 0.167416 Nov 01 01:21:54.071419 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 287/556] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:21:53 2021] GET /compute/v2.1/servers/f086994d-4512-4375-b734-2a35ffe21378 => generated 1470 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:21:54.827161 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-88b325a1-3ae2-4635-87a5-fe6822cffdfa tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:21:54.828573 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-88b325a1-3ae2-4635-87a5-fe6822cffdfa tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:21:54.835399 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-88b325a1-3ae2-4635-87a5-fe6822cffdfa tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:21:54.841065 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-88b325a1-3ae2-4635-87a5-fe6822cffdfa tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:21:54.841065 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-88b325a1-3ae2-4635-87a5-fe6822cffdfa tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:21:54.841065 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-88b325a1-3ae2-4635-87a5-fe6822cffdfa tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:21:55.013250 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-88b325a1-3ae2-4635-87a5-fe6822cffdfa tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:21:55.035293 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-88b325a1-3ae2-4635-87a5-fe6822cffdfa tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1569 microversion: 2.1 time: 0.211936 Nov 01 01:21:55.037051 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 270/557] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:21:54 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1569 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:21:55.087307 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-a5d7f142-86ef-47b8-a49a-d825b62c503a tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:21:55.088206 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-a5d7f142-86ef-47b8-a49a-d825b62c503a tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] [instance: f086994d-4512-4375-b734-2a35ffe21378] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:21:55.097832 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a5d7f142-86ef-47b8-a49a-d825b62c503a tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:21:55.098276 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a5d7f142-86ef-47b8-a49a-d825b62c503a tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:21:55.099283 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a5d7f142-86ef-47b8-a49a-d825b62c503a tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:21:55.099855 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a5d7f142-86ef-47b8-a49a-d825b62c503a tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:21:55.269420 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-a5d7f142-86ef-47b8-a49a-d825b62c503a tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff78d19b078b41f88a713bcaf706fe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70abf79c702a4ab09f0a25c3dd9800a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:21:55.279482 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-a5d7f142-86ef-47b8-a49a-d825b62c503a tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] 10.222.0.47 "GET /compute/v2.1/servers/f086994d-4512-4375-b734-2a35ffe21378" status: 200 len: 1470 microversion: 2.1 time: 0.196403 Nov 01 01:21:55.280180 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 288/558] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:21:55 2021] GET /compute/v2.1/servers/f086994d-4512-4375-b734-2a35ffe21378 => generated 1470 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:21:56.054140 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-0f902000-1afd-4b89-90b8-7c326ebda95c tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:21:56.054793 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-0f902000-1afd-4b89-90b8-7c326ebda95c tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:21:56.061240 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0f902000-1afd-4b89-90b8-7c326ebda95c tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:21:56.061689 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0f902000-1afd-4b89-90b8-7c326ebda95c tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:21:56.062480 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0f902000-1afd-4b89-90b8-7c326ebda95c tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:21:56.062914 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0f902000-1afd-4b89-90b8-7c326ebda95c tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:21:56.297914 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-f73e2c85-19aa-4f5b-b18a-bc826c5c3a99 tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:21:56.298557 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-f73e2c85-19aa-4f5b-b18a-bc826c5c3a99 tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] [instance: f086994d-4512-4375-b734-2a35ffe21378] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:21:56.301622 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-0f902000-1afd-4b89-90b8-7c326ebda95c tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:21:56.305217 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f73e2c85-19aa-4f5b-b18a-bc826c5c3a99 tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:21:56.305817 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f73e2c85-19aa-4f5b-b18a-bc826c5c3a99 tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:21:56.307030 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f73e2c85-19aa-4f5b-b18a-bc826c5c3a99 tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:21:56.307456 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f73e2c85-19aa-4f5b-b18a-bc826c5c3a99 tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:21:56.309626 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-0f902000-1afd-4b89-90b8-7c326ebda95c tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1569 microversion: 2.1 time: 0.259230 Nov 01 01:21:56.310197 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 271/559] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:21:56 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1569 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:21:56.531552 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-f73e2c85-19aa-4f5b-b18a-bc826c5c3a99 tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff78d19b078b41f88a713bcaf706fe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70abf79c702a4ab09f0a25c3dd9800a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:21:56.550265 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-f73e2c85-19aa-4f5b-b18a-bc826c5c3a99 tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] 10.222.0.47 "GET /compute/v2.1/servers/f086994d-4512-4375-b734-2a35ffe21378" status: 200 len: 1470 microversion: 2.1 time: 0.256442 Nov 01 01:21:56.550883 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 289/560] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:21:56 2021] GET /compute/v2.1/servers/f086994d-4512-4375-b734-2a35ffe21378 => generated 1470 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:21:56.825079 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [req-06e83fc7-4b24-4daf-98d7-689c9b77d860 req-c4d6e0f7-68f3-40b2-86cb-07f7b0b8e327 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f086994d-4512-4375-b734-2a35ffe21378", "name": "network-vif-deleted", "tag": "3f543a4c-4423-4633-b008-099bea3a18ba"}]} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:21:56.826870 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 01 01:21:56.826870 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: warnings.warn(msg) Nov 01 01:21:56.834029 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [req-06e83fc7-4b24-4daf-98d7-689c9b77d860 req-c4d6e0f7-68f3-40b2-86cb-07f7b0b8e327 service nova] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:21:56.834496 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [req-06e83fc7-4b24-4daf-98d7-689c9b77d860 req-c4d6e0f7-68f3-40b2-86cb-07f7b0b8e327 service nova] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:21:56.851183 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.compute.server_external_events [req-06e83fc7-4b24-4daf-98d7-689c9b77d860 req-c4d6e0f7-68f3-40b2-86cb-07f7b0b8e327 service nova] Creating event network-vif-deleted:3f543a4c-4423-4633-b008-099bea3a18ba for instance f086994d-4512-4375-b734-2a35ffe21378 on hv-cinder-81561 Nov 01 01:21:56.859192 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [req-06e83fc7-4b24-4daf-98d7-689c9b77d860 req-c4d6e0f7-68f3-40b2-86cb-07f7b0b8e327 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037641 Nov 01 01:21:56.859792 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 272/561] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Nov 1 01:21:56 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:21:57.332987 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-9e4113a2-5b19-408a-8585-adac9c27db41 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:21:57.333732 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-9e4113a2-5b19-408a-8585-adac9c27db41 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:21:57.340275 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9e4113a2-5b19-408a-8585-adac9c27db41 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:21:57.340655 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9e4113a2-5b19-408a-8585-adac9c27db41 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:21:57.341596 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9e4113a2-5b19-408a-8585-adac9c27db41 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:21:57.342054 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9e4113a2-5b19-408a-8585-adac9c27db41 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:21:57.496628 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-9e4113a2-5b19-408a-8585-adac9c27db41 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:21:57.504907 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-9e4113a2-5b19-408a-8585-adac9c27db41 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1569 microversion: 2.1 time: 0.176179 Nov 01 01:21:57.505413 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 290/562] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:21:57 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1569 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:21:57.567033 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-0a46e4d8-7e98-46dc-8c88-b4d5592fc9cb tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Action: 'create', calling method: .version_select at 0x7fccf634bee0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1281802673"}} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:21:57.567906 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-b4c497ef-7d16-43f3-9676-3776adb7496e tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:21:57.568525 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-b4c497ef-7d16-43f3-9676-3776adb7496e tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] [instance: f086994d-4512-4375-b734-2a35ffe21378] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:21:57.575411 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b4c497ef-7d16-43f3-9676-3776adb7496e tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:21:57.575940 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b4c497ef-7d16-43f3-9676-3776adb7496e tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:21:57.576747 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b4c497ef-7d16-43f3-9676-3776adb7496e tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:21:57.577183 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b4c497ef-7d16-43f3-9676-3776adb7496e tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:21:57.598681 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.quota [None req-0a46e4d8-7e98-46dc-8c88-b4d5592fc9cb tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Getting quotas for project d454283e656c405f88ecb0b2ed70760a. Resources: {'key_pairs'} {{(pid=116267) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 01 01:21:57.602792 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.quota [None req-0a46e4d8-7e98-46dc-8c88-b4d5592fc9cb tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Getting quotas for user ec98ca6057d54c8caeac35ed360d8765 and project d454283e656c405f88ecb0b2ed70760a. Resources: {'key_pairs'} {{(pid=116267) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 01 01:21:57.616674 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b4c497ef-7d16-43f3-9676-3776adb7496e tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:21:57.617122 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b4c497ef-7d16-43f3-9676-3776adb7496e tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:21:57.617566 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.objects.instance [None req-b4c497ef-7d16-43f3-9676-3776adb7496e tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Lazy-loading 'fault' on Instance uuid f086994d-4512-4375-b734-2a35ffe21378 {{(pid=116266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 01 01:21:57.659184 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-b4c497ef-7d16-43f3-9676-3776adb7496e tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff78d19b078b41f88a713bcaf706fe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70abf79c702a4ab09f0a25c3dd9800a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:21:57.666918 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-b4c497ef-7d16-43f3-9676-3776adb7496e tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] 10.222.0.47 "GET /compute/v2.1/servers/f086994d-4512-4375-b734-2a35ffe21378" status: 200 len: 1304 microversion: 2.1 time: 0.103316 Nov 01 01:21:57.667489 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 291/563] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:21:57 2021] GET /compute/v2.1/servers/f086994d-4512-4375-b734-2a35ffe21378 => generated 1304 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:21:58.414635 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.quota [None req-0a46e4d8-7e98-46dc-8c88-b4d5592fc9cb tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Getting quotas for project d454283e656c405f88ecb0b2ed70760a. Resources: {'key_pairs'} {{(pid=116267) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 01 01:21:58.418142 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.quota [None req-0a46e4d8-7e98-46dc-8c88-b4d5592fc9cb tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Getting quotas for user ec98ca6057d54c8caeac35ed360d8765 and project d454283e656c405f88ecb0b2ed70760a. Resources: {'key_pairs'} {{(pid=116267) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 01 01:21:58.430998 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-0a46e4d8-7e98-46dc-8c88-b4d5592fc9cb tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 2318 microversion: 2.1 time: 0.868346 Nov 01 01:21:58.431587 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 273/564] 10.222.0.47 () {60 vars in 1157 bytes} [Mon Nov 1 01:21:57 2021] POST /compute/v2.1/os-keypairs => generated 2318 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:21:58.523748 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-72901a02-264f-482f-8605-15e3df0926c7 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:21:58.524423 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-72901a02-264f-482f-8605-15e3df0926c7 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:21:58.529318 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-e2f73428-4439-480d-9021-7308ce9f97e7 tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-73569579", "imageRef": "9fd4b265-b4f9-4592-aead-0233da23fd8c", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1281802673", "networks": [{"uuid": "2da48868-ea1c-4650-8a88-be25668830c9"}]}} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:21:58.531377 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-72901a02-264f-482f-8605-15e3df0926c7 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:21:58.532117 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-72901a02-264f-482f-8605-15e3df0926c7 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:21:58.533122 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-72901a02-264f-482f-8605-15e3df0926c7 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:21:58.533558 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-72901a02-264f-482f-8605-15e3df0926c7 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:21:58.582398 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.network.neutron [None req-e2f73428-4439-480d-9021-7308ce9f97e7 tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] validate_networks() for [('2da48868-ea1c-4650-8a88-be25668830c9', None, None, None, None, None)] {{(pid=116267) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Nov 01 01:21:58.757521 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-72901a02-264f-482f-8605-15e3df0926c7 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:21:58.768999 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-72901a02-264f-482f-8605-15e3df0926c7 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1569 microversion: 2.1 time: 0.248993 Nov 01 01:21:58.769582 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 292/565] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:21:58 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1569 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:21:58.773970 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-e21d3214-384f-4519-949a-56875b36b7a9 tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:21:58.774588 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-e21d3214-384f-4519-949a-56875b36b7a9 tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] [instance: f086994d-4512-4375-b734-2a35ffe21378] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:21:58.781079 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e21d3214-384f-4519-949a-56875b36b7a9 tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:21:58.781516 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e21d3214-384f-4519-949a-56875b36b7a9 tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:21:58.782310 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e21d3214-384f-4519-949a-56875b36b7a9 tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:21:58.782762 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e21d3214-384f-4519-949a-56875b36b7a9 tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:21:58.797095 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.wsgi [None req-e21d3214-384f-4519-949a-56875b36b7a9 tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] HTTP exception thrown: Instance f086994d-4512-4375-b734-2a35ffe21378 could not be found. Nov 01 01:21:58.797682 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-e21d3214-384f-4519-949a-56875b36b7a9 tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] Returning 404 to user: Instance f086994d-4512-4375-b734-2a35ffe21378 could not be found. {{(pid=116266) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 01 01:21:58.800095 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-e21d3214-384f-4519-949a-56875b36b7a9 tempest-VolumesNegativeTest-153911469 tempest-VolumesNegativeTest-153911469-project] 10.222.0.47 "GET /compute/v2.1/servers/f086994d-4512-4375-b734-2a35ffe21378" status: 404 len: 111 microversion: 2.1 time: 0.028023 Nov 01 01:21:58.800095 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 293/566] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:21:58 2021] GET /compute/v2.1/servers/f086994d-4512-4375-b734-2a35ffe21378 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 01:21:59.018582 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.virt.hardware [None req-e2f73428-4439-480d-9021-7308ce9f97e7 tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Flavor limits 0:0:0 {{(pid=116267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 01 01:21:59.018998 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.virt.hardware [None req-e2f73428-4439-480d-9021-7308ce9f97e7 tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Image limits 0:0:0 {{(pid=116267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 01 01:21:59.019681 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.virt.hardware [None req-e2f73428-4439-480d-9021-7308ce9f97e7 tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Flavor pref 0:0:0 {{(pid=116267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 01 01:21:59.020407 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.virt.hardware [None req-e2f73428-4439-480d-9021-7308ce9f97e7 tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Image pref 0:0:0 {{(pid=116267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 01 01:21:59.020812 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.virt.hardware [None req-e2f73428-4439-480d-9021-7308ce9f97e7 tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 01 01:21:59.030098 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e2f73428-4439-480d-9021-7308ce9f97e7 tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:21:59.030597 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e2f73428-4439-480d-9021-7308ce9f97e7 tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:21:59.031387 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e2f73428-4439-480d-9021-7308ce9f97e7 tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:21:59.031802 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e2f73428-4439-480d-9021-7308ce9f97e7 tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:21:59.050706 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.quota [None req-e2f73428-4439-480d-9021-7308ce9f97e7 tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Getting quotas for project d454283e656c405f88ecb0b2ed70760a. Resources: {'instances', 'cores', 'ram'} {{(pid=116267) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 01 01:21:59.054525 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.quota [None req-e2f73428-4439-480d-9021-7308ce9f97e7 tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Getting quotas for user ec98ca6057d54c8caeac35ed360d8765 and project d454283e656c405f88ecb0b2ed70760a. Resources: {'instances', 'cores', 'ram'} {{(pid=116267) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 01 01:21:59.065483 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-e2f73428-4439-480d-9021-7308ce9f97e7 tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Going to run 1 instances... {{(pid=116267) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 01 01:21:59.067949 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-e2f73428-4439-480d-9021-7308ce9f97e7 tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] [instance: 947fe830-e3f1-4dcc-81ab-fd177af6c35f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9fd4b265-b4f9-4592-aead-0233da23fd8c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116267) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 01 01:21:59.195114 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-e2f73428-4439-480d-9021-7308ce9f97e7 tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.669755 Nov 01 01:21:59.195923 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 274/567] 10.222.0.47 () {60 vars in 1146 bytes} [Mon Nov 1 01:21:58 2021] POST /compute/v2.1/servers => generated 380 bytes in 672 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 01 01:21:59.206984 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-b7b7ba5c-a594-4d7b-8bfb-3923aa6c21b1 tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:21:59.207642 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-b7b7ba5c-a594-4d7b-8bfb-3923aa6c21b1 tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] [instance: 947fe830-e3f1-4dcc-81ab-fd177af6c35f] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:21:59.270680 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-b7b7ba5c-a594-4d7b-8bfb-3923aa6c21b1 tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec98ca6057d54c8caeac35ed360d8765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd454283e656c405f88ecb0b2ed70760a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:21:59.277383 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-b7b7ba5c-a594-4d7b-8bfb-3923aa6c21b1 tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] 10.222.0.47 "GET /compute/v2.1/servers/947fe830-e3f1-4dcc-81ab-fd177af6c35f" status: 200 len: 1257 microversion: 2.1 time: 0.074204 Nov 01 01:21:59.277932 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 294/568] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:21:59 2021] GET /compute/v2.1/servers/947fe830-e3f1-4dcc-81ab-fd177af6c35f => generated 1257 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:21:59.786913 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-8c0c9a5f-4a33-421b-aa78-b3d9a1f00b78 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:21:59.787517 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-8c0c9a5f-4a33-421b-aa78-b3d9a1f00b78 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:21:59.793547 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8c0c9a5f-4a33-421b-aa78-b3d9a1f00b78 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:21:59.793991 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8c0c9a5f-4a33-421b-aa78-b3d9a1f00b78 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:21:59.794814 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8c0c9a5f-4a33-421b-aa78-b3d9a1f00b78 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:21:59.795259 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8c0c9a5f-4a33-421b-aa78-b3d9a1f00b78 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:21:59.923126 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-8c0c9a5f-4a33-421b-aa78-b3d9a1f00b78 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:21:59.931068 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-8c0c9a5f-4a33-421b-aa78-b3d9a1f00b78 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1549 microversion: 2.1 time: 0.148278 Nov 01 01:21:59.931629 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 275/569] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:21:59 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1549 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:21:59.948552 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-8b78e742-2e4e-43b7-b69d-13f08a8bbee7 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:21:59.949143 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-8b78e742-2e4e-43b7-b69d-13f08a8bbee7 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:21:59.956023 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8b78e742-2e4e-43b7-b69d-13f08a8bbee7 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:21:59.957921 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8b78e742-2e4e-43b7-b69d-13f08a8bbee7 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:21:59.958769 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8b78e742-2e4e-43b7-b69d-13f08a8bbee7 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:21:59.959207 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8b78e742-2e4e-43b7-b69d-13f08a8bbee7 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:00.090751 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.wsgi [None req-8b78e742-2e4e-43b7-b69d-13f08a8bbee7 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] HTTP exception thrown: Cannot 'detach_volume' instance f02098be-ed15-45a0-a599-941cb0e1eebb while it is in vm_state rescued Nov 01 01:22:00.091356 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-8b78e742-2e4e-43b7-b69d-13f08a8bbee7 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Returning 409 to user: Cannot 'detach_volume' instance f02098be-ed15-45a0-a599-941cb0e1eebb while it is in vm_state rescued {{(pid=116266) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 01 01:22:00.092760 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-8b78e742-2e4e-43b7-b69d-13f08a8bbee7 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "DELETE /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments/527828b0-9121-4b41-b5b3-d25799e058da" status: 409 len: 152 microversion: 2.1 time: 0.147497 Nov 01 01:22:00.093302 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 295/570] 10.222.0.47 () {58 vars in 1415 bytes} [Mon Nov 1 01:21:59 2021] DELETE /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments/527828b0-9121-4b41-b5b3-d25799e058da => generated 152 bytes in 149 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 01 01:22:00.101457 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-026bda1d-29de-4aab-bbd9-954116f7f92c tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:22:00.113129 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-026bda1d-29de-4aab-bbd9-954116f7f92c tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:22:00.113129 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-026bda1d-29de-4aab-bbd9-954116f7f92c tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:00.113129 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-026bda1d-29de-4aab-bbd9-954116f7f92c tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:00.113129 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-026bda1d-29de-4aab-bbd9-954116f7f92c tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:00.114105 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-026bda1d-29de-4aab-bbd9-954116f7f92c tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:00.295462 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-cf7a79e1-2406-442b-9497-6603d83f4813 tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:22:00.296299 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-cf7a79e1-2406-442b-9497-6603d83f4813 tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] [instance: 947fe830-e3f1-4dcc-81ab-fd177af6c35f] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:22:00.356321 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-cf7a79e1-2406-442b-9497-6603d83f4813 tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec98ca6057d54c8caeac35ed360d8765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd454283e656c405f88ecb0b2ed70760a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:22:00.363184 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-026bda1d-29de-4aab-bbd9-954116f7f92c tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "POST /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/action" status: 202 len: 0 microversion: 2.1 time: 0.264447 Nov 01 01:22:00.365289 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-cf7a79e1-2406-442b-9497-6603d83f4813 tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] 10.222.0.47 "GET /compute/v2.1/servers/947fe830-e3f1-4dcc-81ab-fd177af6c35f" status: 200 len: 1257 microversion: 2.1 time: 0.072361 Nov 01 01:22:00.365289 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 296/571] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:22:00 2021] GET /compute/v2.1/servers/947fe830-e3f1-4dcc-81ab-fd177af6c35f => generated 1257 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:22:00.365486 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 276/572] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Nov 1 01:22:00 2021] POST /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/action => generated 0 bytes in 267 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 01 01:22:00.374364 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-1c4167cd-0b6d-485e-b5e9-555915a9732c tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:22:00.375052 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-1c4167cd-0b6d-485e-b5e9-555915a9732c tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:22:00.381067 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1c4167cd-0b6d-485e-b5e9-555915a9732c tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:00.381678 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1c4167cd-0b6d-485e-b5e9-555915a9732c tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:00.386516 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1c4167cd-0b6d-485e-b5e9-555915a9732c tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:00.386516 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1c4167cd-0b6d-485e-b5e9-555915a9732c tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:00.554489 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-1c4167cd-0b6d-485e-b5e9-555915a9732c tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:22:00.563090 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-1c4167cd-0b6d-485e-b5e9-555915a9732c tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1557 microversion: 2.1 time: 0.192348 Nov 01 01:22:00.563654 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 297/573] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:22:00 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1557 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:22:01.380904 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-4ef3ffdc-4e45-4cd9-a04b-57b328fe9463 tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:22:01.381445 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-4ef3ffdc-4e45-4cd9-a04b-57b328fe9463 tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] [instance: 947fe830-e3f1-4dcc-81ab-fd177af6c35f] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:22:01.388085 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4ef3ffdc-4e45-4cd9-a04b-57b328fe9463 tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:01.388535 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4ef3ffdc-4e45-4cd9-a04b-57b328fe9463 tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:01.389998 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4ef3ffdc-4e45-4cd9-a04b-57b328fe9463 tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:01.390516 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4ef3ffdc-4e45-4cd9-a04b-57b328fe9463 tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:01.450308 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-4ef3ffdc-4e45-4cd9-a04b-57b328fe9463 tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec98ca6057d54c8caeac35ed360d8765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd454283e656c405f88ecb0b2ed70760a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:22:01.458565 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-4ef3ffdc-4e45-4cd9-a04b-57b328fe9463 tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] 10.222.0.47 "GET /compute/v2.1/servers/947fe830-e3f1-4dcc-81ab-fd177af6c35f" status: 200 len: 1309 microversion: 2.1 time: 0.081798 Nov 01 01:22:01.459129 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 277/574] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:22:01 2021] GET /compute/v2.1/servers/947fe830-e3f1-4dcc-81ab-fd177af6c35f => generated 1309 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:22:01.581685 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-1bdfbb84-2055-4996-91f6-c7f383cd8e97 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:22:01.582331 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-1bdfbb84-2055-4996-91f6-c7f383cd8e97 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:22:01.589191 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1bdfbb84-2055-4996-91f6-c7f383cd8e97 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:01.589687 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1bdfbb84-2055-4996-91f6-c7f383cd8e97 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:01.590560 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1bdfbb84-2055-4996-91f6-c7f383cd8e97 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:01.590987 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1bdfbb84-2055-4996-91f6-c7f383cd8e97 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:01.717208 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-1bdfbb84-2055-4996-91f6-c7f383cd8e97 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:22:01.731144 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-1bdfbb84-2055-4996-91f6-c7f383cd8e97 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1557 microversion: 2.1 time: 0.153733 Nov 01 01:22:01.731717 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 298/575] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:22:01 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1557 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:22:02.475231 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-8a0c3b2e-7562-4642-8e80-70f78224a3db tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:22:02.476010 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-8a0c3b2e-7562-4642-8e80-70f78224a3db tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] [instance: 947fe830-e3f1-4dcc-81ab-fd177af6c35f] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:22:02.490085 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8a0c3b2e-7562-4642-8e80-70f78224a3db tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:02.490551 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8a0c3b2e-7562-4642-8e80-70f78224a3db tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:02.491619 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8a0c3b2e-7562-4642-8e80-70f78224a3db tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:02.492041 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8a0c3b2e-7562-4642-8e80-70f78224a3db tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:02.568671 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-8a0c3b2e-7562-4642-8e80-70f78224a3db tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec98ca6057d54c8caeac35ed360d8765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd454283e656c405f88ecb0b2ed70760a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:22:02.577645 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-8a0c3b2e-7562-4642-8e80-70f78224a3db tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] 10.222.0.47 "GET /compute/v2.1/servers/947fe830-e3f1-4dcc-81ab-fd177af6c35f" status: 200 len: 1315 microversion: 2.1 time: 0.106088 Nov 01 01:22:02.578213 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 278/576] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:22:02 2021] GET /compute/v2.1/servers/947fe830-e3f1-4dcc-81ab-fd177af6c35f => generated 1315 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:22:02.751403 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-5dc1eeba-8403-4958-9f7a-541d95413b8f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:22:02.753026 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-5dc1eeba-8403-4958-9f7a-541d95413b8f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:22:02.761580 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5dc1eeba-8403-4958-9f7a-541d95413b8f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:02.762022 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5dc1eeba-8403-4958-9f7a-541d95413b8f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:02.762888 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5dc1eeba-8403-4958-9f7a-541d95413b8f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:02.763416 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5dc1eeba-8403-4958-9f7a-541d95413b8f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:02.951687 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-5dc1eeba-8403-4958-9f7a-541d95413b8f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:22:02.963539 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-5dc1eeba-8403-4958-9f7a-541d95413b8f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1557 microversion: 2.1 time: 0.218032 Nov 01 01:22:02.964114 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 299/577] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:22:02 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1557 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:22:03.600732 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-1cbc4a63-662b-4d31-9863-e369756368c3 tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:22:03.601564 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-1cbc4a63-662b-4d31-9863-e369756368c3 tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] [instance: 947fe830-e3f1-4dcc-81ab-fd177af6c35f] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:22:03.609162 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-1cbc4a63-662b-4d31-9863-e369756368c3 tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:03.609803 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-1cbc4a63-662b-4d31-9863-e369756368c3 tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:03.611014 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-1cbc4a63-662b-4d31-9863-e369756368c3 tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:03.611727 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-1cbc4a63-662b-4d31-9863-e369756368c3 tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:03.757282 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-1cbc4a63-662b-4d31-9863-e369756368c3 tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec98ca6057d54c8caeac35ed360d8765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd454283e656c405f88ecb0b2ed70760a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:22:03.765700 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-1cbc4a63-662b-4d31-9863-e369756368c3 tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] 10.222.0.47 "GET /compute/v2.1/servers/947fe830-e3f1-4dcc-81ab-fd177af6c35f" status: 200 len: 1357 microversion: 2.1 time: 0.171045 Nov 01 01:22:03.766267 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 279/578] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:22:03 2021] GET /compute/v2.1/servers/947fe830-e3f1-4dcc-81ab-fd177af6c35f => generated 1357 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:22:03.981049 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-9e27939a-e54e-4168-b244-5b60764a2021 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:22:03.981593 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-9e27939a-e54e-4168-b244-5b60764a2021 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:22:03.987910 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9e27939a-e54e-4168-b244-5b60764a2021 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:03.988346 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9e27939a-e54e-4168-b244-5b60764a2021 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:03.989367 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9e27939a-e54e-4168-b244-5b60764a2021 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:03.989792 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9e27939a-e54e-4168-b244-5b60764a2021 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:04.146582 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-9e27939a-e54e-4168-b244-5b60764a2021 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:22:04.155112 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-9e27939a-e54e-4168-b244-5b60764a2021 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1557 microversion: 2.1 time: 0.177213 Nov 01 01:22:04.155898 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 300/579] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:22:03 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1557 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:22:04.784603 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-581c51a1-a450-4ca7-a7e1-92b8e509e6c0 tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:22:04.785215 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-581c51a1-a450-4ca7-a7e1-92b8e509e6c0 tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] [instance: 947fe830-e3f1-4dcc-81ab-fd177af6c35f] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:22:04.791390 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-581c51a1-a450-4ca7-a7e1-92b8e509e6c0 tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:04.791868 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-581c51a1-a450-4ca7-a7e1-92b8e509e6c0 tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:04.792637 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-581c51a1-a450-4ca7-a7e1-92b8e509e6c0 tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:04.793068 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-581c51a1-a450-4ca7-a7e1-92b8e509e6c0 tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:04.939186 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-581c51a1-a450-4ca7-a7e1-92b8e509e6c0 tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec98ca6057d54c8caeac35ed360d8765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd454283e656c405f88ecb0b2ed70760a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:22:04.946351 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-581c51a1-a450-4ca7-a7e1-92b8e509e6c0 tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] 10.222.0.47 "GET /compute/v2.1/servers/947fe830-e3f1-4dcc-81ab-fd177af6c35f" status: 200 len: 1357 microversion: 2.1 time: 0.166565 Nov 01 01:22:04.946934 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 280/580] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:22:04 2021] GET /compute/v2.1/servers/947fe830-e3f1-4dcc-81ab-fd177af6c35f => generated 1357 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:22:05.172834 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-048c2fd6-4c2a-4a4d-9a0e-8000e3a44d72 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:22:05.173691 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-048c2fd6-4c2a-4a4d-9a0e-8000e3a44d72 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:22:05.180517 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-048c2fd6-4c2a-4a4d-9a0e-8000e3a44d72 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:05.180956 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-048c2fd6-4c2a-4a4d-9a0e-8000e3a44d72 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:05.181904 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-048c2fd6-4c2a-4a4d-9a0e-8000e3a44d72 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:05.182330 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-048c2fd6-4c2a-4a4d-9a0e-8000e3a44d72 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:05.339028 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-048c2fd6-4c2a-4a4d-9a0e-8000e3a44d72 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:22:05.348579 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-048c2fd6-4c2a-4a4d-9a0e-8000e3a44d72 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1557 microversion: 2.1 time: 0.179992 Nov 01 01:22:05.349432 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 301/581] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:22:05 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1557 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:22:05.965037 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-68a09333-e6cb-4398-afa9-854c1e97e7be tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:22:05.965687 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-68a09333-e6cb-4398-afa9-854c1e97e7be tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] [instance: 947fe830-e3f1-4dcc-81ab-fd177af6c35f] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:22:05.973008 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-68a09333-e6cb-4398-afa9-854c1e97e7be tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:05.973456 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-68a09333-e6cb-4398-afa9-854c1e97e7be tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:05.974246 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-68a09333-e6cb-4398-afa9-854c1e97e7be tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:05.974707 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-68a09333-e6cb-4398-afa9-854c1e97e7be tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:06.111663 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-68a09333-e6cb-4398-afa9-854c1e97e7be tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec98ca6057d54c8caeac35ed360d8765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd454283e656c405f88ecb0b2ed70760a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:22:06.119298 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-68a09333-e6cb-4398-afa9-854c1e97e7be tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] 10.222.0.47 "GET /compute/v2.1/servers/947fe830-e3f1-4dcc-81ab-fd177af6c35f" status: 200 len: 1357 microversion: 2.1 time: 0.158036 Nov 01 01:22:06.119854 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 281/582] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:22:05 2021] GET /compute/v2.1/servers/947fe830-e3f1-4dcc-81ab-fd177af6c35f => generated 1357 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:22:06.365298 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-3f26e480-7939-4c40-96c5-de3da0a7be80 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:22:06.365911 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-3f26e480-7939-4c40-96c5-de3da0a7be80 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:22:06.372212 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3f26e480-7939-4c40-96c5-de3da0a7be80 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:06.372665 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3f26e480-7939-4c40-96c5-de3da0a7be80 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:06.373510 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3f26e480-7939-4c40-96c5-de3da0a7be80 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:06.373969 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3f26e480-7939-4c40-96c5-de3da0a7be80 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:06.504256 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-3f26e480-7939-4c40-96c5-de3da0a7be80 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:22:06.511936 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-3f26e480-7939-4c40-96c5-de3da0a7be80 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1557 microversion: 2.1 time: 0.150612 Nov 01 01:22:06.512499 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 302/583] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:22:06 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1557 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:22:06.814670 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-4cfee6ee-c5e0-4b82-bff4-7fbd8f41fe2d tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9c1da9b4-cfe5-429d-bc30-5fa4e7cf4308", "device": "/dev/sdb"}} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:22:06.816432 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-4cfee6ee-c5e0-4b82-bff4-7fbd8f41fe2d tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:22:06.823327 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4cfee6ee-c5e0-4b82-bff4-7fbd8f41fe2d tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:06.823794 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4cfee6ee-c5e0-4b82-bff4-7fbd8f41fe2d tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:06.824579 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4cfee6ee-c5e0-4b82-bff4-7fbd8f41fe2d tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:06.825005 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4cfee6ee-c5e0-4b82-bff4-7fbd8f41fe2d tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:07.137141 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-8d58bc61-0bc2-4889-aff9-f39d1502f2ae tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:22:07.137691 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-8d58bc61-0bc2-4889-aff9-f39d1502f2ae tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] [instance: 947fe830-e3f1-4dcc-81ab-fd177af6c35f] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:22:07.143627 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8d58bc61-0bc2-4889-aff9-f39d1502f2ae tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:07.144072 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8d58bc61-0bc2-4889-aff9-f39d1502f2ae tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:07.144833 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8d58bc61-0bc2-4889-aff9-f39d1502f2ae tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:07.145253 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8d58bc61-0bc2-4889-aff9-f39d1502f2ae tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:07.267635 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-8d58bc61-0bc2-4889-aff9-f39d1502f2ae tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec98ca6057d54c8caeac35ed360d8765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd454283e656c405f88ecb0b2ed70760a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:22:07.274881 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-8d58bc61-0bc2-4889-aff9-f39d1502f2ae tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] 10.222.0.47 "GET /compute/v2.1/servers/947fe830-e3f1-4dcc-81ab-fd177af6c35f" status: 200 len: 1357 microversion: 2.1 time: 0.141577 Nov 01 01:22:07.275434 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 303/584] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:22:07 2021] GET /compute/v2.1/servers/947fe830-e3f1-4dcc-81ab-fd177af6c35f => generated 1357 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:22:07.528818 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-bd79132f-6d78-4d6d-9de8-14322c3ffc8c tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:22:07.529762 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-bd79132f-6d78-4d6d-9de8-14322c3ffc8c tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:22:07.535941 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-bd79132f-6d78-4d6d-9de8-14322c3ffc8c tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:07.536442 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-bd79132f-6d78-4d6d-9de8-14322c3ffc8c tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:07.537290 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-bd79132f-6d78-4d6d-9de8-14322c3ffc8c tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:07.537795 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-bd79132f-6d78-4d6d-9de8-14322c3ffc8c tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:07.683865 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-bd79132f-6d78-4d6d-9de8-14322c3ffc8c tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:22:07.701855 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-bd79132f-6d78-4d6d-9de8-14322c3ffc8c tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1557 microversion: 2.1 time: 0.176524 Nov 01 01:22:07.702738 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 304/585] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:22:07 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1557 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:22:08.291903 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-f61b5694-461c-428d-963e-55a43e7e1d5e tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:22:08.292486 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-f61b5694-461c-428d-963e-55a43e7e1d5e tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] [instance: 947fe830-e3f1-4dcc-81ab-fd177af6c35f] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:22:08.309423 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f61b5694-461c-428d-963e-55a43e7e1d5e tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:08.309923 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f61b5694-461c-428d-963e-55a43e7e1d5e tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:08.311422 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f61b5694-461c-428d-963e-55a43e7e1d5e tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:08.311910 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f61b5694-461c-428d-963e-55a43e7e1d5e tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:08.447944 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-f61b5694-461c-428d-963e-55a43e7e1d5e tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec98ca6057d54c8caeac35ed360d8765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd454283e656c405f88ecb0b2ed70760a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:22:08.455211 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-f61b5694-461c-428d-963e-55a43e7e1d5e tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] 10.222.0.47 "GET /compute/v2.1/servers/947fe830-e3f1-4dcc-81ab-fd177af6c35f" status: 200 len: 1357 microversion: 2.1 time: 0.166928 Nov 01 01:22:08.455768 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 305/586] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:22:08 2021] GET /compute/v2.1/servers/947fe830-e3f1-4dcc-81ab-fd177af6c35f => generated 1357 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:22:08.718773 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-54497452-4f44-457c-a434-9cafaabfdad4 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:22:08.719507 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-54497452-4f44-457c-a434-9cafaabfdad4 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:22:08.725594 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-54497452-4f44-457c-a434-9cafaabfdad4 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:08.726038 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-54497452-4f44-457c-a434-9cafaabfdad4 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:08.726819 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-54497452-4f44-457c-a434-9cafaabfdad4 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:08.727247 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-54497452-4f44-457c-a434-9cafaabfdad4 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:09.253742 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-54497452-4f44-457c-a434-9cafaabfdad4 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:22:09.261801 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-54497452-4f44-457c-a434-9cafaabfdad4 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1557 microversion: 2.1 time: 0.547111 Nov 01 01:22:09.262357 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 306/587] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:22:08 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1557 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:22:09.472820 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-3daff0d2-dfd6-4cce-ae8c-90bfb3e234c8 tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:22:09.473744 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-3daff0d2-dfd6-4cce-ae8c-90bfb3e234c8 tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] [instance: 947fe830-e3f1-4dcc-81ab-fd177af6c35f] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:22:09.479993 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3daff0d2-dfd6-4cce-ae8c-90bfb3e234c8 tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:09.480438 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3daff0d2-dfd6-4cce-ae8c-90bfb3e234c8 tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:09.481215 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3daff0d2-dfd6-4cce-ae8c-90bfb3e234c8 tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:09.481642 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3daff0d2-dfd6-4cce-ae8c-90bfb3e234c8 tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:09.601971 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-3daff0d2-dfd6-4cce-ae8c-90bfb3e234c8 tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec98ca6057d54c8caeac35ed360d8765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd454283e656c405f88ecb0b2ed70760a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:22:09.609867 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-3daff0d2-dfd6-4cce-ae8c-90bfb3e234c8 tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] 10.222.0.47 "GET /compute/v2.1/servers/947fe830-e3f1-4dcc-81ab-fd177af6c35f" status: 200 len: 1357 microversion: 2.1 time: 0.141021 Nov 01 01:22:09.610838 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 307/588] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:22:09 2021] GET /compute/v2.1/servers/947fe830-e3f1-4dcc-81ab-fd177af6c35f => generated 1357 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:22:10.279281 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-0450dbd1-f29f-478e-ac99-1b5dafad578f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:22:10.279933 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-0450dbd1-f29f-478e-ac99-1b5dafad578f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:22:10.286084 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0450dbd1-f29f-478e-ac99-1b5dafad578f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:10.286569 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0450dbd1-f29f-478e-ac99-1b5dafad578f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:10.287435 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0450dbd1-f29f-478e-ac99-1b5dafad578f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:10.287757 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0450dbd1-f29f-478e-ac99-1b5dafad578f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:10.430918 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-0450dbd1-f29f-478e-ac99-1b5dafad578f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:22:10.439214 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-0450dbd1-f29f-478e-ac99-1b5dafad578f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1557 microversion: 2.1 time: 0.163540 Nov 01 01:22:10.440009 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 308/589] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:22:10 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1557 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:22:10.627378 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-a5c1397b-f57f-4969-acce-6ef4b9185776 tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:22:10.627907 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-a5c1397b-f57f-4969-acce-6ef4b9185776 tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] [instance: 947fe830-e3f1-4dcc-81ab-fd177af6c35f] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:22:10.633858 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a5c1397b-f57f-4969-acce-6ef4b9185776 tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:10.634811 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a5c1397b-f57f-4969-acce-6ef4b9185776 tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:10.635258 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a5c1397b-f57f-4969-acce-6ef4b9185776 tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:10.635700 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a5c1397b-f57f-4969-acce-6ef4b9185776 tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:10.774325 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-a5c1397b-f57f-4969-acce-6ef4b9185776 tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec98ca6057d54c8caeac35ed360d8765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd454283e656c405f88ecb0b2ed70760a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:22:10.781746 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-a5c1397b-f57f-4969-acce-6ef4b9185776 tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] 10.222.0.47 "GET /compute/v2.1/servers/947fe830-e3f1-4dcc-81ab-fd177af6c35f" status: 200 len: 1357 microversion: 2.1 time: 0.158982 Nov 01 01:22:10.782524 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 309/590] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:22:10 2021] GET /compute/v2.1/servers/947fe830-e3f1-4dcc-81ab-fd177af6c35f => generated 1357 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:22:11.456864 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-a69530be-4f14-493e-a224-3fc85e52b424 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:22:11.457548 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-a69530be-4f14-493e-a224-3fc85e52b424 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:22:11.464212 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a69530be-4f14-493e-a224-3fc85e52b424 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:11.464700 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a69530be-4f14-493e-a224-3fc85e52b424 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:11.465508 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a69530be-4f14-493e-a224-3fc85e52b424 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:11.465941 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a69530be-4f14-493e-a224-3fc85e52b424 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:11.591785 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-a69530be-4f14-493e-a224-3fc85e52b424 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:22:11.600200 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-a69530be-4f14-493e-a224-3fc85e52b424 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1557 microversion: 2.1 time: 0.147004 Nov 01 01:22:11.600763 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 310/591] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:22:11 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1557 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:22:11.797861 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-36456e96-f8c0-46e0-a5ed-c234a90c1593 tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:22:11.798490 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-36456e96-f8c0-46e0-a5ed-c234a90c1593 tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] [instance: 947fe830-e3f1-4dcc-81ab-fd177af6c35f] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:22:11.804268 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-36456e96-f8c0-46e0-a5ed-c234a90c1593 tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:11.804712 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-36456e96-f8c0-46e0-a5ed-c234a90c1593 tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:11.805464 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-36456e96-f8c0-46e0-a5ed-c234a90c1593 tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:11.805889 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-36456e96-f8c0-46e0-a5ed-c234a90c1593 tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:11.936227 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-36456e96-f8c0-46e0-a5ed-c234a90c1593 tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec98ca6057d54c8caeac35ed360d8765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd454283e656c405f88ecb0b2ed70760a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:22:11.943415 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-36456e96-f8c0-46e0-a5ed-c234a90c1593 tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] 10.222.0.47 "GET /compute/v2.1/servers/947fe830-e3f1-4dcc-81ab-fd177af6c35f" status: 200 len: 1357 microversion: 2.1 time: 0.149147 Nov 01 01:22:11.943975 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 311/592] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:22:11 2021] GET /compute/v2.1/servers/947fe830-e3f1-4dcc-81ab-fd177af6c35f => generated 1357 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:22:12.617339 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-6d50fa9a-5cfc-49aa-8c99-cffdcfad3640 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:22:12.770024 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-6d50fa9a-5cfc-49aa-8c99-cffdcfad3640 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:22:12.770024 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6d50fa9a-5cfc-49aa-8c99-cffdcfad3640 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:12.770024 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6d50fa9a-5cfc-49aa-8c99-cffdcfad3640 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:12.770024 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6d50fa9a-5cfc-49aa-8c99-cffdcfad3640 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:12.770349 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6d50fa9a-5cfc-49aa-8c99-cffdcfad3640 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:12.770349 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-6d50fa9a-5cfc-49aa-8c99-cffdcfad3640 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:22:12.771248 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-6d50fa9a-5cfc-49aa-8c99-cffdcfad3640 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1557 microversion: 2.1 time: 0.157882 Nov 01 01:22:12.771815 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 312/593] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:22:12 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1557 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:22:12.963555 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-599da0f9-65ad-4838-b275-68a1630f44b4 tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:22:12.964205 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-599da0f9-65ad-4838-b275-68a1630f44b4 tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] [instance: 947fe830-e3f1-4dcc-81ab-fd177af6c35f] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:22:12.972107 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-599da0f9-65ad-4838-b275-68a1630f44b4 tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:12.972557 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-599da0f9-65ad-4838-b275-68a1630f44b4 tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:12.973335 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-599da0f9-65ad-4838-b275-68a1630f44b4 tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:12.973764 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-599da0f9-65ad-4838-b275-68a1630f44b4 tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:13.108590 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-599da0f9-65ad-4838-b275-68a1630f44b4 tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec98ca6057d54c8caeac35ed360d8765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd454283e656c405f88ecb0b2ed70760a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:22:13.126935 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-599da0f9-65ad-4838-b275-68a1630f44b4 tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] 10.222.0.47 "GET /compute/v2.1/servers/947fe830-e3f1-4dcc-81ab-fd177af6c35f" status: 200 len: 1357 microversion: 2.1 time: 0.166922 Nov 01 01:22:13.128278 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 313/594] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:22:12 2021] GET /compute/v2.1/servers/947fe830-e3f1-4dcc-81ab-fd177af6c35f => generated 1357 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:22:13.794404 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-891b3a27-3309-497c-a597-66a739ae9fbb tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:22:13.795395 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-891b3a27-3309-497c-a597-66a739ae9fbb tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:22:13.801880 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-891b3a27-3309-497c-a597-66a739ae9fbb tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:13.812858 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-891b3a27-3309-497c-a597-66a739ae9fbb tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:13.812858 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-891b3a27-3309-497c-a597-66a739ae9fbb tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:13.812858 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-891b3a27-3309-497c-a597-66a739ae9fbb tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:13.932633 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-891b3a27-3309-497c-a597-66a739ae9fbb tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:22:13.944306 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-891b3a27-3309-497c-a597-66a739ae9fbb tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1557 microversion: 2.1 time: 0.150388 Nov 01 01:22:13.944306 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 314/595] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:22:13 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1557 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:22:14.148172 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-bcc89573-85f5-4fa4-8573-842e928083cb tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:22:14.148695 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-bcc89573-85f5-4fa4-8573-842e928083cb tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] [instance: 947fe830-e3f1-4dcc-81ab-fd177af6c35f] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:22:14.154638 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-bcc89573-85f5-4fa4-8573-842e928083cb tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:14.155083 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-bcc89573-85f5-4fa4-8573-842e928083cb tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:14.155875 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-bcc89573-85f5-4fa4-8573-842e928083cb tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:14.156297 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-bcc89573-85f5-4fa4-8573-842e928083cb tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:14.290204 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-bcc89573-85f5-4fa4-8573-842e928083cb tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec98ca6057d54c8caeac35ed360d8765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd454283e656c405f88ecb0b2ed70760a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:22:14.298284 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-bcc89573-85f5-4fa4-8573-842e928083cb tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] 10.222.0.47 "GET /compute/v2.1/servers/947fe830-e3f1-4dcc-81ab-fd177af6c35f" status: 200 len: 1357 microversion: 2.1 time: 0.153999 Nov 01 01:22:14.300542 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 315/596] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:22:14 2021] GET /compute/v2.1/servers/947fe830-e3f1-4dcc-81ab-fd177af6c35f => generated 1357 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:22:14.917939 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-5ab3b82f-c2ac-4a7f-9281-7257bfbf52ab tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-95136953", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-2122604351", "security_groups": [{"name": "tempest-secgroup-smoke-2052216325"}], "networks": [{"uuid": "c01565d8-2490-4dd3-8b01-bf9784f0ede9"}], "block_device_mapping_v2": [{"uuid": "b8429f6e-69c0-4b3a-a097-ded9f0144492", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:22:15.021861 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.network.neutron [None req-5ab3b82f-c2ac-4a7f-9281-7257bfbf52ab tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] validate_networks() for [('c01565d8-2490-4dd3-8b01-bf9784f0ede9', None, None, None, None, None)] {{(pid=116266) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Nov 01 01:22:15.403364 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.virt.hardware [None req-5ab3b82f-c2ac-4a7f-9281-7257bfbf52ab tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Flavor limits 0:0:0 {{(pid=116266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 01 01:22:15.403775 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.virt.hardware [None req-5ab3b82f-c2ac-4a7f-9281-7257bfbf52ab tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Image limits 0:0:0 {{(pid=116266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 01 01:22:15.404237 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.virt.hardware [None req-5ab3b82f-c2ac-4a7f-9281-7257bfbf52ab tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Flavor pref 0:0:0 {{(pid=116266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 01 01:22:15.404634 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.virt.hardware [None req-5ab3b82f-c2ac-4a7f-9281-7257bfbf52ab tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Image pref 0:0:0 {{(pid=116266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 01 01:22:15.405032 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.virt.hardware [None req-5ab3b82f-c2ac-4a7f-9281-7257bfbf52ab tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 01 01:22:15.413681 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5ab3b82f-c2ac-4a7f-9281-7257bfbf52ab tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:15.414114 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5ab3b82f-c2ac-4a7f-9281-7257bfbf52ab tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:15.414939 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5ab3b82f-c2ac-4a7f-9281-7257bfbf52ab tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:15.415360 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5ab3b82f-c2ac-4a7f-9281-7257bfbf52ab tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:15.432507 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.quota [None req-5ab3b82f-c2ac-4a7f-9281-7257bfbf52ab tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Getting quotas for project 89ba2f03280e45b4ad8deab41fffe14f. Resources: {'instances', 'cores', 'ram'} {{(pid=116266) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 01 01:22:15.437564 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.quota [None req-5ab3b82f-c2ac-4a7f-9281-7257bfbf52ab tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Getting quotas for user b67e821884b248a99caf956b7f3de189 and project 89ba2f03280e45b4ad8deab41fffe14f. Resources: {'instances', 'cores', 'ram'} {{(pid=116266) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 01 01:22:15.493356 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-5ab3b82f-c2ac-4a7f-9281-7257bfbf52ab tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Going to run 1 instances... {{(pid=116266) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 01 01:22:15.495427 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-5ab3b82f-c2ac-4a7f-9281-7257bfbf52ab tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b8429f6e-69c0-4b3a-a097-ded9f0144492',volume_size=None,volume_type=None)] {{(pid=116266) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 01 01:22:16.262683 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-5ab3b82f-c2ac-4a7f-9281-7257bfbf52ab tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.348322 Nov 01 01:22:16.263640 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 316/597] 10.222.0.47 () {60 vars in 1146 bytes} [Mon Nov 1 01:22:14 2021] POST /compute/v2.1/servers => generated 406 bytes in 1350 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 01 01:22:16.268826 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-725d3349-aed8-47e4-bf40-b37124d3b735 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:22:16.269432 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-725d3349-aed8-47e4-bf40-b37124d3b735 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:22:16.275375 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-725d3349-aed8-47e4-bf40-b37124d3b735 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:16.275820 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-725d3349-aed8-47e4-bf40-b37124d3b735 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:16.276588 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-725d3349-aed8-47e4-bf40-b37124d3b735 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:16.277024 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-725d3349-aed8-47e4-bf40-b37124d3b735 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:16.422212 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-725d3349-aed8-47e4-bf40-b37124d3b735 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:22:16.431108 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-725d3349-aed8-47e4-bf40-b37124d3b735 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1557 microversion: 2.1 time: 0.166426 Nov 01 01:22:16.431850 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 317/598] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:22:16 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1557 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:22:16.446019 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-9d28af47-135a-4fc1-b2b7-06a45919b8be tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:22:16.446665 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-9d28af47-135a-4fc1-b2b7-06a45919b8be tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] [instance: 947fe830-e3f1-4dcc-81ab-fd177af6c35f] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:22:16.453739 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9d28af47-135a-4fc1-b2b7-06a45919b8be tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:16.454313 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9d28af47-135a-4fc1-b2b7-06a45919b8be tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:16.455198 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9d28af47-135a-4fc1-b2b7-06a45919b8be tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:16.455700 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9d28af47-135a-4fc1-b2b7-06a45919b8be tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:16.608779 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-9d28af47-135a-4fc1-b2b7-06a45919b8be tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec98ca6057d54c8caeac35ed360d8765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd454283e656c405f88ecb0b2ed70760a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:22:16.616617 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-9d28af47-135a-4fc1-b2b7-06a45919b8be tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] 10.222.0.47 "GET /compute/v2.1/servers/947fe830-e3f1-4dcc-81ab-fd177af6c35f" status: 200 len: 1357 microversion: 2.1 time: 0.177706 Nov 01 01:22:16.617536 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 318/599] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:22:16 2021] GET /compute/v2.1/servers/947fe830-e3f1-4dcc-81ab-fd177af6c35f => generated 1357 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:22:16.625980 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-52731d3f-263c-45bf-8d35-2ff77f05f8db tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:22:16.625980 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-52731d3f-263c-45bf-8d35-2ff77f05f8db tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:22:16.680455 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-52731d3f-263c-45bf-8d35-2ff77f05f8db tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:22:16.686826 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-52731d3f-263c-45bf-8d35-2ff77f05f8db tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1087 microversion: 2.1 time: 0.067804 Nov 01 01:22:16.689127 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 319/600] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:22:16 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1087 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:22:17.448670 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-17a46699-280e-42a2-9941-96d2c48aa497 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:22:17.449563 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-17a46699-280e-42a2-9941-96d2c48aa497 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:22:17.456429 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-17a46699-280e-42a2-9941-96d2c48aa497 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:17.456984 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-17a46699-280e-42a2-9941-96d2c48aa497 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:17.458028 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-17a46699-280e-42a2-9941-96d2c48aa497 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:17.458718 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-17a46699-280e-42a2-9941-96d2c48aa497 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:17.585735 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-17a46699-280e-42a2-9941-96d2c48aa497 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:22:17.593548 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-17a46699-280e-42a2-9941-96d2c48aa497 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1557 microversion: 2.1 time: 0.148731 Nov 01 01:22:17.598410 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 320/601] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:22:17 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1557 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:22:17.633369 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-0c658cc2-66fd-4186-bfb6-a8ee41d99219 tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:22:17.634010 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-0c658cc2-66fd-4186-bfb6-a8ee41d99219 tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] [instance: 947fe830-e3f1-4dcc-81ab-fd177af6c35f] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:22:17.640034 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0c658cc2-66fd-4186-bfb6-a8ee41d99219 tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:17.640519 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0c658cc2-66fd-4186-bfb6-a8ee41d99219 tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:17.641282 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0c658cc2-66fd-4186-bfb6-a8ee41d99219 tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:17.641711 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0c658cc2-66fd-4186-bfb6-a8ee41d99219 tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:17.764105 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-0c658cc2-66fd-4186-bfb6-a8ee41d99219 tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec98ca6057d54c8caeac35ed360d8765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd454283e656c405f88ecb0b2ed70760a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:22:17.771979 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-0c658cc2-66fd-4186-bfb6-a8ee41d99219 tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] 10.222.0.47 "GET /compute/v2.1/servers/947fe830-e3f1-4dcc-81ab-fd177af6c35f" status: 200 len: 1357 microversion: 2.1 time: 0.142310 Nov 01 01:22:17.772582 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 321/602] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:22:17 2021] GET /compute/v2.1/servers/947fe830-e3f1-4dcc-81ab-fd177af6c35f => generated 1357 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:22:17.776899 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-f4646893-f5d1-4f76-b422-e85cee1abf2d tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:22:17.777496 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-f4646893-f5d1-4f76-b422-e85cee1abf2d tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:22:17.783115 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f4646893-f5d1-4f76-b422-e85cee1abf2d tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:17.783558 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f4646893-f5d1-4f76-b422-e85cee1abf2d tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:17.784315 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f4646893-f5d1-4f76-b422-e85cee1abf2d tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:17.784742 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f4646893-f5d1-4f76-b422-e85cee1abf2d tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:17.843757 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-f4646893-f5d1-4f76-b422-e85cee1abf2d tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:22:17.851173 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-f4646893-f5d1-4f76-b422-e85cee1abf2d tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1137 microversion: 2.1 time: 0.077653 Nov 01 01:22:17.851732 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 322/603] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:22:17 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1137 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:22:18.611117 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-155626cc-2c8f-4dfe-8639-ecaf19d77954 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:22:18.611741 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-155626cc-2c8f-4dfe-8639-ecaf19d77954 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:22:18.618162 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-155626cc-2c8f-4dfe-8639-ecaf19d77954 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:18.618667 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-155626cc-2c8f-4dfe-8639-ecaf19d77954 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:18.619422 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-155626cc-2c8f-4dfe-8639-ecaf19d77954 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:18.619847 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-155626cc-2c8f-4dfe-8639-ecaf19d77954 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:18.736105 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-155626cc-2c8f-4dfe-8639-ecaf19d77954 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:22:18.743985 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-155626cc-2c8f-4dfe-8639-ecaf19d77954 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1557 microversion: 2.1 time: 0.137049 Nov 01 01:22:18.744546 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 323/604] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:22:18 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1557 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:22:18.787712 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-fbeb9593-856b-4dbf-848a-a36858bd53ff tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:22:18.788304 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-fbeb9593-856b-4dbf-848a-a36858bd53ff tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] [instance: 947fe830-e3f1-4dcc-81ab-fd177af6c35f] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:22:18.793873 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-fbeb9593-856b-4dbf-848a-a36858bd53ff tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:18.794307 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-fbeb9593-856b-4dbf-848a-a36858bd53ff tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:18.795080 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-fbeb9593-856b-4dbf-848a-a36858bd53ff tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:18.795503 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-fbeb9593-856b-4dbf-848a-a36858bd53ff tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:18.910559 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-fbeb9593-856b-4dbf-848a-a36858bd53ff tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec98ca6057d54c8caeac35ed360d8765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd454283e656c405f88ecb0b2ed70760a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:22:18.917663 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-fbeb9593-856b-4dbf-848a-a36858bd53ff tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] 10.222.0.47 "GET /compute/v2.1/servers/947fe830-e3f1-4dcc-81ab-fd177af6c35f" status: 200 len: 1357 microversion: 2.1 time: 0.133386 Nov 01 01:22:18.918221 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 324/605] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:22:18 2021] GET /compute/v2.1/servers/947fe830-e3f1-4dcc-81ab-fd177af6c35f => generated 1357 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:22:18.922942 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-e9e267cd-ca65-4bd9-b985-b5e563c45216 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:22:18.923535 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-e9e267cd-ca65-4bd9-b985-b5e563c45216 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:22:18.928733 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e9e267cd-ca65-4bd9-b985-b5e563c45216 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:18.929175 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e9e267cd-ca65-4bd9-b985-b5e563c45216 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:18.929921 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e9e267cd-ca65-4bd9-b985-b5e563c45216 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:18.930344 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e9e267cd-ca65-4bd9-b985-b5e563c45216 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:18.991237 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-e9e267cd-ca65-4bd9-b985-b5e563c45216 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:22:18.998505 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-e9e267cd-ca65-4bd9-b985-b5e563c45216 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1137 microversion: 2.1 time: 0.079228 Nov 01 01:22:18.999839 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 325/606] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:22:18 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1137 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:22:19.761417 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-7e8daa3c-d267-490e-86a4-7ab5c3995a3d tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:22:19.762185 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-7e8daa3c-d267-490e-86a4-7ab5c3995a3d tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:22:19.768099 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7e8daa3c-d267-490e-86a4-7ab5c3995a3d tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:19.768552 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7e8daa3c-d267-490e-86a4-7ab5c3995a3d tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:19.769309 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7e8daa3c-d267-490e-86a4-7ab5c3995a3d tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:19.769739 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7e8daa3c-d267-490e-86a4-7ab5c3995a3d tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:19.893394 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-7e8daa3c-d267-490e-86a4-7ab5c3995a3d tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:22:19.901429 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-7e8daa3c-d267-490e-86a4-7ab5c3995a3d tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1557 microversion: 2.1 time: 0.144115 Nov 01 01:22:19.902235 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 326/607] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:22:19 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1557 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:22:19.934194 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-fe9232d4-5f28-40d7-a531-049cf2d8b823 tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:22:19.934828 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-fe9232d4-5f28-40d7-a531-049cf2d8b823 tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] [instance: 947fe830-e3f1-4dcc-81ab-fd177af6c35f] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:22:19.941089 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-fe9232d4-5f28-40d7-a531-049cf2d8b823 tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:19.941525 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-fe9232d4-5f28-40d7-a531-049cf2d8b823 tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:19.942273 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-fe9232d4-5f28-40d7-a531-049cf2d8b823 tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:19.942718 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-fe9232d4-5f28-40d7-a531-049cf2d8b823 tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:20.071651 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-fe9232d4-5f28-40d7-a531-049cf2d8b823 tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec98ca6057d54c8caeac35ed360d8765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd454283e656c405f88ecb0b2ed70760a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:22:20.079406 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-fe9232d4-5f28-40d7-a531-049cf2d8b823 tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] 10.222.0.47 "GET /compute/v2.1/servers/947fe830-e3f1-4dcc-81ab-fd177af6c35f" status: 200 len: 1357 microversion: 2.1 time: 0.148686 Nov 01 01:22:20.079973 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 327/608] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:22:19 2021] GET /compute/v2.1/servers/947fe830-e3f1-4dcc-81ab-fd177af6c35f => generated 1357 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:22:20.084084 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-ac94b2ea-5902-48d1-a390-bf72cf0c0150 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:22:20.084679 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-ac94b2ea-5902-48d1-a390-bf72cf0c0150 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:22:20.090192 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ac94b2ea-5902-48d1-a390-bf72cf0c0150 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:20.090667 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ac94b2ea-5902-48d1-a390-bf72cf0c0150 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:20.091469 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ac94b2ea-5902-48d1-a390-bf72cf0c0150 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:20.091904 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ac94b2ea-5902-48d1-a390-bf72cf0c0150 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:20.149566 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-ac94b2ea-5902-48d1-a390-bf72cf0c0150 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:22:20.156760 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-ac94b2ea-5902-48d1-a390-bf72cf0c0150 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1137 microversion: 2.1 time: 0.075859 Nov 01 01:22:20.157312 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 328/609] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:22:20 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1137 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:22:20.918229 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-f553dfcd-9995-4a9a-a646-89e4c7e5ce2b tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:22:20.918935 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-f553dfcd-9995-4a9a-a646-89e4c7e5ce2b tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:22:20.925193 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f553dfcd-9995-4a9a-a646-89e4c7e5ce2b tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:20.925635 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f553dfcd-9995-4a9a-a646-89e4c7e5ce2b tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:20.926451 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f553dfcd-9995-4a9a-a646-89e4c7e5ce2b tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:20.926928 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f553dfcd-9995-4a9a-a646-89e4c7e5ce2b tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:21.178266 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-f553dfcd-9995-4a9a-a646-89e4c7e5ce2b tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:22:21.186267 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-f553dfcd-9995-4a9a-a646-89e4c7e5ce2b tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1557 microversion: 2.1 time: 0.271756 Nov 01 01:22:21.187224 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 329/610] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:22:20 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1557 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:22:21.193025 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-6fcb9c2d-6ca4-4912-947b-d0354ae89543 tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:22:21.193654 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-6fcb9c2d-6ca4-4912-947b-d0354ae89543 tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] [instance: 947fe830-e3f1-4dcc-81ab-fd177af6c35f] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:22:21.209940 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6fcb9c2d-6ca4-4912-947b-d0354ae89543 tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:21.210657 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6fcb9c2d-6ca4-4912-947b-d0354ae89543 tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:21.211745 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6fcb9c2d-6ca4-4912-947b-d0354ae89543 tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:21.212332 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6fcb9c2d-6ca4-4912-947b-d0354ae89543 tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:21.387071 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-6fcb9c2d-6ca4-4912-947b-d0354ae89543 tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec98ca6057d54c8caeac35ed360d8765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd454283e656c405f88ecb0b2ed70760a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:22:21.394558 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-6fcb9c2d-6ca4-4912-947b-d0354ae89543 tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] 10.222.0.47 "GET /compute/v2.1/servers/947fe830-e3f1-4dcc-81ab-fd177af6c35f" status: 200 len: 1357 microversion: 2.1 time: 0.205670 Nov 01 01:22:21.404408 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 330/611] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:22:21 2021] GET /compute/v2.1/servers/947fe830-e3f1-4dcc-81ab-fd177af6c35f => generated 1357 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:22:21.409951 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-dc5d3ce2-c915-4004-9da6-e501710d8a21 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:22:21.410969 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-dc5d3ce2-c915-4004-9da6-e501710d8a21 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:22:21.418708 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-dc5d3ce2-c915-4004-9da6-e501710d8a21 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:21.421432 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-dc5d3ce2-c915-4004-9da6-e501710d8a21 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:21.421432 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-dc5d3ce2-c915-4004-9da6-e501710d8a21 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:21.421432 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-dc5d3ce2-c915-4004-9da6-e501710d8a21 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:21.493422 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-dc5d3ce2-c915-4004-9da6-e501710d8a21 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:22:21.500846 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-dc5d3ce2-c915-4004-9da6-e501710d8a21 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1129 microversion: 2.1 time: 0.095188 Nov 01 01:22:21.501851 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 331/612] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:22:21 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1129 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:22:21.860771 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-4cfee6ee-c5e0-4b82-bff4-7fbd8f41fe2d tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "POST /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 15.050238 Nov 01 01:22:21.861369 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 282/613] 10.222.0.47 () {60 vars in 1322 bytes} [Mon Nov 1 01:22:06 2021] POST /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b/os-volume_attachments => generated 194 bytes in 15052 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:22:21.942279 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [req-d3240d34-0578-4a74-b49d-347a60ad6201 req-bbe6c60f-7f2b-462f-b437-966c5c904eb0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "947fe830-e3f1-4dcc-81ab-fd177af6c35f", "tag": "dcc542d2-302c-4d52-bd3e-404d021f3507"}]} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:22:21.945564 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 01 01:22:21.945564 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: warnings.warn(msg) Nov 01 01:22:21.953055 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [req-d3240d34-0578-4a74-b49d-347a60ad6201 req-bbe6c60f-7f2b-462f-b437-966c5c904eb0 service nova] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:21.959089 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [req-d3240d34-0578-4a74-b49d-347a60ad6201 req-bbe6c60f-7f2b-462f-b437-966c5c904eb0 service nova] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:21.977818 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.compute.server_external_events [req-d3240d34-0578-4a74-b49d-347a60ad6201 req-bbe6c60f-7f2b-462f-b437-966c5c904eb0 service nova] Creating event network-changed:dcc542d2-302c-4d52-bd3e-404d021f3507 for instance 947fe830-e3f1-4dcc-81ab-fd177af6c35f on hv-cinder-81561 Nov 01 01:22:21.978169 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [req-d3240d34-0578-4a74-b49d-347a60ad6201 req-bbe6c60f-7f2b-462f-b437-966c5c904eb0 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048327 Nov 01 01:22:21.979128 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 332/614] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Nov 1 01:22:21 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:22:22.210278 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-1c5d3a40-831e-4efd-be05-3eedf7a16147 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:22:22.211139 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-1c5d3a40-831e-4efd-be05-3eedf7a16147 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:22:22.217935 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-1c5d3a40-831e-4efd-be05-3eedf7a16147 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:22.218373 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-1c5d3a40-831e-4efd-be05-3eedf7a16147 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:22.219151 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-1c5d3a40-831e-4efd-be05-3eedf7a16147 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:22.219574 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-1c5d3a40-831e-4efd-be05-3eedf7a16147 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:22.394523 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-1c5d3a40-831e-4efd-be05-3eedf7a16147 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:22:22.406789 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-1c5d3a40-831e-4efd-be05-3eedf7a16147 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1557 microversion: 2.1 time: 0.205227 Nov 01 01:22:22.412346 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-8454e1bd-8cba-4cfd-9ecc-6c19977e58ae tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:22:22.413123 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-8454e1bd-8cba-4cfd-9ecc-6c19977e58ae tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] [instance: 947fe830-e3f1-4dcc-81ab-fd177af6c35f] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:22:22.417934 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 283/615] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:22:22 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1557 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:22:22.421946 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8454e1bd-8cba-4cfd-9ecc-6c19977e58ae tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:22.422379 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8454e1bd-8cba-4cfd-9ecc-6c19977e58ae tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:22.423271 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8454e1bd-8cba-4cfd-9ecc-6c19977e58ae tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:22.423666 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8454e1bd-8cba-4cfd-9ecc-6c19977e58ae tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:22.517510 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-f50f7f9b-dbbe-4ccf-b719-2c49d8ffd37a tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:22:22.518340 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-f50f7f9b-dbbe-4ccf-b719-2c49d8ffd37a tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:22:22.524700 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f50f7f9b-dbbe-4ccf-b719-2c49d8ffd37a tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:22.525250 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f50f7f9b-dbbe-4ccf-b719-2c49d8ffd37a tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:22.526214 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f50f7f9b-dbbe-4ccf-b719-2c49d8ffd37a tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:22.526890 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f50f7f9b-dbbe-4ccf-b719-2c49d8ffd37a tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:22.576753 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-8454e1bd-8cba-4cfd-9ecc-6c19977e58ae tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec98ca6057d54c8caeac35ed360d8765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd454283e656c405f88ecb0b2ed70760a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:22:22.588457 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-8454e1bd-8cba-4cfd-9ecc-6c19977e58ae tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] 10.222.0.47 "GET /compute/v2.1/servers/947fe830-e3f1-4dcc-81ab-fd177af6c35f" status: 200 len: 1357 microversion: 2.1 time: 0.180340 Nov 01 01:22:22.592176 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-f50f7f9b-dbbe-4ccf-b719-2c49d8ffd37a tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:22:22.595266 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 333/616] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:22:22 2021] GET /compute/v2.1/servers/947fe830-e3f1-4dcc-81ab-fd177af6c35f => generated 1357 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:22:22.601068 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-f50f7f9b-dbbe-4ccf-b719-2c49d8ffd37a tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1193 microversion: 2.1 time: 0.087469 Nov 01 01:22:22.601703 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 284/617] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:22:22 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1193 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:22:23.425713 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-e318e52a-7143-4493-b4eb-5ff0449b2ffd tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:22:23.434507 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-e318e52a-7143-4493-b4eb-5ff0449b2ffd tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:22:23.442372 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e318e52a-7143-4493-b4eb-5ff0449b2ffd tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:23.442855 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e318e52a-7143-4493-b4eb-5ff0449b2ffd tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:23.443655 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e318e52a-7143-4493-b4eb-5ff0449b2ffd tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:23.444082 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e318e52a-7143-4493-b4eb-5ff0449b2ffd tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:23.576485 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-e318e52a-7143-4493-b4eb-5ff0449b2ffd tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:22:23.586531 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-e318e52a-7143-4493-b4eb-5ff0449b2ffd tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1557 microversion: 2.1 time: 0.164929 Nov 01 01:22:23.587061 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 334/618] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:22:23 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1557 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:22:23.611005 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-b47bdadc-33ad-4f7f-8444-02a8ab03d6cf tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:22:23.611676 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-b47bdadc-33ad-4f7f-8444-02a8ab03d6cf tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] [instance: 947fe830-e3f1-4dcc-81ab-fd177af6c35f] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:22:23.618537 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b47bdadc-33ad-4f7f-8444-02a8ab03d6cf tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:23.618730 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-40230a4f-545f-4e7b-b62a-f6be7370cbc8 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:22:23.619225 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-40230a4f-545f-4e7b-b62a-f6be7370cbc8 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:22:23.619508 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b47bdadc-33ad-4f7f-8444-02a8ab03d6cf tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:23.620277 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b47bdadc-33ad-4f7f-8444-02a8ab03d6cf tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:23.620696 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b47bdadc-33ad-4f7f-8444-02a8ab03d6cf tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:23.625578 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-40230a4f-545f-4e7b-b62a-f6be7370cbc8 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:23.626061 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-40230a4f-545f-4e7b-b62a-f6be7370cbc8 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:23.626885 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-40230a4f-545f-4e7b-b62a-f6be7370cbc8 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:23.627317 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-40230a4f-545f-4e7b-b62a-f6be7370cbc8 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:23.805640 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-b47bdadc-33ad-4f7f-8444-02a8ab03d6cf tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec98ca6057d54c8caeac35ed360d8765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd454283e656c405f88ecb0b2ed70760a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:22:23.814972 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-b47bdadc-33ad-4f7f-8444-02a8ab03d6cf tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] 10.222.0.47 "GET /compute/v2.1/servers/947fe830-e3f1-4dcc-81ab-fd177af6c35f" status: 200 len: 1357 microversion: 2.1 time: 0.207475 Nov 01 01:22:23.815506 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 285/619] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:22:23 2021] GET /compute/v2.1/servers/947fe830-e3f1-4dcc-81ab-fd177af6c35f => generated 1357 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:22:23.820360 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-40230a4f-545f-4e7b-b62a-f6be7370cbc8 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:22:23.827743 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-40230a4f-545f-4e7b-b62a-f6be7370cbc8 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1271 microversion: 2.1 time: 0.212629 Nov 01 01:22:23.828852 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 335/620] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:22:23 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1271 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:22:24.239242 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [req-910e8a57-99f9-4643-9437-b91c562050e9 req-073663de-ce4b-46c6-997f-4b27cbd9f88c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7554da88-1726-438a-bed5-4e30d999ba9d", "tag": "bebb1bd2-6980-4bbb-a08e-ca30b1d8aac9"}]} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:22:24.241183 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 01 01:22:24.241183 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: warnings.warn(msg) Nov 01 01:22:24.248114 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [req-910e8a57-99f9-4643-9437-b91c562050e9 req-073663de-ce4b-46c6-997f-4b27cbd9f88c service nova] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:24.248616 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [req-910e8a57-99f9-4643-9437-b91c562050e9 req-073663de-ce4b-46c6-997f-4b27cbd9f88c service nova] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:24.260544 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.compute.server_external_events [req-910e8a57-99f9-4643-9437-b91c562050e9 req-073663de-ce4b-46c6-997f-4b27cbd9f88c service nova] Creating event network-changed:bebb1bd2-6980-4bbb-a08e-ca30b1d8aac9 for instance 7554da88-1726-438a-bed5-4e30d999ba9d on hv-cinder-81561 Nov 01 01:22:24.265229 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [req-910e8a57-99f9-4643-9437-b91c562050e9 req-073663de-ce4b-46c6-997f-4b27cbd9f88c service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031373 Nov 01 01:22:24.265814 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 286/621] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Nov 1 01:22:24 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:22:24.604240 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-ff61106e-5f7a-441a-b9c6-84104d3fd70d tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:22:24.604870 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-ff61106e-5f7a-441a-b9c6-84104d3fd70d tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:22:24.612628 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ff61106e-5f7a-441a-b9c6-84104d3fd70d tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:24.613489 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ff61106e-5f7a-441a-b9c6-84104d3fd70d tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:24.614250 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ff61106e-5f7a-441a-b9c6-84104d3fd70d tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:24.614747 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ff61106e-5f7a-441a-b9c6-84104d3fd70d tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:24.741218 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-ff61106e-5f7a-441a-b9c6-84104d3fd70d tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:22:24.749000 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-ff61106e-5f7a-441a-b9c6-84104d3fd70d tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1563 microversion: 2.1 time: 0.148514 Nov 01 01:22:24.749564 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 336/622] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:22:24 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1563 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:22:24.816663 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-d889d5dc-f8d8-4657-9c18-bb41c889d4fb tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:22:24.817190 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-d889d5dc-f8d8-4657-9c18-bb41c889d4fb tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:22:24.823007 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d889d5dc-f8d8-4657-9c18-bb41c889d4fb tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:24.823451 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d889d5dc-f8d8-4657-9c18-bb41c889d4fb tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:24.824209 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d889d5dc-f8d8-4657-9c18-bb41c889d4fb tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:24.824640 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d889d5dc-f8d8-4657-9c18-bb41c889d4fb tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:24.831808 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-02e30888-21dc-45f0-88f2-f566e5ef081d tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:22:24.832704 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-02e30888-21dc-45f0-88f2-f566e5ef081d tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] [instance: 947fe830-e3f1-4dcc-81ab-fd177af6c35f] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:22:24.838723 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-02e30888-21dc-45f0-88f2-f566e5ef081d tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:24.839370 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-02e30888-21dc-45f0-88f2-f566e5ef081d tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:24.840319 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-02e30888-21dc-45f0-88f2-f566e5ef081d tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:24.840764 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-02e30888-21dc-45f0-88f2-f566e5ef081d tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:24.957615 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.objects.instance [None req-d889d5dc-f8d8-4657-9c18-bb41c889d4fb tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lazy-loading 'services' on Instance uuid f02098be-ed15-45a0-a599-941cb0e1eebb {{(pid=116267) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 01 01:22:24.966646 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-02e30888-21dc-45f0-88f2-f566e5ef081d tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec98ca6057d54c8caeac35ed360d8765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd454283e656c405f88ecb0b2ed70760a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:22:24.974901 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-02e30888-21dc-45f0-88f2-f566e5ef081d tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] 10.222.0.47 "GET /compute/v2.1/servers/947fe830-e3f1-4dcc-81ab-fd177af6c35f" status: 200 len: 1357 microversion: 2.1 time: 0.147493 Nov 01 01:22:24.975592 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 337/623] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:22:24 2021] GET /compute/v2.1/servers/947fe830-e3f1-4dcc-81ab-fd177af6c35f => generated 1357 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:22:24.980144 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-9a45083a-f721-4e6c-930c-d9bc529ea86a tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:22:24.983400 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-9a45083a-f721-4e6c-930c-d9bc529ea86a tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:22:24.987830 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9a45083a-f721-4e6c-930c-d9bc529ea86a tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:24.989386 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9a45083a-f721-4e6c-930c-d9bc529ea86a tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:24.990260 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9a45083a-f721-4e6c-930c-d9bc529ea86a tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:24.990817 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9a45083a-f721-4e6c-930c-d9bc529ea86a tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:25.123293 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-9a45083a-f721-4e6c-930c-d9bc529ea86a tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:22:25.131290 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-9a45083a-f721-4e6c-930c-d9bc529ea86a tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1271 microversion: 2.1 time: 0.154495 Nov 01 01:22:25.137876 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 338/624] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:22:24 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1271 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:22:25.368820 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-d889d5dc-f8d8-4657-9c18-bb41c889d4fb tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "DELETE /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments/527828b0-9121-4b41-b5b3-d25799e058da" status: 202 len: 0 microversion: 2.1 time: 0.556550 Nov 01 01:22:25.369764 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 287/625] 10.222.0.47 () {58 vars in 1415 bytes} [Mon Nov 1 01:22:24 2021] DELETE /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments/527828b0-9121-4b41-b5b3-d25799e058da => generated 0 bytes in 559 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 01 01:22:25.378863 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-2081a70e-0f7b-479f-8d0f-fedb9ae598ee tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:22:25.379838 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-2081a70e-0f7b-479f-8d0f-fedb9ae598ee tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:22:25.385618 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2081a70e-0f7b-479f-8d0f-fedb9ae598ee tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:25.386057 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2081a70e-0f7b-479f-8d0f-fedb9ae598ee tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:25.386831 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2081a70e-0f7b-479f-8d0f-fedb9ae598ee tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:25.387251 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2081a70e-0f7b-479f-8d0f-fedb9ae598ee tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:25.415561 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-2081a70e-0f7b-479f-8d0f-fedb9ae598ee tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041461 Nov 01 01:22:25.416131 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 339/626] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:22:25 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:22:25.709083 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-a04584b1-96f2-4099-95f2-976989646447 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1849665457", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-36728570", "security_groups": [{"name": "tempest-secgroup-smoke-140683370"}], "block_device_mapping_v2": [{"uuid": "567f0724-1edc-4d66-a054-d620a418ed70", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "7c3771fd-9770-4df3-925d-1736d53d869e"}]}} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:22:25.806725 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.network.neutron [None req-a04584b1-96f2-4099-95f2-976989646447 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] validate_networks() for [('7c3771fd-9770-4df3-925d-1736d53d869e', None, None, None, None, None)] {{(pid=116267) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Nov 01 01:22:25.991949 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-647a07b6-b708-4e37-9838-d0ecba5436c4 tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:22:25.992558 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-647a07b6-b708-4e37-9838-d0ecba5436c4 tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] [instance: 947fe830-e3f1-4dcc-81ab-fd177af6c35f] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:22:25.998850 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-647a07b6-b708-4e37-9838-d0ecba5436c4 tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:26.006877 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-647a07b6-b708-4e37-9838-d0ecba5436c4 tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:26.006877 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-647a07b6-b708-4e37-9838-d0ecba5436c4 tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:26.006877 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-647a07b6-b708-4e37-9838-d0ecba5436c4 tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:26.198925 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-647a07b6-b708-4e37-9838-d0ecba5436c4 tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec98ca6057d54c8caeac35ed360d8765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd454283e656c405f88ecb0b2ed70760a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:22:26.205972 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-647a07b6-b708-4e37-9838-d0ecba5436c4 tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] 10.222.0.47 "GET /compute/v2.1/servers/947fe830-e3f1-4dcc-81ab-fd177af6c35f" status: 200 len: 1357 microversion: 2.1 time: 0.217966 Nov 01 01:22:26.206560 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 340/627] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:22:25 2021] GET /compute/v2.1/servers/947fe830-e3f1-4dcc-81ab-fd177af6c35f => generated 1357 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:22:26.210712 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-c2fef91e-7f2d-4770-b459-18cd495c2292 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:22:26.211305 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-c2fef91e-7f2d-4770-b459-18cd495c2292 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:22:26.216606 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c2fef91e-7f2d-4770-b459-18cd495c2292 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:26.217041 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c2fef91e-7f2d-4770-b459-18cd495c2292 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:26.217790 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c2fef91e-7f2d-4770-b459-18cd495c2292 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:26.218217 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c2fef91e-7f2d-4770-b459-18cd495c2292 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:26.305874 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.virt.hardware [None req-a04584b1-96f2-4099-95f2-976989646447 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Flavor limits 0:0:0 {{(pid=116267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 01 01:22:26.306360 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.virt.hardware [None req-a04584b1-96f2-4099-95f2-976989646447 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Image limits 0:0:0 {{(pid=116267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 01 01:22:26.306884 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.virt.hardware [None req-a04584b1-96f2-4099-95f2-976989646447 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Flavor pref 0:0:0 {{(pid=116267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 01 01:22:26.307213 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.virt.hardware [None req-a04584b1-96f2-4099-95f2-976989646447 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Image pref 0:0:0 {{(pid=116267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 01 01:22:26.307621 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.virt.hardware [None req-a04584b1-96f2-4099-95f2-976989646447 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 01 01:22:26.322546 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a04584b1-96f2-4099-95f2-976989646447 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:26.323003 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a04584b1-96f2-4099-95f2-976989646447 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:26.323867 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a04584b1-96f2-4099-95f2-976989646447 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:26.324297 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a04584b1-96f2-4099-95f2-976989646447 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:26.345617 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.quota [None req-a04584b1-96f2-4099-95f2-976989646447 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Getting quotas for project c5ca84d6acd44f8d92713d50ac2e825a. Resources: {'instances', 'cores', 'ram'} {{(pid=116267) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 01 01:22:26.345617 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.quota [None req-a04584b1-96f2-4099-95f2-976989646447 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Getting quotas for user 4897556a37d144428d3b385a5859d724 and project c5ca84d6acd44f8d92713d50ac2e825a. Resources: {'instances', 'cores', 'ram'} {{(pid=116267) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 01 01:22:26.366296 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-c2fef91e-7f2d-4770-b459-18cd495c2292 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:22:26.373745 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-c2fef91e-7f2d-4770-b459-18cd495c2292 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1271 microversion: 2.1 time: 0.166227 Nov 01 01:22:26.374311 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 341/628] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:22:26 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1271 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:22:26.404679 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-a04584b1-96f2-4099-95f2-976989646447 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Going to run 1 instances... {{(pid=116267) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 01 01:22:26.406940 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-a04584b1-96f2-4099-95f2-976989646447 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='567f0724-1edc-4d66-a054-d620a418ed70',volume_size=None,volume_type=None)] {{(pid=116267) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 01 01:22:26.427827 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-de56d1c4-41a0-4e62-9df2-62d49510bcc5 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:22:26.428449 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-de56d1c4-41a0-4e62-9df2-62d49510bcc5 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:22:26.434076 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-de56d1c4-41a0-4e62-9df2-62d49510bcc5 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:26.434544 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-de56d1c4-41a0-4e62-9df2-62d49510bcc5 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:26.435307 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-de56d1c4-41a0-4e62-9df2-62d49510bcc5 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:26.435732 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-de56d1c4-41a0-4e62-9df2-62d49510bcc5 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:26.464445 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-de56d1c4-41a0-4e62-9df2-62d49510bcc5 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041208 Nov 01 01:22:26.464989 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 342/629] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:22:26 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 01 01:22:26.804355 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-a04584b1-96f2-4099-95f2-976989646447 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.099693 Nov 01 01:22:26.810161 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 288/630] 10.222.0.47 () {60 vars in 1146 bytes} [Mon Nov 1 01:22:25 2021] POST /compute/v2.1/servers => generated 405 bytes in 1101 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 01 01:22:26.815636 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-6da45b3e-92c3-4846-8c06-14b08490b417 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:22:26.819344 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-6da45b3e-92c3-4846-8c06-14b08490b417 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:22:26.870201 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-6da45b3e-92c3-4846-8c06-14b08490b417 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:22:26.877597 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-6da45b3e-92c3-4846-8c06-14b08490b417 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1093 microversion: 2.1 time: 0.066231 Nov 01 01:22:26.878237 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 343/631] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:22:26 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1093 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:22:27.222257 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-450e14b0-e312-4d8a-a828-c26d591698af tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:22:27.222869 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-450e14b0-e312-4d8a-a828-c26d591698af tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] [instance: 947fe830-e3f1-4dcc-81ab-fd177af6c35f] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:22:27.230086 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-450e14b0-e312-4d8a-a828-c26d591698af tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:27.230565 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-450e14b0-e312-4d8a-a828-c26d591698af tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:27.231328 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-450e14b0-e312-4d8a-a828-c26d591698af tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:27.231754 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-450e14b0-e312-4d8a-a828-c26d591698af tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:27.352009 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-450e14b0-e312-4d8a-a828-c26d591698af tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec98ca6057d54c8caeac35ed360d8765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd454283e656c405f88ecb0b2ed70760a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:22:27.359956 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-450e14b0-e312-4d8a-a828-c26d591698af tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] 10.222.0.47 "GET /compute/v2.1/servers/947fe830-e3f1-4dcc-81ab-fd177af6c35f" status: 200 len: 1357 microversion: 2.1 time: 0.141397 Nov 01 01:22:27.360584 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 289/632] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:22:27 2021] GET /compute/v2.1/servers/947fe830-e3f1-4dcc-81ab-fd177af6c35f => generated 1357 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:22:27.390744 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-048854a9-65b0-4880-b7fb-6ea826ae529c tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:22:27.391344 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-048854a9-65b0-4880-b7fb-6ea826ae529c tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:22:27.397608 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-048854a9-65b0-4880-b7fb-6ea826ae529c tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:27.398049 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-048854a9-65b0-4880-b7fb-6ea826ae529c tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:27.398838 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-048854a9-65b0-4880-b7fb-6ea826ae529c tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:27.399263 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-048854a9-65b0-4880-b7fb-6ea826ae529c tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:27.476605 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-8294b534-3123-4511-b21e-24fb39559590 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:22:27.477658 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-8294b534-3123-4511-b21e-24fb39559590 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:22:27.483780 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8294b534-3123-4511-b21e-24fb39559590 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:27.484217 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8294b534-3123-4511-b21e-24fb39559590 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:27.484988 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8294b534-3123-4511-b21e-24fb39559590 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:27.485410 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8294b534-3123-4511-b21e-24fb39559590 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:27.515549 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-8294b534-3123-4511-b21e-24fb39559590 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042683 Nov 01 01:22:27.516097 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 290/633] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:22:27 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 01 01:22:27.519637 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-048854a9-65b0-4880-b7fb-6ea826ae529c tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:22:27.527001 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-048854a9-65b0-4880-b7fb-6ea826ae529c tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1271 microversion: 2.1 time: 0.139865 Nov 01 01:22:27.531920 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 344/634] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:22:27 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1271 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:22:27.894062 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-daae0caf-0c75-4781-b4fa-05affa99d009 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:22:27.894695 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-daae0caf-0c75-4781-b4fa-05affa99d009 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:22:27.949000 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-daae0caf-0c75-4781-b4fa-05affa99d009 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:22:27.955540 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-daae0caf-0c75-4781-b4fa-05affa99d009 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1093 microversion: 2.1 time: 0.065192 Nov 01 01:22:27.956100 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 291/635] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:22:27 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1093 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:22:28.377159 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-79a7ceb4-a09c-49f8-b1dd-28c4d1639dfa tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:22:28.377842 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-79a7ceb4-a09c-49f8-b1dd-28c4d1639dfa tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] [instance: 947fe830-e3f1-4dcc-81ab-fd177af6c35f] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:22:28.384157 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-79a7ceb4-a09c-49f8-b1dd-28c4d1639dfa tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:28.384737 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-79a7ceb4-a09c-49f8-b1dd-28c4d1639dfa tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:28.385489 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-79a7ceb4-a09c-49f8-b1dd-28c4d1639dfa tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:28.385910 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-79a7ceb4-a09c-49f8-b1dd-28c4d1639dfa tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:28.505583 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-79a7ceb4-a09c-49f8-b1dd-28c4d1639dfa tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec98ca6057d54c8caeac35ed360d8765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd454283e656c405f88ecb0b2ed70760a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:22:28.512722 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-79a7ceb4-a09c-49f8-b1dd-28c4d1639dfa tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] 10.222.0.47 "GET /compute/v2.1/servers/947fe830-e3f1-4dcc-81ab-fd177af6c35f" status: 200 len: 1357 microversion: 2.1 time: 0.139663 Nov 01 01:22:28.513269 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 345/636] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:22:28 2021] GET /compute/v2.1/servers/947fe830-e3f1-4dcc-81ab-fd177af6c35f => generated 1357 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:22:28.527314 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-406ea9f0-365e-4794-a722-3cd20c797602 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:22:28.528227 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-406ea9f0-365e-4794-a722-3cd20c797602 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:22:28.535215 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-406ea9f0-365e-4794-a722-3cd20c797602 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:28.535664 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-406ea9f0-365e-4794-a722-3cd20c797602 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:28.540133 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-406ea9f0-365e-4794-a722-3cd20c797602 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:28.540133 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-406ea9f0-365e-4794-a722-3cd20c797602 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:28.545949 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-75e1fcc1-5025-4cd0-9ef2-836457fbf1fb tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:22:28.546590 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-75e1fcc1-5025-4cd0-9ef2-836457fbf1fb tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:22:28.552810 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-75e1fcc1-5025-4cd0-9ef2-836457fbf1fb tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:28.553254 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-75e1fcc1-5025-4cd0-9ef2-836457fbf1fb tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:28.554017 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-75e1fcc1-5025-4cd0-9ef2-836457fbf1fb tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:28.554469 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-75e1fcc1-5025-4cd0-9ef2-836457fbf1fb tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:28.566508 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-406ea9f0-365e-4794-a722-3cd20c797602 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042819 Nov 01 01:22:28.567267 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 292/637] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:22:28 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:22:28.672345 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-75e1fcc1-5025-4cd0-9ef2-836457fbf1fb tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:22:28.683555 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-75e1fcc1-5025-4cd0-9ef2-836457fbf1fb tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1271 microversion: 2.1 time: 0.141067 Nov 01 01:22:28.684128 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 346/638] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:22:28 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1271 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:22:28.972805 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-8ab40f43-62ee-4cfd-a712-bc6428911d66 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:22:28.973415 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-8ab40f43-62ee-4cfd-a712-bc6428911d66 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:22:28.979212 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8ab40f43-62ee-4cfd-a712-bc6428911d66 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:28.979660 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8ab40f43-62ee-4cfd-a712-bc6428911d66 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:28.980420 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8ab40f43-62ee-4cfd-a712-bc6428911d66 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:28.980849 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8ab40f43-62ee-4cfd-a712-bc6428911d66 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:29.039094 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-8ab40f43-62ee-4cfd-a712-bc6428911d66 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:22:29.046785 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-8ab40f43-62ee-4cfd-a712-bc6428911d66 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1191 microversion: 2.1 time: 0.078155 Nov 01 01:22:29.047348 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 293/639] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:22:28 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1191 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:22:29.530103 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-b607aa24-113a-4bb8-adf6-9bbd1fb6a341 tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:22:29.530841 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-b607aa24-113a-4bb8-adf6-9bbd1fb6a341 tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] [instance: 947fe830-e3f1-4dcc-81ab-fd177af6c35f] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:22:29.537853 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b607aa24-113a-4bb8-adf6-9bbd1fb6a341 tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:29.538497 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b607aa24-113a-4bb8-adf6-9bbd1fb6a341 tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:29.539278 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b607aa24-113a-4bb8-adf6-9bbd1fb6a341 tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:29.539714 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b607aa24-113a-4bb8-adf6-9bbd1fb6a341 tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:29.577374 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-76e97629-22b9-47c7-9e8c-e12246b6575f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:22:29.578283 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-76e97629-22b9-47c7-9e8c-e12246b6575f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:22:29.585240 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-76e97629-22b9-47c7-9e8c-e12246b6575f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:29.585692 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-76e97629-22b9-47c7-9e8c-e12246b6575f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:29.586493 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-76e97629-22b9-47c7-9e8c-e12246b6575f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:29.586926 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-76e97629-22b9-47c7-9e8c-e12246b6575f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:29.619836 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-76e97629-22b9-47c7-9e8c-e12246b6575f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046087 Nov 01 01:22:29.620409 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 294/640] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:22:29 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 01 01:22:29.678189 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-b607aa24-113a-4bb8-adf6-9bbd1fb6a341 tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec98ca6057d54c8caeac35ed360d8765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd454283e656c405f88ecb0b2ed70760a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:22:29.685504 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-b607aa24-113a-4bb8-adf6-9bbd1fb6a341 tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] 10.222.0.47 "GET /compute/v2.1/servers/947fe830-e3f1-4dcc-81ab-fd177af6c35f" status: 200 len: 1357 microversion: 2.1 time: 0.159789 Nov 01 01:22:29.686067 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 347/641] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:22:29 2021] GET /compute/v2.1/servers/947fe830-e3f1-4dcc-81ab-fd177af6c35f => generated 1357 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:22:29.700447 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-7ede3c85-c8d1-4bc7-adaa-5d0a972487e1 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:22:29.701057 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-7ede3c85-c8d1-4bc7-adaa-5d0a972487e1 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:22:29.707708 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-7ede3c85-c8d1-4bc7-adaa-5d0a972487e1 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:29.708160 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-7ede3c85-c8d1-4bc7-adaa-5d0a972487e1 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:29.708924 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-7ede3c85-c8d1-4bc7-adaa-5d0a972487e1 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:29.709375 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-7ede3c85-c8d1-4bc7-adaa-5d0a972487e1 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:29.831583 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-7ede3c85-c8d1-4bc7-adaa-5d0a972487e1 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:22:29.839036 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-7ede3c85-c8d1-4bc7-adaa-5d0a972487e1 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1271 microversion: 2.1 time: 0.142184 Nov 01 01:22:29.848650 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 295/642] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:22:29 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1271 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:22:30.064281 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-c130b49b-f4b4-4124-acc8-1eb0765bab53 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:22:30.065256 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-c130b49b-f4b4-4124-acc8-1eb0765bab53 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:22:30.072210 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c130b49b-f4b4-4124-acc8-1eb0765bab53 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:30.072729 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c130b49b-f4b4-4124-acc8-1eb0765bab53 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:30.073581 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c130b49b-f4b4-4124-acc8-1eb0765bab53 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:30.074003 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c130b49b-f4b4-4124-acc8-1eb0765bab53 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:30.135545 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-c130b49b-f4b4-4124-acc8-1eb0765bab53 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:22:30.143827 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-c130b49b-f4b4-4124-acc8-1eb0765bab53 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1209 microversion: 2.1 time: 0.083223 Nov 01 01:22:30.144425 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 348/643] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:22:30 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1209 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:22:30.160928 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [req-8768aeb6-2bb8-4b93-9883-c0a42153b5d0 req-c2b56c1e-9730-4857-8a54-826c969d8cae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "947fe830-e3f1-4dcc-81ab-fd177af6c35f", "name": "network-vif-plugged", "status": "completed", "tag": "dcc542d2-302c-4d52-bd3e-404d021f3507"}]} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:22:30.162555 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 01 01:22:30.162555 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: warnings.warn(msg) Nov 01 01:22:30.169157 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [req-8768aeb6-2bb8-4b93-9883-c0a42153b5d0 req-c2b56c1e-9730-4857-8a54-826c969d8cae service nova] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:30.169619 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [req-8768aeb6-2bb8-4b93-9883-c0a42153b5d0 req-c2b56c1e-9730-4857-8a54-826c969d8cae service nova] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:30.182254 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.compute.server_external_events [req-8768aeb6-2bb8-4b93-9883-c0a42153b5d0 req-c2b56c1e-9730-4857-8a54-826c969d8cae service nova] Creating event network-vif-plugged:dcc542d2-302c-4d52-bd3e-404d021f3507 for instance 947fe830-e3f1-4dcc-81ab-fd177af6c35f on hv-cinder-81561 Nov 01 01:22:30.187340 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [req-8768aeb6-2bb8-4b93-9883-c0a42153b5d0 req-c2b56c1e-9730-4857-8a54-826c969d8cae service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030667 Nov 01 01:22:30.188168 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 296/644] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Nov 1 01:22:30 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:22:30.631832 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-ddeff498-20d7-4eee-8f8b-e8aca4424e75 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:22:30.632887 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-ddeff498-20d7-4eee-8f8b-e8aca4424e75 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:22:30.639239 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ddeff498-20d7-4eee-8f8b-e8aca4424e75 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:30.642558 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ddeff498-20d7-4eee-8f8b-e8aca4424e75 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:30.642558 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ddeff498-20d7-4eee-8f8b-e8aca4424e75 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:30.642558 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ddeff498-20d7-4eee-8f8b-e8aca4424e75 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:30.675343 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-ddeff498-20d7-4eee-8f8b-e8aca4424e75 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047318 Nov 01 01:22:30.676308 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 349/645] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:22:30 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:22:30.702609 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-af14307f-21e4-47b9-8062-17ac9d013aa7 tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:22:30.703457 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-af14307f-21e4-47b9-8062-17ac9d013aa7 tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] [instance: 947fe830-e3f1-4dcc-81ab-fd177af6c35f] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:22:30.710572 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-af14307f-21e4-47b9-8062-17ac9d013aa7 tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:30.711398 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-af14307f-21e4-47b9-8062-17ac9d013aa7 tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:30.712034 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-af14307f-21e4-47b9-8062-17ac9d013aa7 tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:30.712461 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-af14307f-21e4-47b9-8062-17ac9d013aa7 tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:30.847402 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-af14307f-21e4-47b9-8062-17ac9d013aa7 tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec98ca6057d54c8caeac35ed360d8765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd454283e656c405f88ecb0b2ed70760a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:22:30.855811 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-ff21c91d-28fd-4de7-9b22-26570e26937e tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:22:30.856181 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-af14307f-21e4-47b9-8062-17ac9d013aa7 tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] 10.222.0.47 "GET /compute/v2.1/servers/947fe830-e3f1-4dcc-81ab-fd177af6c35f" status: 200 len: 1357 microversion: 2.1 time: 0.157588 Nov 01 01:22:30.856413 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-ff21c91d-28fd-4de7-9b22-26570e26937e tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:22:30.857095 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 297/646] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:22:30 2021] GET /compute/v2.1/servers/947fe830-e3f1-4dcc-81ab-fd177af6c35f => generated 1357 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:22:30.863287 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ff21c91d-28fd-4de7-9b22-26570e26937e tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:30.863735 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ff21c91d-28fd-4de7-9b22-26570e26937e tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:30.864497 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ff21c91d-28fd-4de7-9b22-26570e26937e tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:30.864955 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ff21c91d-28fd-4de7-9b22-26570e26937e tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:30.989266 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-ff21c91d-28fd-4de7-9b22-26570e26937e tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:22:30.996655 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-ff21c91d-28fd-4de7-9b22-26570e26937e tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1271 microversion: 2.1 time: 0.144669 Nov 01 01:22:30.997213 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 350/647] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:22:30 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1271 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:22:31.161252 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-0cc4ac42-a073-418f-a7cb-77332aee1108 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:22:31.161892 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-0cc4ac42-a073-418f-a7cb-77332aee1108 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:22:31.167699 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0cc4ac42-a073-418f-a7cb-77332aee1108 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:31.168124 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0cc4ac42-a073-418f-a7cb-77332aee1108 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:31.168883 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0cc4ac42-a073-418f-a7cb-77332aee1108 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:31.169313 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0cc4ac42-a073-418f-a7cb-77332aee1108 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:31.314625 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-0cc4ac42-a073-418f-a7cb-77332aee1108 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:22:31.322350 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-0cc4ac42-a073-418f-a7cb-77332aee1108 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.165142 Nov 01 01:22:31.332001 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 298/648] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:22:31 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:22:31.503997 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [req-fa9d6615-8884-4b62-bf3f-5126ce7f183d req-c9961d75-cde7-41d1-b308-a7ba42f034f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "330dc645-b56f-4c45-8a1b-7535494ce136", "tag": "64c69a07-6eee-4d10-bcdf-91cd955820d9"}]} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:22:31.505864 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 01 01:22:31.505864 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: warnings.warn(msg) Nov 01 01:22:31.512654 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [req-fa9d6615-8884-4b62-bf3f-5126ce7f183d req-c9961d75-cde7-41d1-b308-a7ba42f034f3 service nova] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:31.512825 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [req-fa9d6615-8884-4b62-bf3f-5126ce7f183d req-c9961d75-cde7-41d1-b308-a7ba42f034f3 service nova] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:31.528974 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.compute.server_external_events [req-fa9d6615-8884-4b62-bf3f-5126ce7f183d req-c9961d75-cde7-41d1-b308-a7ba42f034f3 service nova] Creating event network-changed:64c69a07-6eee-4d10-bcdf-91cd955820d9 for instance 330dc645-b56f-4c45-8a1b-7535494ce136 on hv-cinder-81561 Nov 01 01:22:31.534500 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [req-fa9d6615-8884-4b62-bf3f-5126ce7f183d req-c9961d75-cde7-41d1-b308-a7ba42f034f3 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034259 Nov 01 01:22:31.535208 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 351/649] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Nov 1 01:22:31 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:22:31.686118 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-b0ceb2a3-5ba6-4c28-b541-17e1a2b72945 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:22:31.687138 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-b0ceb2a3-5ba6-4c28-b541-17e1a2b72945 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:22:31.692938 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b0ceb2a3-5ba6-4c28-b541-17e1a2b72945 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:31.693376 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b0ceb2a3-5ba6-4c28-b541-17e1a2b72945 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:31.694126 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b0ceb2a3-5ba6-4c28-b541-17e1a2b72945 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:31.694573 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b0ceb2a3-5ba6-4c28-b541-17e1a2b72945 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:31.729457 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-b0ceb2a3-5ba6-4c28-b541-17e1a2b72945 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042150 Nov 01 01:22:31.729457 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 299/650] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:22:31 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:22:31.874510 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-5ca36d68-cd3f-4770-8344-a065e114ef23 tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:22:31.875142 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-5ca36d68-cd3f-4770-8344-a065e114ef23 tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] [instance: 947fe830-e3f1-4dcc-81ab-fd177af6c35f] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:22:31.881704 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5ca36d68-cd3f-4770-8344-a065e114ef23 tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:31.882140 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5ca36d68-cd3f-4770-8344-a065e114ef23 tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:31.882952 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5ca36d68-cd3f-4770-8344-a065e114ef23 tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:31.883377 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5ca36d68-cd3f-4770-8344-a065e114ef23 tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:32.005339 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-5ca36d68-cd3f-4770-8344-a065e114ef23 tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec98ca6057d54c8caeac35ed360d8765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd454283e656c405f88ecb0b2ed70760a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:22:32.012807 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-a74b5776-a132-42c5-adc6-75ff5c092014 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:22:32.013265 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-5ca36d68-cd3f-4770-8344-a065e114ef23 tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] 10.222.0.47 "GET /compute/v2.1/servers/947fe830-e3f1-4dcc-81ab-fd177af6c35f" status: 200 len: 1357 microversion: 2.1 time: 0.143128 Nov 01 01:22:32.013399 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-a74b5776-a132-42c5-adc6-75ff5c092014 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:22:32.014049 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 352/651] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:22:31 2021] GET /compute/v2.1/servers/947fe830-e3f1-4dcc-81ab-fd177af6c35f => generated 1357 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:22:32.023719 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a74b5776-a132-42c5-adc6-75ff5c092014 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:32.024103 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a74b5776-a132-42c5-adc6-75ff5c092014 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:32.024877 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a74b5776-a132-42c5-adc6-75ff5c092014 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:32.025307 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a74b5776-a132-42c5-adc6-75ff5c092014 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:32.146551 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-a74b5776-a132-42c5-adc6-75ff5c092014 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:22:32.153908 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-a74b5776-a132-42c5-adc6-75ff5c092014 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1259 microversion: 2.1 time: 0.144766 Nov 01 01:22:32.163140 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 300/652] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:22:32 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1259 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:22:32.339306 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-bbd240ec-0a68-490a-8946-cc3bf76d43b4 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:22:32.339909 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-bbd240ec-0a68-490a-8946-cc3bf76d43b4 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:22:32.347508 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-bbd240ec-0a68-490a-8946-cc3bf76d43b4 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:32.347958 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-bbd240ec-0a68-490a-8946-cc3bf76d43b4 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:32.348740 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-bbd240ec-0a68-490a-8946-cc3bf76d43b4 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:32.349174 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-bbd240ec-0a68-490a-8946-cc3bf76d43b4 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:32.472438 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-bbd240ec-0a68-490a-8946-cc3bf76d43b4 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:22:32.479718 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-bbd240ec-0a68-490a-8946-cc3bf76d43b4 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.144099 Nov 01 01:22:32.480275 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 353/653] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:22:32 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:22:32.736079 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-e9b8113e-2b05-4a88-b706-af39eaca18ab tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:22:32.737593 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-e9b8113e-2b05-4a88-b706-af39eaca18ab tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:22:32.744110 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e9b8113e-2b05-4a88-b706-af39eaca18ab tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:32.744550 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e9b8113e-2b05-4a88-b706-af39eaca18ab tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:32.745313 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e9b8113e-2b05-4a88-b706-af39eaca18ab tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:32.745745 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e9b8113e-2b05-4a88-b706-af39eaca18ab tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:32.774690 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-e9b8113e-2b05-4a88-b706-af39eaca18ab tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042361 Nov 01 01:22:32.775230 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 301/654] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:22:32 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:22:33.030616 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-a4554d58-b71a-4007-8378-d34eddb6a33e tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:22:33.031225 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-a4554d58-b71a-4007-8378-d34eddb6a33e tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] [instance: 947fe830-e3f1-4dcc-81ab-fd177af6c35f] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:22:33.038143 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a4554d58-b71a-4007-8378-d34eddb6a33e tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:33.038625 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a4554d58-b71a-4007-8378-d34eddb6a33e tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:33.039399 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a4554d58-b71a-4007-8378-d34eddb6a33e tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:33.039832 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a4554d58-b71a-4007-8378-d34eddb6a33e tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:33.156482 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-a4554d58-b71a-4007-8378-d34eddb6a33e tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec98ca6057d54c8caeac35ed360d8765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd454283e656c405f88ecb0b2ed70760a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:22:33.164360 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-a4554d58-b71a-4007-8378-d34eddb6a33e tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] 10.222.0.47 "GET /compute/v2.1/servers/947fe830-e3f1-4dcc-81ab-fd177af6c35f" status: 200 len: 1548 microversion: 2.1 time: 0.137327 Nov 01 01:22:33.164927 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 354/655] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:22:33 2021] GET /compute/v2.1/servers/947fe830-e3f1-4dcc-81ab-fd177af6c35f => generated 1548 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:22:33.170371 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-59004ab5-785f-47d1-a93d-3a4eb72edad4 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:22:33.171022 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-59004ab5-785f-47d1-a93d-3a4eb72edad4 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:22:33.176698 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-59004ab5-785f-47d1-a93d-3a4eb72edad4 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:33.177136 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-59004ab5-785f-47d1-a93d-3a4eb72edad4 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:33.177880 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-59004ab5-785f-47d1-a93d-3a4eb72edad4 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:33.178301 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-59004ab5-785f-47d1-a93d-3a4eb72edad4 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:33.179571 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-93889867-6a2f-42a5-8155-9fbc0619434c tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:22:33.180202 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-93889867-6a2f-42a5-8155-9fbc0619434c tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] [instance: 947fe830-e3f1-4dcc-81ab-fd177af6c35f] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:22:33.185858 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-93889867-6a2f-42a5-8155-9fbc0619434c tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:33.186305 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-93889867-6a2f-42a5-8155-9fbc0619434c tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:33.187102 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-93889867-6a2f-42a5-8155-9fbc0619434c tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:33.187535 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-93889867-6a2f-42a5-8155-9fbc0619434c tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:33.351929 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-59004ab5-785f-47d1-a93d-3a4eb72edad4 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:22:33.357010 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-93889867-6a2f-42a5-8155-9fbc0619434c tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec98ca6057d54c8caeac35ed360d8765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd454283e656c405f88ecb0b2ed70760a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:22:33.359617 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-59004ab5-785f-47d1-a93d-3a4eb72edad4 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1259 microversion: 2.1 time: 0.192765 Nov 01 01:22:33.360191 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 302/656] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:22:33 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1259 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:22:33.364617 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-93889867-6a2f-42a5-8155-9fbc0619434c tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] 10.222.0.47 "GET /compute/v2.1/servers/947fe830-e3f1-4dcc-81ab-fd177af6c35f" status: 200 len: 1548 microversion: 2.1 time: 0.188508 Nov 01 01:22:33.365555 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 355/657] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:22:33 2021] GET /compute/v2.1/servers/947fe830-e3f1-4dcc-81ab-fd177af6c35f => generated 1548 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:22:33.380602 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-40096402-ff30-453d-aeb2-ee1255083fbd tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:22:33.383921 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 01 01:22:33.383921 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: warnings.warn(msg) Nov 01 01:22:33.384913 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-40096402-ff30-453d-aeb2-ee1255083fbd tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ec98ca6057d54c8caeac35ed360d8765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd454283e656c405f88ecb0b2ed70760a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:22:33.385568 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-40096402-ff30-453d-aeb2-ee1255083fbd tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Searching by: {'deleted': False, 'project_id': 'd454283e656c405f88ecb0b2ed70760a'} {{(pid=116267) get_all /opt/stack/nova/nova/compute/api.py:2905}} Nov 01 01:22:33.392127 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-40096402-ff30-453d-aeb2-ee1255083fbd tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:33.392564 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-40096402-ff30-453d-aeb2-ee1255083fbd tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:33.394025 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-40096402-ff30-453d-aeb2-ee1255083fbd tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:33.394473 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-40096402-ff30-453d-aeb2-ee1255083fbd tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:33.481287 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.multi_cell_list [None req-40096402-ff30-453d-aeb2-ee1255083fbd tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=116267) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:371}} Nov 01 01:22:33.496871 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-24db51b3-547e-4694-96eb-66833dd7c0d5 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:22:33.497522 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-24db51b3-547e-4694-96eb-66833dd7c0d5 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:22:33.503801 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-24db51b3-547e-4694-96eb-66833dd7c0d5 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:33.504241 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-24db51b3-547e-4694-96eb-66833dd7c0d5 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:33.504998 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-24db51b3-547e-4694-96eb-66833dd7c0d5 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:33.505422 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-24db51b3-547e-4694-96eb-66833dd7c0d5 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:33.576457 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-40096402-ff30-453d-aeb2-ee1255083fbd tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] 10.222.0.47 "GET /compute/v2.1/servers" status: 200 len: 341 microversion: 2.1 time: 0.199727 Nov 01 01:22:33.576967 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 303/658] 10.222.0.47 () {58 vars in 1124 bytes} [Mon Nov 1 01:22:33 2021] GET /compute/v2.1/servers => generated 341 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:22:33.586977 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-1d96c3ad-4603-41a5-8b39-be9b7bc8911e tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:22:33.587580 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-1d96c3ad-4603-41a5-8b39-be9b7bc8911e tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] [instance: 947fe830-e3f1-4dcc-81ab-fd177af6c35f] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:22:33.593370 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-1d96c3ad-4603-41a5-8b39-be9b7bc8911e tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:33.593813 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-1d96c3ad-4603-41a5-8b39-be9b7bc8911e tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:33.594609 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-1d96c3ad-4603-41a5-8b39-be9b7bc8911e tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:33.595046 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-1d96c3ad-4603-41a5-8b39-be9b7bc8911e tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:33.622663 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-24db51b3-547e-4694-96eb-66833dd7c0d5 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:22:33.630379 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-24db51b3-547e-4694-96eb-66833dd7c0d5 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.137133 Nov 01 01:22:33.630967 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 356/659] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:22:33 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:22:33.713592 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-1d96c3ad-4603-41a5-8b39-be9b7bc8911e tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec98ca6057d54c8caeac35ed360d8765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd454283e656c405f88ecb0b2ed70760a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:22:33.721225 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-1d96c3ad-4603-41a5-8b39-be9b7bc8911e tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] 10.222.0.47 "GET /compute/v2.1/servers/947fe830-e3f1-4dcc-81ab-fd177af6c35f" status: 200 len: 1548 microversion: 2.1 time: 0.137618 Nov 01 01:22:33.721795 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 304/660] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:22:33 2021] GET /compute/v2.1/servers/947fe830-e3f1-4dcc-81ab-fd177af6c35f => generated 1548 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:22:33.784945 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-36a595b1-9c76-4a26-8f8d-1427e49b75a0 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:22:33.785925 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-36a595b1-9c76-4a26-8f8d-1427e49b75a0 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:22:33.791880 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-36a595b1-9c76-4a26-8f8d-1427e49b75a0 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:33.792835 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-36a595b1-9c76-4a26-8f8d-1427e49b75a0 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:33.793139 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-36a595b1-9c76-4a26-8f8d-1427e49b75a0 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:33.793562 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-36a595b1-9c76-4a26-8f8d-1427e49b75a0 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:33.831356 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-36a595b1-9c76-4a26-8f8d-1427e49b75a0 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049980 Nov 01 01:22:33.832016 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 357/661] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:22:33 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:22:34.376050 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-a3c167b8-a0f9-4517-89d8-4a8deb58b9a8 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:22:34.376652 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-a3c167b8-a0f9-4517-89d8-4a8deb58b9a8 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:22:34.382913 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a3c167b8-a0f9-4517-89d8-4a8deb58b9a8 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:34.388470 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a3c167b8-a0f9-4517-89d8-4a8deb58b9a8 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:34.388470 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a3c167b8-a0f9-4517-89d8-4a8deb58b9a8 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:34.388470 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a3c167b8-a0f9-4517-89d8-4a8deb58b9a8 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:34.506752 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-a3c167b8-a0f9-4517-89d8-4a8deb58b9a8 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:22:34.513905 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-a3c167b8-a0f9-4517-89d8-4a8deb58b9a8 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1259 microversion: 2.1 time: 0.141551 Nov 01 01:22:34.514484 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 305/662] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:22:34 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1259 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:22:34.647089 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-a50daf56-5f57-478d-8f43-6faa0e09aa70 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:22:34.647755 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-a50daf56-5f57-478d-8f43-6faa0e09aa70 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:22:34.654001 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a50daf56-5f57-478d-8f43-6faa0e09aa70 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:34.654462 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a50daf56-5f57-478d-8f43-6faa0e09aa70 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:34.655216 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a50daf56-5f57-478d-8f43-6faa0e09aa70 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:34.655640 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a50daf56-5f57-478d-8f43-6faa0e09aa70 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:34.774288 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-a50daf56-5f57-478d-8f43-6faa0e09aa70 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:22:34.781486 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-a50daf56-5f57-478d-8f43-6faa0e09aa70 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.138621 Nov 01 01:22:34.782045 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 358/663] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:22:34 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:22:34.842786 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-adecbe63-e7fc-478f-b837-582e23416447 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:22:34.843726 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-adecbe63-e7fc-478f-b837-582e23416447 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:22:34.849454 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-adecbe63-e7fc-478f-b837-582e23416447 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:34.849893 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-adecbe63-e7fc-478f-b837-582e23416447 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:34.850686 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-adecbe63-e7fc-478f-b837-582e23416447 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:34.851143 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-adecbe63-e7fc-478f-b837-582e23416447 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:34.879562 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-adecbe63-e7fc-478f-b837-582e23416447 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040536 Nov 01 01:22:34.880105 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 306/664] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:22:34 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:22:35.532015 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-fc2c3264-66f2-4211-bf55-fb63fc64b062 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:22:35.532830 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-fc2c3264-66f2-4211-bf55-fb63fc64b062 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:22:35.538642 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-fc2c3264-66f2-4211-bf55-fb63fc64b062 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:35.539082 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-fc2c3264-66f2-4211-bf55-fb63fc64b062 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:35.539829 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-fc2c3264-66f2-4211-bf55-fb63fc64b062 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:35.540250 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-fc2c3264-66f2-4211-bf55-fb63fc64b062 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:35.656077 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-fc2c3264-66f2-4211-bf55-fb63fc64b062 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:22:35.664844 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-fc2c3264-66f2-4211-bf55-fb63fc64b062 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1259 microversion: 2.1 time: 0.136517 Nov 01 01:22:35.665397 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 359/665] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:22:35 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1259 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:22:35.798309 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-ce106d4f-878f-48e3-aa16-78bae432495e tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:22:35.798953 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-ce106d4f-878f-48e3-aa16-78bae432495e tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:22:35.806003 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ce106d4f-878f-48e3-aa16-78bae432495e tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:35.806472 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ce106d4f-878f-48e3-aa16-78bae432495e tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:35.807243 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ce106d4f-878f-48e3-aa16-78bae432495e tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:35.807670 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ce106d4f-878f-48e3-aa16-78bae432495e tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:35.891091 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-4adf38bb-de7f-4c57-96e5-2434a2ec7dcb tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:22:35.892083 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-4adf38bb-de7f-4c57-96e5-2434a2ec7dcb tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:22:35.898388 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4adf38bb-de7f-4c57-96e5-2434a2ec7dcb tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:35.898933 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4adf38bb-de7f-4c57-96e5-2434a2ec7dcb tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:35.899689 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4adf38bb-de7f-4c57-96e5-2434a2ec7dcb tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:35.900112 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4adf38bb-de7f-4c57-96e5-2434a2ec7dcb tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:35.928569 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-ce106d4f-878f-48e3-aa16-78bae432495e tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:22:35.929184 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-4adf38bb-de7f-4c57-96e5-2434a2ec7dcb tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041914 Nov 01 01:22:35.929745 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 360/666] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:22:35 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 01 01:22:35.936330 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-ce106d4f-878f-48e3-aa16-78bae432495e tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.141703 Nov 01 01:22:35.936891 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 307/667] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:22:35 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:22:36.686661 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-7e9e648b-dc9e-4f96-b48b-7ead25828088 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:22:36.687321 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-7e9e648b-dc9e-4f96-b48b-7ead25828088 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:22:36.694052 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7e9e648b-dc9e-4f96-b48b-7ead25828088 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:36.694520 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7e9e648b-dc9e-4f96-b48b-7ead25828088 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:36.695280 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7e9e648b-dc9e-4f96-b48b-7ead25828088 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:36.695706 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7e9e648b-dc9e-4f96-b48b-7ead25828088 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:36.811232 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-7e9e648b-dc9e-4f96-b48b-7ead25828088 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:22:36.819101 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-7e9e648b-dc9e-4f96-b48b-7ead25828088 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1259 microversion: 2.1 time: 0.135976 Nov 01 01:22:36.819670 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 361/668] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:22:36 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1259 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:22:36.940316 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-12fc8f03-33d9-462d-9464-cb751f0738c2 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:22:36.941191 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-12fc8f03-33d9-462d-9464-cb751f0738c2 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:22:36.948115 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-12fc8f03-33d9-462d-9464-cb751f0738c2 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:36.948561 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-12fc8f03-33d9-462d-9464-cb751f0738c2 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:36.949313 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-12fc8f03-33d9-462d-9464-cb751f0738c2 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:36.949741 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-12fc8f03-33d9-462d-9464-cb751f0738c2 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:36.952232 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-05f05a62-6c75-499a-b73a-6064b5823945 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:22:36.952841 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-05f05a62-6c75-499a-b73a-6064b5823945 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:22:36.958405 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-05f05a62-6c75-499a-b73a-6064b5823945 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:36.958875 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-05f05a62-6c75-499a-b73a-6064b5823945 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:36.959640 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-05f05a62-6c75-499a-b73a-6064b5823945 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:36.960068 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-05f05a62-6c75-499a-b73a-6064b5823945 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:36.981444 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-12fc8f03-33d9-462d-9464-cb751f0738c2 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044820 Nov 01 01:22:36.982004 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 308/669] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:22:36 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:22:37.077003 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-05f05a62-6c75-499a-b73a-6064b5823945 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:22:37.084254 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-05f05a62-6c75-499a-b73a-6064b5823945 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.135549 Nov 01 01:22:37.084809 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 362/670] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:22:36 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:22:37.839816 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-42d7f518-ebdb-4081-9b07-18855f9a418e tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:22:37.840427 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-42d7f518-ebdb-4081-9b07-18855f9a418e tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:22:37.846402 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-42d7f518-ebdb-4081-9b07-18855f9a418e tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:37.846869 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-42d7f518-ebdb-4081-9b07-18855f9a418e tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:37.847625 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-42d7f518-ebdb-4081-9b07-18855f9a418e tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:37.848053 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-42d7f518-ebdb-4081-9b07-18855f9a418e tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:37.967924 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-42d7f518-ebdb-4081-9b07-18855f9a418e tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:22:37.975073 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-42d7f518-ebdb-4081-9b07-18855f9a418e tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1259 microversion: 2.1 time: 0.138932 Nov 01 01:22:37.975622 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 309/671] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:22:37 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1259 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:22:37.992819 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-a5c74eff-c493-427e-9c52-720c15ac7981 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:22:37.993728 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-a5c74eff-c493-427e-9c52-720c15ac7981 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:22:37.999955 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a5c74eff-c493-427e-9c52-720c15ac7981 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:38.000402 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a5c74eff-c493-427e-9c52-720c15ac7981 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:38.001188 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a5c74eff-c493-427e-9c52-720c15ac7981 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:38.001615 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a5c74eff-c493-427e-9c52-720c15ac7981 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:38.031110 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-a5c74eff-c493-427e-9c52-720c15ac7981 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041953 Nov 01 01:22:38.032227 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 363/672] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:22:37 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:22:38.100850 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-d1e7c4c3-2468-400c-92c5-3bee2eeb622b tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:22:38.101525 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-d1e7c4c3-2468-400c-92c5-3bee2eeb622b tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:22:38.107231 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d1e7c4c3-2468-400c-92c5-3bee2eeb622b tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:38.107664 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d1e7c4c3-2468-400c-92c5-3bee2eeb622b tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:38.112550 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d1e7c4c3-2468-400c-92c5-3bee2eeb622b tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:38.112550 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d1e7c4c3-2468-400c-92c5-3bee2eeb622b tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:38.225561 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-d1e7c4c3-2468-400c-92c5-3bee2eeb622b tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:22:38.232779 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-d1e7c4c3-2468-400c-92c5-3bee2eeb622b tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.135926 Nov 01 01:22:38.233337 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 310/673] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:22:38 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:22:38.991286 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-abd034b2-75b8-44d6-b5f6-d444ef2443df tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:22:38.991891 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-abd034b2-75b8-44d6-b5f6-d444ef2443df tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:22:38.998130 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-abd034b2-75b8-44d6-b5f6-d444ef2443df tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:38.998714 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-abd034b2-75b8-44d6-b5f6-d444ef2443df tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:38.999352 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-abd034b2-75b8-44d6-b5f6-d444ef2443df tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:38.999788 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-abd034b2-75b8-44d6-b5f6-d444ef2443df tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:39.043011 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-0ae398f5-2f21-4012-b3c7-e85993aace77 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:22:39.044020 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-0ae398f5-2f21-4012-b3c7-e85993aace77 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:22:39.050082 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0ae398f5-2f21-4012-b3c7-e85993aace77 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:39.050549 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0ae398f5-2f21-4012-b3c7-e85993aace77 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:39.051304 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0ae398f5-2f21-4012-b3c7-e85993aace77 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:39.051787 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0ae398f5-2f21-4012-b3c7-e85993aace77 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:39.080937 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-0ae398f5-2f21-4012-b3c7-e85993aace77 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041561 Nov 01 01:22:39.081517 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 311/674] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:22:39 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 01 01:22:39.118755 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-abd034b2-75b8-44d6-b5f6-d444ef2443df tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:22:39.126025 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-abd034b2-75b8-44d6-b5f6-d444ef2443df tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1259 microversion: 2.1 time: 0.138647 Nov 01 01:22:39.126606 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 364/675] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:22:38 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1259 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:22:39.250064 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-f30aa735-1462-4bf9-b1e8-ca4a3a9195c2 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:22:39.250611 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-f30aa735-1462-4bf9-b1e8-ca4a3a9195c2 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:22:39.256890 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f30aa735-1462-4bf9-b1e8-ca4a3a9195c2 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:39.257325 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f30aa735-1462-4bf9-b1e8-ca4a3a9195c2 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:39.258072 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f30aa735-1462-4bf9-b1e8-ca4a3a9195c2 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:39.258522 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f30aa735-1462-4bf9-b1e8-ca4a3a9195c2 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:39.377615 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-f30aa735-1462-4bf9-b1e8-ca4a3a9195c2 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:22:39.385284 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-f30aa735-1462-4bf9-b1e8-ca4a3a9195c2 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.138951 Nov 01 01:22:39.385873 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 312/676] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:22:39 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:22:40.092828 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-3be7c80d-facb-4f44-abbd-b4bf7f37da9a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:22:40.093766 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-3be7c80d-facb-4f44-abbd-b4bf7f37da9a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:22:40.100023 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3be7c80d-facb-4f44-abbd-b4bf7f37da9a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:40.100470 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3be7c80d-facb-4f44-abbd-b4bf7f37da9a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:40.101295 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3be7c80d-facb-4f44-abbd-b4bf7f37da9a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:40.101722 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3be7c80d-facb-4f44-abbd-b4bf7f37da9a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:40.129704 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-3be7c80d-facb-4f44-abbd-b4bf7f37da9a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040671 Nov 01 01:22:40.131011 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 365/677] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:22:40 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:22:40.142096 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-811cde0f-34e4-44f1-acc9-75955bcbdc71 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:22:40.142730 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-811cde0f-34e4-44f1-acc9-75955bcbdc71 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:22:40.149519 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-811cde0f-34e4-44f1-acc9-75955bcbdc71 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:40.149973 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-811cde0f-34e4-44f1-acc9-75955bcbdc71 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:40.150758 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-811cde0f-34e4-44f1-acc9-75955bcbdc71 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:40.151189 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-811cde0f-34e4-44f1-acc9-75955bcbdc71 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:40.268489 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-811cde0f-34e4-44f1-acc9-75955bcbdc71 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:22:40.276356 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-811cde0f-34e4-44f1-acc9-75955bcbdc71 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1259 microversion: 2.1 time: 0.137815 Nov 01 01:22:40.276924 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 313/678] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:22:40 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1259 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:22:40.402072 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-af3390c4-b151-4d8a-a194-ac8e709551e9 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:22:40.402697 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-af3390c4-b151-4d8a-a194-ac8e709551e9 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:22:40.408522 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-af3390c4-b151-4d8a-a194-ac8e709551e9 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:40.408955 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-af3390c4-b151-4d8a-a194-ac8e709551e9 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:40.409708 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-af3390c4-b151-4d8a-a194-ac8e709551e9 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:40.410130 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-af3390c4-b151-4d8a-a194-ac8e709551e9 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:40.524584 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-af3390c4-b151-4d8a-a194-ac8e709551e9 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:22:40.531656 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-af3390c4-b151-4d8a-a194-ac8e709551e9 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.133274 Nov 01 01:22:40.532217 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 366/679] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:22:40 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:22:41.140728 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-70383d0c-1d71-435d-ad3f-284d346efbff tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:22:41.141638 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-70383d0c-1d71-435d-ad3f-284d346efbff tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:22:41.148383 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-70383d0c-1d71-435d-ad3f-284d346efbff tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:41.148968 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-70383d0c-1d71-435d-ad3f-284d346efbff tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:41.149570 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-70383d0c-1d71-435d-ad3f-284d346efbff tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:41.149996 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-70383d0c-1d71-435d-ad3f-284d346efbff tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:41.182856 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-70383d0c-1d71-435d-ad3f-284d346efbff tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045830 Nov 01 01:22:41.183409 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 314/680] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:22:41 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:22:41.293192 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-03c3c8d9-330c-4ecb-8b50-55efc6f2a4c4 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:22:41.293802 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-03c3c8d9-330c-4ecb-8b50-55efc6f2a4c4 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:22:41.299988 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-03c3c8d9-330c-4ecb-8b50-55efc6f2a4c4 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:41.300425 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-03c3c8d9-330c-4ecb-8b50-55efc6f2a4c4 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:41.301174 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-03c3c8d9-330c-4ecb-8b50-55efc6f2a4c4 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:41.301591 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-03c3c8d9-330c-4ecb-8b50-55efc6f2a4c4 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:41.421230 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-03c3c8d9-330c-4ecb-8b50-55efc6f2a4c4 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:22:41.428394 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-03c3c8d9-330c-4ecb-8b50-55efc6f2a4c4 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1259 microversion: 2.1 time: 0.138807 Nov 01 01:22:41.428953 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 367/681] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:22:41 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1259 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:22:41.548237 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-47e5724b-333f-481d-8be6-3a425f3a0754 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:22:41.548839 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-47e5724b-333f-481d-8be6-3a425f3a0754 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:22:41.554591 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-47e5724b-333f-481d-8be6-3a425f3a0754 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:41.555036 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-47e5724b-333f-481d-8be6-3a425f3a0754 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:41.555787 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-47e5724b-333f-481d-8be6-3a425f3a0754 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:41.556214 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-47e5724b-333f-481d-8be6-3a425f3a0754 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:41.671584 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-47e5724b-333f-481d-8be6-3a425f3a0754 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:22:41.678775 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-47e5724b-333f-481d-8be6-3a425f3a0754 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.134130 Nov 01 01:22:41.680041 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 315/682] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:22:41 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:22:42.195061 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-b0f3fc96-eaa4-4e19-9246-d7572a2ac0e7 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:22:42.195986 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-b0f3fc96-eaa4-4e19-9246-d7572a2ac0e7 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:22:42.201793 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b0f3fc96-eaa4-4e19-9246-d7572a2ac0e7 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:42.202228 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b0f3fc96-eaa4-4e19-9246-d7572a2ac0e7 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:42.203010 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b0f3fc96-eaa4-4e19-9246-d7572a2ac0e7 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:42.203431 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b0f3fc96-eaa4-4e19-9246-d7572a2ac0e7 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:42.238524 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-b0f3fc96-eaa4-4e19-9246-d7572a2ac0e7 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047903 Nov 01 01:22:42.239063 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 368/683] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:22:42 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:22:42.444687 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-06843762-6bd1-4529-9aa4-3ffbf9cbc8cb tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:22:42.445237 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-06843762-6bd1-4529-9aa4-3ffbf9cbc8cb tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:22:42.451499 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-06843762-6bd1-4529-9aa4-3ffbf9cbc8cb tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:42.451942 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-06843762-6bd1-4529-9aa4-3ffbf9cbc8cb tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:42.452703 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-06843762-6bd1-4529-9aa4-3ffbf9cbc8cb tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:42.453126 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-06843762-6bd1-4529-9aa4-3ffbf9cbc8cb tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:42.572704 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-06843762-6bd1-4529-9aa4-3ffbf9cbc8cb tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:22:42.579856 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-06843762-6bd1-4529-9aa4-3ffbf9cbc8cb tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1259 microversion: 2.1 time: 0.138859 Nov 01 01:22:42.580422 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 316/684] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:22:42 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1259 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:22:42.695326 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-d239db5c-41d0-4274-b158-36e69a63eeae tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:22:42.695862 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-d239db5c-41d0-4274-b158-36e69a63eeae tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:22:42.701998 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d239db5c-41d0-4274-b158-36e69a63eeae tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:42.702475 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d239db5c-41d0-4274-b158-36e69a63eeae tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:42.703240 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d239db5c-41d0-4274-b158-36e69a63eeae tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:42.703669 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d239db5c-41d0-4274-b158-36e69a63eeae tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:43.037566 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-d239db5c-41d0-4274-b158-36e69a63eeae tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:22:43.044855 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-d239db5c-41d0-4274-b158-36e69a63eeae tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.353223 Nov 01 01:22:43.045415 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 369/685] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:22:42 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:22:43.250296 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-9b307f8f-3675-467d-9e34-dedd36267b37 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:22:43.251239 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-9b307f8f-3675-467d-9e34-dedd36267b37 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:22:43.257494 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9b307f8f-3675-467d-9e34-dedd36267b37 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:43.257878 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9b307f8f-3675-467d-9e34-dedd36267b37 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:43.258665 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9b307f8f-3675-467d-9e34-dedd36267b37 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:43.259112 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9b307f8f-3675-467d-9e34-dedd36267b37 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:43.287059 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-9b307f8f-3675-467d-9e34-dedd36267b37 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040520 Nov 01 01:22:43.287587 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 317/686] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:22:43 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:22:43.596397 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-b57b7b59-4804-4561-8a7c-11f7ff2cd66b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:22:43.596962 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-b57b7b59-4804-4561-8a7c-11f7ff2cd66b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:22:43.602871 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b57b7b59-4804-4561-8a7c-11f7ff2cd66b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:43.603314 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b57b7b59-4804-4561-8a7c-11f7ff2cd66b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:43.604066 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b57b7b59-4804-4561-8a7c-11f7ff2cd66b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:43.604497 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b57b7b59-4804-4561-8a7c-11f7ff2cd66b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:43.720831 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-b57b7b59-4804-4561-8a7c-11f7ff2cd66b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:22:43.728486 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-b57b7b59-4804-4561-8a7c-11f7ff2cd66b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1259 microversion: 2.1 time: 0.135812 Nov 01 01:22:43.729038 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 370/687] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:22:43 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1259 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:22:44.061134 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-b4e08242-fb2b-4f66-9a45-35df61a6610b tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:22:44.061745 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-b4e08242-fb2b-4f66-9a45-35df61a6610b tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:22:44.068132 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b4e08242-fb2b-4f66-9a45-35df61a6610b tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:44.068579 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b4e08242-fb2b-4f66-9a45-35df61a6610b tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:44.069340 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b4e08242-fb2b-4f66-9a45-35df61a6610b tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:44.069772 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b4e08242-fb2b-4f66-9a45-35df61a6610b tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:44.189987 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-b4e08242-fb2b-4f66-9a45-35df61a6610b tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:22:44.197136 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-b4e08242-fb2b-4f66-9a45-35df61a6610b tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.139610 Nov 01 01:22:44.197695 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 318/688] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:22:44 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:22:44.297763 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-9406ae0f-97be-4ad0-87ea-6755d02acb27 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:22:44.298742 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-9406ae0f-97be-4ad0-87ea-6755d02acb27 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:22:44.304662 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9406ae0f-97be-4ad0-87ea-6755d02acb27 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:44.305159 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9406ae0f-97be-4ad0-87ea-6755d02acb27 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:44.305920 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9406ae0f-97be-4ad0-87ea-6755d02acb27 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:44.306350 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9406ae0f-97be-4ad0-87ea-6755d02acb27 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:44.336378 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-9406ae0f-97be-4ad0-87ea-6755d02acb27 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042359 Nov 01 01:22:44.336930 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 371/689] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:22:44 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:22:44.744800 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-3b297083-e2c9-499a-8680-db3189140774 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:22:44.745407 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-3b297083-e2c9-499a-8680-db3189140774 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:22:44.751497 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3b297083-e2c9-499a-8680-db3189140774 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:44.751945 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3b297083-e2c9-499a-8680-db3189140774 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:44.752703 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3b297083-e2c9-499a-8680-db3189140774 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:44.753140 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3b297083-e2c9-499a-8680-db3189140774 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:44.873579 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-3b297083-e2c9-499a-8680-db3189140774 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:22:44.881648 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-3b297083-e2c9-499a-8680-db3189140774 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1259 microversion: 2.1 time: 0.140492 Nov 01 01:22:44.882204 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 319/690] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:22:44 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1259 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:22:45.213285 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-31906941-9067-459a-b114-fb58fac7d2a2 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:22:45.213895 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-31906941-9067-459a-b114-fb58fac7d2a2 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:22:45.219692 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-31906941-9067-459a-b114-fb58fac7d2a2 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:45.220138 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-31906941-9067-459a-b114-fb58fac7d2a2 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:45.220965 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-31906941-9067-459a-b114-fb58fac7d2a2 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:45.221402 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-31906941-9067-459a-b114-fb58fac7d2a2 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:45.339834 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-31906941-9067-459a-b114-fb58fac7d2a2 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:22:45.347356 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-53b40d3f-484b-48d6-b514-2ddbcea865c2 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:22:45.347874 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-31906941-9067-459a-b114-fb58fac7d2a2 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.137953 Nov 01 01:22:45.357161 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-53b40d3f-484b-48d6-b514-2ddbcea865c2 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:22:45.357305 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 372/691] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:22:45 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:22:45.357418 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-53b40d3f-484b-48d6-b514-2ddbcea865c2 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:45.357418 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-53b40d3f-484b-48d6-b514-2ddbcea865c2 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:45.357418 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-53b40d3f-484b-48d6-b514-2ddbcea865c2 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:45.357418 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-53b40d3f-484b-48d6-b514-2ddbcea865c2 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:45.385737 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-53b40d3f-484b-48d6-b514-2ddbcea865c2 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042007 Nov 01 01:22:45.386276 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 320/692] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:22:45 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 01 01:22:45.897641 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-11541712-484a-47b4-bf4e-d3713d48bb3e tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:22:45.898240 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-11541712-484a-47b4-bf4e-d3713d48bb3e tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:22:45.903901 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-11541712-484a-47b4-bf4e-d3713d48bb3e tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:45.904341 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-11541712-484a-47b4-bf4e-d3713d48bb3e tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:45.905094 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-11541712-484a-47b4-bf4e-d3713d48bb3e tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:45.905521 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-11541712-484a-47b4-bf4e-d3713d48bb3e tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:46.022110 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-11541712-484a-47b4-bf4e-d3713d48bb3e tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:22:46.029428 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-11541712-484a-47b4-bf4e-d3713d48bb3e tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1259 microversion: 2.1 time: 0.135370 Nov 01 01:22:46.029976 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 373/693] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:22:45 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1259 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:22:46.364481 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-01b6400b-3157-40ba-bde9-a0fbdc85dfa9 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:22:46.365189 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-01b6400b-3157-40ba-bde9-a0fbdc85dfa9 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:22:46.371449 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-01b6400b-3157-40ba-bde9-a0fbdc85dfa9 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:46.371888 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-01b6400b-3157-40ba-bde9-a0fbdc85dfa9 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:46.372634 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-01b6400b-3157-40ba-bde9-a0fbdc85dfa9 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:46.373055 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-01b6400b-3157-40ba-bde9-a0fbdc85dfa9 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:46.396563 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-768d1fe9-cd6a-4544-b7a6-449c09571c56 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:22:46.397459 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-768d1fe9-cd6a-4544-b7a6-449c09571c56 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:22:46.403580 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-768d1fe9-cd6a-4544-b7a6-449c09571c56 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:46.404019 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-768d1fe9-cd6a-4544-b7a6-449c09571c56 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:46.404772 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-768d1fe9-cd6a-4544-b7a6-449c09571c56 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:46.405192 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-768d1fe9-cd6a-4544-b7a6-449c09571c56 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:46.434099 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-768d1fe9-cd6a-4544-b7a6-449c09571c56 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041792 Nov 01 01:22:46.434872 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 374/694] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:22:46 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 01 01:22:46.494502 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-01b6400b-3157-40ba-bde9-a0fbdc85dfa9 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:22:46.501645 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-01b6400b-3157-40ba-bde9-a0fbdc85dfa9 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.141199 Nov 01 01:22:46.502203 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 321/695] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:22:46 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:22:47.046446 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-89670120-2e81-45e5-965c-acb80cc0be29 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:22:47.047055 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-89670120-2e81-45e5-965c-acb80cc0be29 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:22:47.053267 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-89670120-2e81-45e5-965c-acb80cc0be29 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:47.053717 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-89670120-2e81-45e5-965c-acb80cc0be29 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:47.054509 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-89670120-2e81-45e5-965c-acb80cc0be29 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:47.054940 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-89670120-2e81-45e5-965c-acb80cc0be29 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:47.182742 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-89670120-2e81-45e5-965c-acb80cc0be29 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:22:47.190539 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-89670120-2e81-45e5-965c-acb80cc0be29 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1259 microversion: 2.1 time: 0.147735 Nov 01 01:22:47.191968 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 375/696] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:22:47 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1259 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:22:47.446168 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-9455fb1f-78e9-4259-91dd-a801086d85d0 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:22:47.447986 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-9455fb1f-78e9-4259-91dd-a801086d85d0 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:22:47.453323 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9455fb1f-78e9-4259-91dd-a801086d85d0 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:47.453792 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9455fb1f-78e9-4259-91dd-a801086d85d0 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:47.454599 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9455fb1f-78e9-4259-91dd-a801086d85d0 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:47.455030 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9455fb1f-78e9-4259-91dd-a801086d85d0 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:47.483659 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-9455fb1f-78e9-4259-91dd-a801086d85d0 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041970 Nov 01 01:22:47.484218 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 322/697] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:22:47 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:22:47.518022 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-30a9669b-64dc-4570-8c07-50db0e0a3fff tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:22:47.518714 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-30a9669b-64dc-4570-8c07-50db0e0a3fff tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:22:47.525060 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-30a9669b-64dc-4570-8c07-50db0e0a3fff tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:47.525508 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-30a9669b-64dc-4570-8c07-50db0e0a3fff tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:47.526274 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-30a9669b-64dc-4570-8c07-50db0e0a3fff tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:47.526732 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-30a9669b-64dc-4570-8c07-50db0e0a3fff tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:47.643465 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-30a9669b-64dc-4570-8c07-50db0e0a3fff tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:22:47.650936 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-30a9669b-64dc-4570-8c07-50db0e0a3fff tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.136564 Nov 01 01:22:47.651508 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 376/698] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:22:47 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:22:48.207505 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-a33f2c6a-6c8d-48aa-92cc-2879ff8265ac tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:22:48.208067 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-a33f2c6a-6c8d-48aa-92cc-2879ff8265ac tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:22:48.213859 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a33f2c6a-6c8d-48aa-92cc-2879ff8265ac tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:48.214299 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a33f2c6a-6c8d-48aa-92cc-2879ff8265ac tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:48.215086 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a33f2c6a-6c8d-48aa-92cc-2879ff8265ac tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:48.215510 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a33f2c6a-6c8d-48aa-92cc-2879ff8265ac tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:48.337228 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-a33f2c6a-6c8d-48aa-92cc-2879ff8265ac tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:22:48.344624 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-a33f2c6a-6c8d-48aa-92cc-2879ff8265ac tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1259 microversion: 2.1 time: 0.140805 Nov 01 01:22:48.345436 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 323/699] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:22:48 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1259 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:22:48.494909 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-3402b87d-29d9-44ef-b750-9e04bed1087b tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:22:48.495748 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-3402b87d-29d9-44ef-b750-9e04bed1087b tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:22:48.501465 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3402b87d-29d9-44ef-b750-9e04bed1087b tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:48.501897 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3402b87d-29d9-44ef-b750-9e04bed1087b tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:48.502663 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3402b87d-29d9-44ef-b750-9e04bed1087b tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:48.503086 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3402b87d-29d9-44ef-b750-9e04bed1087b tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:48.531321 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-3402b87d-29d9-44ef-b750-9e04bed1087b tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040194 Nov 01 01:22:48.531904 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 377/700] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:22:48 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:22:48.667805 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-422cfcd0-4eca-46ba-8f37-3447c326a578 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:22:48.668405 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-422cfcd0-4eca-46ba-8f37-3447c326a578 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:22:48.674663 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-422cfcd0-4eca-46ba-8f37-3447c326a578 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:48.687645 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-422cfcd0-4eca-46ba-8f37-3447c326a578 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:48.687645 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-422cfcd0-4eca-46ba-8f37-3447c326a578 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:48.687645 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-422cfcd0-4eca-46ba-8f37-3447c326a578 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:48.793341 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-422cfcd0-4eca-46ba-8f37-3447c326a578 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:22:48.800545 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-422cfcd0-4eca-46ba-8f37-3447c326a578 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.136420 Nov 01 01:22:48.801106 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 324/701] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:22:48 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:22:49.365380 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-f9b754ea-787b-4912-8654-63d22ef3272a tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:22:49.365976 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-f9b754ea-787b-4912-8654-63d22ef3272a tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:22:49.371803 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f9b754ea-787b-4912-8654-63d22ef3272a tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:49.372124 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f9b754ea-787b-4912-8654-63d22ef3272a tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:49.372988 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f9b754ea-787b-4912-8654-63d22ef3272a tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:49.373474 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f9b754ea-787b-4912-8654-63d22ef3272a tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:49.489531 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-f9b754ea-787b-4912-8654-63d22ef3272a tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:22:49.496604 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-f9b754ea-787b-4912-8654-63d22ef3272a tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1259 microversion: 2.1 time: 0.135651 Nov 01 01:22:49.497158 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 378/702] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:22:49 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1259 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:22:49.541483 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-de08b241-ebb5-4d1a-a517-a5a9df880b4c tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:22:49.542398 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-de08b241-ebb5-4d1a-a517-a5a9df880b4c tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:22:49.548143 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-de08b241-ebb5-4d1a-a517-a5a9df880b4c tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:49.548589 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-de08b241-ebb5-4d1a-a517-a5a9df880b4c tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:49.549341 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-de08b241-ebb5-4d1a-a517-a5a9df880b4c tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:49.549771 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-de08b241-ebb5-4d1a-a517-a5a9df880b4c tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:49.578274 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-de08b241-ebb5-4d1a-a517-a5a9df880b4c tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040510 Nov 01 01:22:49.578843 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 325/703] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:22:49 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:22:49.816895 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-49f27d79-998d-42d7-bd8f-a16d7c317c31 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:22:49.817496 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-49f27d79-998d-42d7-bd8f-a16d7c317c31 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:22:49.824000 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-49f27d79-998d-42d7-bd8f-a16d7c317c31 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:49.824444 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-49f27d79-998d-42d7-bd8f-a16d7c317c31 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:49.825201 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-49f27d79-998d-42d7-bd8f-a16d7c317c31 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:49.825630 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-49f27d79-998d-42d7-bd8f-a16d7c317c31 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:49.945826 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-49f27d79-998d-42d7-bd8f-a16d7c317c31 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:22:49.952984 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-49f27d79-998d-42d7-bd8f-a16d7c317c31 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.139725 Nov 01 01:22:49.953539 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 379/704] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:22:49 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:22:50.513515 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-7a385c5f-5bd8-4447-8dcc-19877a78e2dc tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:22:50.514115 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-7a385c5f-5bd8-4447-8dcc-19877a78e2dc tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:22:50.520986 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-7a385c5f-5bd8-4447-8dcc-19877a78e2dc tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:50.521431 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-7a385c5f-5bd8-4447-8dcc-19877a78e2dc tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:50.522184 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-7a385c5f-5bd8-4447-8dcc-19877a78e2dc tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:50.522643 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-7a385c5f-5bd8-4447-8dcc-19877a78e2dc tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:50.589805 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-1bc7de2e-a25e-4a91-b349-d2637179ce47 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:22:50.590773 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-1bc7de2e-a25e-4a91-b349-d2637179ce47 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:22:50.596478 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1bc7de2e-a25e-4a91-b349-d2637179ce47 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:50.596930 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1bc7de2e-a25e-4a91-b349-d2637179ce47 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:50.597704 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1bc7de2e-a25e-4a91-b349-d2637179ce47 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:50.598139 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1bc7de2e-a25e-4a91-b349-d2637179ce47 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:50.629163 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-1bc7de2e-a25e-4a91-b349-d2637179ce47 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041162 Nov 01 01:22:50.629163 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 380/705] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:22:50 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 01 01:22:50.640886 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-7a385c5f-5bd8-4447-8dcc-19877a78e2dc tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:22:50.648755 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-7a385c5f-5bd8-4447-8dcc-19877a78e2dc tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1259 microversion: 2.1 time: 0.138861 Nov 01 01:22:50.649315 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 326/706] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:22:50 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1259 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:22:50.968820 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-94704e22-1f1d-474b-b75d-31d6adca5783 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:22:50.969425 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-94704e22-1f1d-474b-b75d-31d6adca5783 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:22:50.975681 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-94704e22-1f1d-474b-b75d-31d6adca5783 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:50.976123 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-94704e22-1f1d-474b-b75d-31d6adca5783 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:50.976877 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-94704e22-1f1d-474b-b75d-31d6adca5783 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:50.977302 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-94704e22-1f1d-474b-b75d-31d6adca5783 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:51.095152 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-94704e22-1f1d-474b-b75d-31d6adca5783 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:22:51.102387 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-94704e22-1f1d-474b-b75d-31d6adca5783 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.137214 Nov 01 01:22:51.102972 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 381/707] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:22:50 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:22:51.639189 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-f87c927a-a978-404c-9c8d-640f5dbe9d76 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:22:51.640106 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-f87c927a-a978-404c-9c8d-640f5dbe9d76 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:22:51.645799 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f87c927a-a978-404c-9c8d-640f5dbe9d76 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:51.646271 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f87c927a-a978-404c-9c8d-640f5dbe9d76 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:51.647066 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f87c927a-a978-404c-9c8d-640f5dbe9d76 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:51.647497 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f87c927a-a978-404c-9c8d-640f5dbe9d76 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:51.675777 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-f87c927a-a978-404c-9c8d-640f5dbe9d76 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040292 Nov 01 01:22:51.676326 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 382/708] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:22:51 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 01 01:22:51.680885 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-4bd8b126-64d4-4960-beaf-4a3a392fd069 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:22:51.681474 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-4bd8b126-64d4-4960-beaf-4a3a392fd069 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:22:51.686740 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4bd8b126-64d4-4960-beaf-4a3a392fd069 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:51.687181 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4bd8b126-64d4-4960-beaf-4a3a392fd069 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:51.687933 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4bd8b126-64d4-4960-beaf-4a3a392fd069 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:51.688357 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4bd8b126-64d4-4960-beaf-4a3a392fd069 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:51.709543 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-e847d28c-1415-4f92-85b9-5d6f14736414 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:22:51.710074 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-e847d28c-1415-4f92-85b9-5d6f14736414 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:22:51.716266 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e847d28c-1415-4f92-85b9-5d6f14736414 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:51.716716 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e847d28c-1415-4f92-85b9-5d6f14736414 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:51.717475 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e847d28c-1415-4f92-85b9-5d6f14736414 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:51.717899 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e847d28c-1415-4f92-85b9-5d6f14736414 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:51.795709 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.objects.instance [None req-e847d28c-1415-4f92-85b9-5d6f14736414 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lazy-loading 'services' on Instance uuid a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 {{(pid=116267) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 01 01:22:51.817959 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-4bd8b126-64d4-4960-beaf-4a3a392fd069 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:22:51.825435 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-4bd8b126-64d4-4960-beaf-4a3a392fd069 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1259 microversion: 2.1 time: 0.147657 Nov 01 01:22:51.826029 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 383/709] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:22:51 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1259 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:22:51.979206 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-e847d28c-1415-4f92-85b9-5d6f14736414 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "DELETE /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/os-volume_attachments/85e71fcf-6447-4fd3-99b6-ce736067cd6e" status: 202 len: 0 microversion: 2.1 time: 0.376885 Nov 01 01:22:51.979809 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 327/710] 10.222.0.47 () {58 vars in 1415 bytes} [Mon Nov 1 01:22:51 2021] DELETE /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/os-volume_attachments/85e71fcf-6447-4fd3-99b6-ce736067cd6e => generated 0 bytes in 378 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 01 01:22:52.119764 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-9a718e3a-b641-4d94-ab2e-6731bd436add tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:22:52.120369 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-9a718e3a-b641-4d94-ab2e-6731bd436add tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:22:52.126995 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9a718e3a-b641-4d94-ab2e-6731bd436add tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:52.127440 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9a718e3a-b641-4d94-ab2e-6731bd436add tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:52.128206 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9a718e3a-b641-4d94-ab2e-6731bd436add tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:52.128634 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9a718e3a-b641-4d94-ab2e-6731bd436add tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:52.256729 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-9a718e3a-b641-4d94-ab2e-6731bd436add tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:22:52.264180 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-9a718e3a-b641-4d94-ab2e-6731bd436add tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.148146 Nov 01 01:22:52.264749 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 384/711] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:22:52 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:22:52.688596 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-dc3a052a-7d9a-464a-b3ed-f96bb5317eea tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:22:52.689570 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-dc3a052a-7d9a-464a-b3ed-f96bb5317eea tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:22:52.696260 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-dc3a052a-7d9a-464a-b3ed-f96bb5317eea tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:52.696707 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-dc3a052a-7d9a-464a-b3ed-f96bb5317eea tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:52.697468 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-dc3a052a-7d9a-464a-b3ed-f96bb5317eea tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:52.697931 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-dc3a052a-7d9a-464a-b3ed-f96bb5317eea tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:52.726802 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-dc3a052a-7d9a-464a-b3ed-f96bb5317eea tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042770 Nov 01 01:22:52.727666 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 328/712] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:22:52 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:22:52.842290 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-dd271b11-eed6-421f-a75b-7e5f77007ce5 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:22:52.842935 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-dd271b11-eed6-421f-a75b-7e5f77007ce5 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:22:52.849535 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-dd271b11-eed6-421f-a75b-7e5f77007ce5 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:52.853779 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-dd271b11-eed6-421f-a75b-7e5f77007ce5 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:52.854621 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-dd271b11-eed6-421f-a75b-7e5f77007ce5 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:52.855067 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-dd271b11-eed6-421f-a75b-7e5f77007ce5 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:52.974596 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-dd271b11-eed6-421f-a75b-7e5f77007ce5 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:22:52.981719 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-dd271b11-eed6-421f-a75b-7e5f77007ce5 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1259 microversion: 2.1 time: 0.143442 Nov 01 01:22:52.982290 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 385/713] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:22:52 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1259 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:22:53.280785 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-06893a86-29d2-40cf-8f36-857dbdd854b8 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:22:53.281389 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-06893a86-29d2-40cf-8f36-857dbdd854b8 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:22:53.287844 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-06893a86-29d2-40cf-8f36-857dbdd854b8 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:53.288291 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-06893a86-29d2-40cf-8f36-857dbdd854b8 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:53.289050 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-06893a86-29d2-40cf-8f36-857dbdd854b8 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:53.289479 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-06893a86-29d2-40cf-8f36-857dbdd854b8 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:53.410654 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-06893a86-29d2-40cf-8f36-857dbdd854b8 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:22:53.418375 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-06893a86-29d2-40cf-8f36-857dbdd854b8 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.141228 Nov 01 01:22:53.418966 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 329/714] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:22:53 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:22:53.737989 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-7ed485bb-2498-4670-8340-a4b6fc6cb7ef tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:22:53.738917 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-7ed485bb-2498-4670-8340-a4b6fc6cb7ef tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:22:53.745087 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7ed485bb-2498-4670-8340-a4b6fc6cb7ef tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:53.745530 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7ed485bb-2498-4670-8340-a4b6fc6cb7ef tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:53.746285 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7ed485bb-2498-4670-8340-a4b6fc6cb7ef tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:53.746761 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7ed485bb-2498-4670-8340-a4b6fc6cb7ef tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:53.775079 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-7ed485bb-2498-4670-8340-a4b6fc6cb7ef tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041081 Nov 01 01:22:53.775614 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 386/715] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:22:53 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:22:53.998972 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-00e54440-9810-4fad-a789-bd15e3d5d7e7 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:22:53.999516 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-00e54440-9810-4fad-a789-bd15e3d5d7e7 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:22:54.005685 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-00e54440-9810-4fad-a789-bd15e3d5d7e7 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:54.006120 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-00e54440-9810-4fad-a789-bd15e3d5d7e7 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:54.006919 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-00e54440-9810-4fad-a789-bd15e3d5d7e7 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:54.007343 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-00e54440-9810-4fad-a789-bd15e3d5d7e7 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:54.128368 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-00e54440-9810-4fad-a789-bd15e3d5d7e7 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:22:54.135850 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-00e54440-9810-4fad-a789-bd15e3d5d7e7 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1259 microversion: 2.1 time: 0.140516 Nov 01 01:22:54.136400 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 330/716] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:22:53 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1259 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:22:54.434076 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-9f218efb-ae89-489e-abf5-7a832880944e tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:22:54.434706 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-9f218efb-ae89-489e-abf5-7a832880944e tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:22:54.440451 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9f218efb-ae89-489e-abf5-7a832880944e tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:54.440892 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9f218efb-ae89-489e-abf5-7a832880944e tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:54.441709 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9f218efb-ae89-489e-abf5-7a832880944e tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:54.442668 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9f218efb-ae89-489e-abf5-7a832880944e tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:54.565104 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-9f218efb-ae89-489e-abf5-7a832880944e tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:22:54.573464 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-9f218efb-ae89-489e-abf5-7a832880944e tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.143095 Nov 01 01:22:54.574030 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 387/717] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:22:54 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:22:54.785409 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-ada9efe9-02ff-4719-8598-5e7f9c52dd2c tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:22:54.786398 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-ada9efe9-02ff-4719-8598-5e7f9c52dd2c tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:22:54.792212 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ada9efe9-02ff-4719-8598-5e7f9c52dd2c tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:54.792658 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ada9efe9-02ff-4719-8598-5e7f9c52dd2c tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:54.793413 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ada9efe9-02ff-4719-8598-5e7f9c52dd2c tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:54.793841 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ada9efe9-02ff-4719-8598-5e7f9c52dd2c tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:54.822230 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-ada9efe9-02ff-4719-8598-5e7f9c52dd2c tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040610 Nov 01 01:22:54.822790 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 331/718] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:22:54 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:22:55.152459 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-4fda0eae-b5e1-44c1-b10b-cfe2ec465ec2 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:22:55.153168 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-4fda0eae-b5e1-44c1-b10b-cfe2ec465ec2 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:22:55.159618 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4fda0eae-b5e1-44c1-b10b-cfe2ec465ec2 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:55.160147 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4fda0eae-b5e1-44c1-b10b-cfe2ec465ec2 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:55.161427 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4fda0eae-b5e1-44c1-b10b-cfe2ec465ec2 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:55.161868 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4fda0eae-b5e1-44c1-b10b-cfe2ec465ec2 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:55.291447 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-4fda0eae-b5e1-44c1-b10b-cfe2ec465ec2 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:22:55.298596 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-4fda0eae-b5e1-44c1-b10b-cfe2ec465ec2 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1259 microversion: 2.1 time: 0.149856 Nov 01 01:22:55.299157 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 388/719] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:22:55 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1259 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:22:55.589278 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-e90873fa-babc-4664-801e-2caef34a20fb tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:22:55.589893 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-e90873fa-babc-4664-801e-2caef34a20fb tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:22:55.596025 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e90873fa-babc-4664-801e-2caef34a20fb tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:55.596462 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e90873fa-babc-4664-801e-2caef34a20fb tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:55.597213 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e90873fa-babc-4664-801e-2caef34a20fb tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:55.597639 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e90873fa-babc-4664-801e-2caef34a20fb tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:55.715336 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-e90873fa-babc-4664-801e-2caef34a20fb tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:22:55.722540 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-e90873fa-babc-4664-801e-2caef34a20fb tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.136760 Nov 01 01:22:55.724190 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 332/720] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:22:55 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:22:55.834136 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-c7476187-1c6c-45c3-825d-0cef7a078a4a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:22:55.835056 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-c7476187-1c6c-45c3-825d-0cef7a078a4a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:22:55.841008 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c7476187-1c6c-45c3-825d-0cef7a078a4a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:55.841452 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c7476187-1c6c-45c3-825d-0cef7a078a4a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:55.842210 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c7476187-1c6c-45c3-825d-0cef7a078a4a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:55.842751 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c7476187-1c6c-45c3-825d-0cef7a078a4a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:55.870326 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-c7476187-1c6c-45c3-825d-0cef7a078a4a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040699 Nov 01 01:22:55.870895 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 389/721] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:22:55 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:22:56.315504 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-9475f7cf-16e7-4880-965f-2fc6595981f8 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:22:56.316103 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-9475f7cf-16e7-4880-965f-2fc6595981f8 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:22:56.323546 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9475f7cf-16e7-4880-965f-2fc6595981f8 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:56.323984 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9475f7cf-16e7-4880-965f-2fc6595981f8 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:56.324735 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9475f7cf-16e7-4880-965f-2fc6595981f8 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:56.325157 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9475f7cf-16e7-4880-965f-2fc6595981f8 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:56.448191 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-9475f7cf-16e7-4880-965f-2fc6595981f8 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:22:56.455331 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-9475f7cf-16e7-4880-965f-2fc6595981f8 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1259 microversion: 2.1 time: 0.143464 Nov 01 01:22:56.456079 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 333/722] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:22:56 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1259 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:22:56.738900 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-aec43846-ebc5-4432-9430-620f192a7da8 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:22:56.740110 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-aec43846-ebc5-4432-9430-620f192a7da8 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:22:56.746555 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-aec43846-ebc5-4432-9430-620f192a7da8 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:56.747007 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-aec43846-ebc5-4432-9430-620f192a7da8 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:56.747779 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-aec43846-ebc5-4432-9430-620f192a7da8 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:56.748212 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-aec43846-ebc5-4432-9430-620f192a7da8 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:56.868537 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-aec43846-ebc5-4432-9430-620f192a7da8 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:22:56.875805 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-aec43846-ebc5-4432-9430-620f192a7da8 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.140866 Nov 01 01:22:56.876378 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 390/723] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:22:56 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:22:56.881498 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-8f5f90a6-8e7e-4cbd-9ade-0f789244d0af tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:22:56.882403 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-8f5f90a6-8e7e-4cbd-9ade-0f789244d0af tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:22:56.888713 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8f5f90a6-8e7e-4cbd-9ade-0f789244d0af tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:56.889153 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8f5f90a6-8e7e-4cbd-9ade-0f789244d0af tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:56.889903 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8f5f90a6-8e7e-4cbd-9ade-0f789244d0af tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:56.890323 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8f5f90a6-8e7e-4cbd-9ade-0f789244d0af tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:56.919220 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-8f5f90a6-8e7e-4cbd-9ade-0f789244d0af tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041484 Nov 01 01:22:56.919758 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 334/724] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:22:56 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:22:57.471342 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-c0536420-96ff-453c-8ef4-15ec6a875135 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:22:57.471982 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-c0536420-96ff-453c-8ef4-15ec6a875135 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:22:57.477716 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c0536420-96ff-453c-8ef4-15ec6a875135 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:57.478161 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c0536420-96ff-453c-8ef4-15ec6a875135 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:57.478958 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c0536420-96ff-453c-8ef4-15ec6a875135 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:57.479390 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c0536420-96ff-453c-8ef4-15ec6a875135 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:57.596442 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-c0536420-96ff-453c-8ef4-15ec6a875135 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:22:57.603821 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-c0536420-96ff-453c-8ef4-15ec6a875135 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1259 microversion: 2.1 time: 0.136075 Nov 01 01:22:57.604389 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 391/725] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:22:57 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1259 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:22:57.892385 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-183dfe12-7738-4373-8a73-53897dd244fc tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:22:57.892929 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-183dfe12-7738-4373-8a73-53897dd244fc tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:22:57.899163 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-183dfe12-7738-4373-8a73-53897dd244fc tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:57.899603 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-183dfe12-7738-4373-8a73-53897dd244fc tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:57.900361 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-183dfe12-7738-4373-8a73-53897dd244fc tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:57.900787 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-183dfe12-7738-4373-8a73-53897dd244fc tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:57.931089 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-fe8f0eef-d7d5-45a7-9f72-0005f043a41e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:22:57.932008 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-fe8f0eef-d7d5-45a7-9f72-0005f043a41e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:22:57.938339 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-fe8f0eef-d7d5-45a7-9f72-0005f043a41e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:57.938849 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-fe8f0eef-d7d5-45a7-9f72-0005f043a41e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:57.939655 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-fe8f0eef-d7d5-45a7-9f72-0005f043a41e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:57.940288 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-fe8f0eef-d7d5-45a7-9f72-0005f043a41e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:57.970626 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-fe8f0eef-d7d5-45a7-9f72-0005f043a41e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043213 Nov 01 01:22:57.971189 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 392/726] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:22:57 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 01 01:22:58.020678 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-183dfe12-7738-4373-8a73-53897dd244fc tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:22:58.027975 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-183dfe12-7738-4373-8a73-53897dd244fc tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.139321 Nov 01 01:22:58.028821 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 335/727] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:22:57 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:22:58.620100 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-5fed587b-12b4-4b47-a053-98a7610bbc45 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:22:58.620699 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-5fed587b-12b4-4b47-a053-98a7610bbc45 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:22:58.626429 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5fed587b-12b4-4b47-a053-98a7610bbc45 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:58.626889 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5fed587b-12b4-4b47-a053-98a7610bbc45 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:58.627643 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5fed587b-12b4-4b47-a053-98a7610bbc45 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:58.628069 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5fed587b-12b4-4b47-a053-98a7610bbc45 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:58.747996 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-5fed587b-12b4-4b47-a053-98a7610bbc45 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:22:58.755597 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-5fed587b-12b4-4b47-a053-98a7610bbc45 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1259 microversion: 2.1 time: 0.139121 Nov 01 01:22:58.756153 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 393/728] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:22:58 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1259 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:22:58.982186 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-87aa4f79-7d65-43fe-9103-9ab2331b5a8e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:22:58.983150 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-87aa4f79-7d65-43fe-9103-9ab2331b5a8e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:22:58.989653 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-87aa4f79-7d65-43fe-9103-9ab2331b5a8e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:58.990092 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-87aa4f79-7d65-43fe-9103-9ab2331b5a8e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:58.990880 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-87aa4f79-7d65-43fe-9103-9ab2331b5a8e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:58.991306 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-87aa4f79-7d65-43fe-9103-9ab2331b5a8e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:59.019432 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-87aa4f79-7d65-43fe-9103-9ab2331b5a8e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040968 Nov 01 01:22:59.020042 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 336/729] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:22:58 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:22:59.044900 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-9bed1aba-325e-4477-9901-f3e255a3306b tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:22:59.045570 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-9bed1aba-325e-4477-9901-f3e255a3306b tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:22:59.051848 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9bed1aba-325e-4477-9901-f3e255a3306b tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:59.052298 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9bed1aba-325e-4477-9901-f3e255a3306b tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:59.053061 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9bed1aba-325e-4477-9901-f3e255a3306b tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:59.053491 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9bed1aba-325e-4477-9901-f3e255a3306b tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:59.170961 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-9bed1aba-325e-4477-9901-f3e255a3306b tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:22:59.178636 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-9bed1aba-325e-4477-9901-f3e255a3306b tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.137363 Nov 01 01:22:59.179229 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 394/730] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:22:59 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:22:59.771801 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-abac684f-16f0-4c29-a2a0-bddec467d3b6 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:22:59.772403 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-abac684f-16f0-4c29-a2a0-bddec467d3b6 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:22:59.778157 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-abac684f-16f0-4c29-a2a0-bddec467d3b6 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:59.778633 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-abac684f-16f0-4c29-a2a0-bddec467d3b6 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:59.779414 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-abac684f-16f0-4c29-a2a0-bddec467d3b6 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:22:59.779842 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-abac684f-16f0-4c29-a2a0-bddec467d3b6 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:22:59.907547 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-abac684f-16f0-4c29-a2a0-bddec467d3b6 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:22:59.915345 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-abac684f-16f0-4c29-a2a0-bddec467d3b6 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1259 microversion: 2.1 time: 0.147139 Nov 01 01:22:59.915905 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 337/731] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:22:59 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1259 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:23:00.030464 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-291fd4d4-5946-4851-b472-4e15d6e0f745 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:23:00.031412 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-291fd4d4-5946-4851-b472-4e15d6e0f745 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:23:00.037872 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-291fd4d4-5946-4851-b472-4e15d6e0f745 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:00.038317 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-291fd4d4-5946-4851-b472-4e15d6e0f745 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:00.039117 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-291fd4d4-5946-4851-b472-4e15d6e0f745 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:00.039549 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-291fd4d4-5946-4851-b472-4e15d6e0f745 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:00.067790 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-291fd4d4-5946-4851-b472-4e15d6e0f745 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041114 Nov 01 01:23:00.068361 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 395/732] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:23:00 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:23:00.195863 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-e2ec9796-e317-4579-9e8d-fa5879fdd942 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:23:00.196469 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-e2ec9796-e317-4579-9e8d-fa5879fdd942 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:23:00.202594 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e2ec9796-e317-4579-9e8d-fa5879fdd942 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:00.203029 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e2ec9796-e317-4579-9e8d-fa5879fdd942 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:00.203779 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e2ec9796-e317-4579-9e8d-fa5879fdd942 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:00.204200 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e2ec9796-e317-4579-9e8d-fa5879fdd942 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:00.324546 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-e2ec9796-e317-4579-9e8d-fa5879fdd942 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:23:00.331617 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-e2ec9796-e317-4579-9e8d-fa5879fdd942 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.139833 Nov 01 01:23:00.332167 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 338/733] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:23:00 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:23:00.931500 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-9af62d4e-ae9b-4afc-aa7c-08507faa60cc tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:23:00.932101 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-9af62d4e-ae9b-4afc-aa7c-08507faa60cc tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:23:00.937817 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9af62d4e-ae9b-4afc-aa7c-08507faa60cc tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:00.938260 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9af62d4e-ae9b-4afc-aa7c-08507faa60cc tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:00.939055 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9af62d4e-ae9b-4afc-aa7c-08507faa60cc tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:00.939485 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9af62d4e-ae9b-4afc-aa7c-08507faa60cc tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:01.057850 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-9af62d4e-ae9b-4afc-aa7c-08507faa60cc tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:23:01.065385 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-9af62d4e-ae9b-4afc-aa7c-08507faa60cc tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1259 microversion: 2.1 time: 0.137427 Nov 01 01:23:01.065999 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 396/734] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:23:00 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1259 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:23:01.078362 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-75fc4d5e-8a4a-4199-83bd-ab4ff38dc598 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:23:01.083205 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-75fc4d5e-8a4a-4199-83bd-ab4ff38dc598 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:23:01.085717 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-75fc4d5e-8a4a-4199-83bd-ab4ff38dc598 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:01.086150 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-75fc4d5e-8a4a-4199-83bd-ab4ff38dc598 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:01.086968 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-75fc4d5e-8a4a-4199-83bd-ab4ff38dc598 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:01.087392 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-75fc4d5e-8a4a-4199-83bd-ab4ff38dc598 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:01.116116 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-75fc4d5e-8a4a-4199-83bd-ab4ff38dc598 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041575 Nov 01 01:23:01.117463 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 339/735] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:23:01 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:23:01.352266 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-0ade7bd5-ae94-44df-a837-0343dfcc6758 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:23:01.352821 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-0ade7bd5-ae94-44df-a837-0343dfcc6758 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:23:01.358677 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0ade7bd5-ae94-44df-a837-0343dfcc6758 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:01.359121 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0ade7bd5-ae94-44df-a837-0343dfcc6758 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:01.359877 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0ade7bd5-ae94-44df-a837-0343dfcc6758 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:01.360306 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0ade7bd5-ae94-44df-a837-0343dfcc6758 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:01.478132 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-0ade7bd5-ae94-44df-a837-0343dfcc6758 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:23:01.485195 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-0ade7bd5-ae94-44df-a837-0343dfcc6758 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.136650 Nov 01 01:23:01.485747 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 397/736] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:23:01 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:23:02.082923 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-2096c7c4-2bfc-4173-89e6-196bce03d578 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:23:02.084151 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-2096c7c4-2bfc-4173-89e6-196bce03d578 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:23:02.090367 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-2096c7c4-2bfc-4173-89e6-196bce03d578 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:02.090862 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-2096c7c4-2bfc-4173-89e6-196bce03d578 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:02.091612 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-2096c7c4-2bfc-4173-89e6-196bce03d578 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:02.092031 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-2096c7c4-2bfc-4173-89e6-196bce03d578 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:02.127027 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-9ec45b77-33ab-4406-84a7-1f0c4356fec1 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:23:02.127930 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-9ec45b77-33ab-4406-84a7-1f0c4356fec1 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:23:02.134195 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9ec45b77-33ab-4406-84a7-1f0c4356fec1 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:02.134694 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9ec45b77-33ab-4406-84a7-1f0c4356fec1 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:02.135462 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9ec45b77-33ab-4406-84a7-1f0c4356fec1 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:02.135903 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9ec45b77-33ab-4406-84a7-1f0c4356fec1 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:02.165636 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-9ec45b77-33ab-4406-84a7-1f0c4356fec1 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042179 Nov 01 01:23:02.166217 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 398/737] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:23:02 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 01 01:23:02.212754 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-2096c7c4-2bfc-4173-89e6-196bce03d578 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:23:02.219950 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-2096c7c4-2bfc-4173-89e6-196bce03d578 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1259 microversion: 2.1 time: 0.141427 Nov 01 01:23:02.220516 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 340/738] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:23:02 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1259 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:23:02.502075 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-45443a86-1bde-4f1e-bb61-8768acf7e99d tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:23:02.502716 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-45443a86-1bde-4f1e-bb61-8768acf7e99d tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:23:02.508926 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-45443a86-1bde-4f1e-bb61-8768acf7e99d tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:02.509373 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-45443a86-1bde-4f1e-bb61-8768acf7e99d tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:02.510131 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-45443a86-1bde-4f1e-bb61-8768acf7e99d tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:02.510595 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-45443a86-1bde-4f1e-bb61-8768acf7e99d tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:02.628590 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-45443a86-1bde-4f1e-bb61-8768acf7e99d tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:23:02.636008 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-45443a86-1bde-4f1e-bb61-8768acf7e99d tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.137534 Nov 01 01:23:02.636568 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 399/739] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:23:02 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:23:03.177520 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-0be8f8d6-8b84-43d1-80b2-e32a10b4fd24 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:23:03.178441 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-0be8f8d6-8b84-43d1-80b2-e32a10b4fd24 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:23:03.184715 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0be8f8d6-8b84-43d1-80b2-e32a10b4fd24 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:03.185160 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0be8f8d6-8b84-43d1-80b2-e32a10b4fd24 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:03.185919 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0be8f8d6-8b84-43d1-80b2-e32a10b4fd24 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:03.186350 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0be8f8d6-8b84-43d1-80b2-e32a10b4fd24 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:03.214579 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-0be8f8d6-8b84-43d1-80b2-e32a10b4fd24 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041398 Nov 01 01:23:03.215123 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 341/740] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:23:03 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:23:03.236652 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-9f72b840-ad06-4e58-8ccc-4a1896255737 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:23:03.237517 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-9f72b840-ad06-4e58-8ccc-4a1896255737 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:23:03.244396 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9f72b840-ad06-4e58-8ccc-4a1896255737 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:03.244840 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9f72b840-ad06-4e58-8ccc-4a1896255737 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:03.245594 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9f72b840-ad06-4e58-8ccc-4a1896255737 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:03.246023 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9f72b840-ad06-4e58-8ccc-4a1896255737 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:03.362894 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-9f72b840-ad06-4e58-8ccc-4a1896255737 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:23:03.370143 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-9f72b840-ad06-4e58-8ccc-4a1896255737 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1259 microversion: 2.1 time: 0.137110 Nov 01 01:23:03.370737 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 400/741] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:23:03 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1259 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:23:03.652764 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-e84cd68c-2593-4561-af26-de21000cd1c1 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:23:03.653365 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-e84cd68c-2593-4561-af26-de21000cd1c1 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:23:03.659128 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e84cd68c-2593-4561-af26-de21000cd1c1 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:03.659562 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e84cd68c-2593-4561-af26-de21000cd1c1 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:03.660477 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e84cd68c-2593-4561-af26-de21000cd1c1 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:03.660913 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e84cd68c-2593-4561-af26-de21000cd1c1 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:03.790962 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-e84cd68c-2593-4561-af26-de21000cd1c1 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:23:03.798534 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-e84cd68c-2593-4561-af26-de21000cd1c1 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.149292 Nov 01 01:23:03.799105 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 342/742] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:23:03 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:23:04.226640 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-321b674a-772d-4697-86e0-cf7cb0f2f572 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:23:04.227547 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-321b674a-772d-4697-86e0-cf7cb0f2f572 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:23:04.233320 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-321b674a-772d-4697-86e0-cf7cb0f2f572 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:04.233762 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-321b674a-772d-4697-86e0-cf7cb0f2f572 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:04.234543 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-321b674a-772d-4697-86e0-cf7cb0f2f572 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:04.234968 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-321b674a-772d-4697-86e0-cf7cb0f2f572 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:04.262856 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-321b674a-772d-4697-86e0-cf7cb0f2f572 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040429 Nov 01 01:23:04.263387 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 401/743] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:23:04 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:23:04.386318 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-843ccc2e-591e-422d-a2eb-a0aba4b0b71d tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:23:04.390459 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-843ccc2e-591e-422d-a2eb-a0aba4b0b71d tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:23:04.393146 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-843ccc2e-591e-422d-a2eb-a0aba4b0b71d tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:04.393579 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-843ccc2e-591e-422d-a2eb-a0aba4b0b71d tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:04.394329 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-843ccc2e-591e-422d-a2eb-a0aba4b0b71d tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:04.394774 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-843ccc2e-591e-422d-a2eb-a0aba4b0b71d tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:04.512661 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-843ccc2e-591e-422d-a2eb-a0aba4b0b71d tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:23:04.519800 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-843ccc2e-591e-422d-a2eb-a0aba4b0b71d tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1259 microversion: 2.1 time: 0.137130 Nov 01 01:23:04.520939 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 343/744] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:23:04 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1259 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:23:04.815340 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-43318846-f46a-4af1-a6f4-104a3dbc6c03 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:23:04.815927 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-43318846-f46a-4af1-a6f4-104a3dbc6c03 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:23:04.822128 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-43318846-f46a-4af1-a6f4-104a3dbc6c03 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:04.822613 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-43318846-f46a-4af1-a6f4-104a3dbc6c03 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:04.823375 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-43318846-f46a-4af1-a6f4-104a3dbc6c03 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:04.823826 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-43318846-f46a-4af1-a6f4-104a3dbc6c03 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:04.938984 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-43318846-f46a-4af1-a6f4-104a3dbc6c03 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:23:04.946585 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-43318846-f46a-4af1-a6f4-104a3dbc6c03 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.134814 Nov 01 01:23:04.947140 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 402/745] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:23:04 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:23:05.274196 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-a6543fea-65af-4a44-a97b-8c63bc3feb61 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:23:05.275132 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-a6543fea-65af-4a44-a97b-8c63bc3feb61 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:23:05.280890 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a6543fea-65af-4a44-a97b-8c63bc3feb61 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:05.281354 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a6543fea-65af-4a44-a97b-8c63bc3feb61 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:05.282107 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a6543fea-65af-4a44-a97b-8c63bc3feb61 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:05.282558 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a6543fea-65af-4a44-a97b-8c63bc3feb61 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:05.311707 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-a6543fea-65af-4a44-a97b-8c63bc3feb61 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041273 Nov 01 01:23:05.312261 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 344/746] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:23:05 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:23:05.537310 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-3ff59df3-586a-4f69-a0f1-bcc3dca25e9d tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:23:05.537910 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-3ff59df3-586a-4f69-a0f1-bcc3dca25e9d tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:23:05.544120 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3ff59df3-586a-4f69-a0f1-bcc3dca25e9d tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:05.544563 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3ff59df3-586a-4f69-a0f1-bcc3dca25e9d tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:05.545318 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3ff59df3-586a-4f69-a0f1-bcc3dca25e9d tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:05.545746 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3ff59df3-586a-4f69-a0f1-bcc3dca25e9d tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:05.666868 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-3ff59df3-586a-4f69-a0f1-bcc3dca25e9d tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:23:05.674095 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-3ff59df3-586a-4f69-a0f1-bcc3dca25e9d tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1259 microversion: 2.1 time: 0.140922 Nov 01 01:23:05.674674 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 403/747] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:23:05 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1259 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:23:05.963466 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-38f0210d-7b09-4733-a28b-35b8023ea526 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:23:05.964065 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-38f0210d-7b09-4733-a28b-35b8023ea526 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:23:05.970187 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-38f0210d-7b09-4733-a28b-35b8023ea526 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:05.970665 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-38f0210d-7b09-4733-a28b-35b8023ea526 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:05.971413 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-38f0210d-7b09-4733-a28b-35b8023ea526 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:05.971834 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-38f0210d-7b09-4733-a28b-35b8023ea526 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:06.093319 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-38f0210d-7b09-4733-a28b-35b8023ea526 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:23:06.097002 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-38f0210d-7b09-4733-a28b-35b8023ea526 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.137154 Nov 01 01:23:06.097552 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 345/748] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:23:05 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:23:06.323189 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-8f1cb738-2eeb-4fcb-ae98-044ce48ab88c tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:23:06.324088 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-8f1cb738-2eeb-4fcb-ae98-044ce48ab88c tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:23:06.329790 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8f1cb738-2eeb-4fcb-ae98-044ce48ab88c tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:06.330255 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8f1cb738-2eeb-4fcb-ae98-044ce48ab88c tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:06.331036 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8f1cb738-2eeb-4fcb-ae98-044ce48ab88c tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:06.331458 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8f1cb738-2eeb-4fcb-ae98-044ce48ab88c tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:06.369300 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-8f1cb738-2eeb-4fcb-ae98-044ce48ab88c tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049854 Nov 01 01:23:06.369870 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 404/749] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:23:06 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:23:06.690482 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-0c5b057b-1cfe-4d1e-ae83-4ab891972a69 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:23:06.691118 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-0c5b057b-1cfe-4d1e-ae83-4ab891972a69 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:23:06.696920 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0c5b057b-1cfe-4d1e-ae83-4ab891972a69 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:06.697360 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0c5b057b-1cfe-4d1e-ae83-4ab891972a69 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:06.698210 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0c5b057b-1cfe-4d1e-ae83-4ab891972a69 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:06.698551 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0c5b057b-1cfe-4d1e-ae83-4ab891972a69 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:06.816352 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-0c5b057b-1cfe-4d1e-ae83-4ab891972a69 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:23:06.823521 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-0c5b057b-1cfe-4d1e-ae83-4ab891972a69 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1259 microversion: 2.1 time: 0.136673 Nov 01 01:23:06.824078 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 346/750] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:23:06 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1259 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:23:07.114917 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-7672fd42-a21a-44b7-a17e-82825c7537f0 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:23:07.115512 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-7672fd42-a21a-44b7-a17e-82825c7537f0 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:23:07.121552 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7672fd42-a21a-44b7-a17e-82825c7537f0 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:07.122045 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7672fd42-a21a-44b7-a17e-82825c7537f0 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:07.122836 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7672fd42-a21a-44b7-a17e-82825c7537f0 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:07.123257 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7672fd42-a21a-44b7-a17e-82825c7537f0 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:07.243318 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-7672fd42-a21a-44b7-a17e-82825c7537f0 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:23:07.250670 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-7672fd42-a21a-44b7-a17e-82825c7537f0 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.140159 Nov 01 01:23:07.251244 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 405/751] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:23:07 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:23:07.380783 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-c1834d40-b9e8-4c1d-8d55-bda4258bef75 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:23:07.381699 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-c1834d40-b9e8-4c1d-8d55-bda4258bef75 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:23:07.387903 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c1834d40-b9e8-4c1d-8d55-bda4258bef75 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:07.388342 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c1834d40-b9e8-4c1d-8d55-bda4258bef75 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:07.389093 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c1834d40-b9e8-4c1d-8d55-bda4258bef75 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:07.389517 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c1834d40-b9e8-4c1d-8d55-bda4258bef75 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:07.418561 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-c1834d40-b9e8-4c1d-8d55-bda4258bef75 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041541 Nov 01 01:23:07.419094 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 347/752] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:23:07 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:23:07.840069 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-3af41a67-6afb-45ec-a107-40d732986cbe tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:23:07.840664 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-3af41a67-6afb-45ec-a107-40d732986cbe tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:23:07.846375 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3af41a67-6afb-45ec-a107-40d732986cbe tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:07.846840 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3af41a67-6afb-45ec-a107-40d732986cbe tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:07.847586 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3af41a67-6afb-45ec-a107-40d732986cbe tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:07.848039 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3af41a67-6afb-45ec-a107-40d732986cbe tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:07.967971 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-3af41a67-6afb-45ec-a107-40d732986cbe tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:23:07.975333 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-3af41a67-6afb-45ec-a107-40d732986cbe tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1259 microversion: 2.1 time: 0.138814 Nov 01 01:23:07.975876 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 406/753] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:23:07 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1259 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:23:08.267488 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-5ebfd594-fd94-46df-be8a-c5fcf22261f9 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:23:08.268026 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-5ebfd594-fd94-46df-be8a-c5fcf22261f9 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:23:08.273838 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-5ebfd594-fd94-46df-be8a-c5fcf22261f9 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:08.281468 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-5ebfd594-fd94-46df-be8a-c5fcf22261f9 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:08.281468 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-5ebfd594-fd94-46df-be8a-c5fcf22261f9 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:08.281468 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-5ebfd594-fd94-46df-be8a-c5fcf22261f9 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:08.399209 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-5ebfd594-fd94-46df-be8a-c5fcf22261f9 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:23:08.406351 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-5ebfd594-fd94-46df-be8a-c5fcf22261f9 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.142582 Nov 01 01:23:08.406946 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 348/754] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:23:08 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:23:08.429852 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-ff1e624f-455b-4c8d-a730-6a8aaf2c3857 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:23:08.430772 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-ff1e624f-455b-4c8d-a730-6a8aaf2c3857 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:23:08.436853 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ff1e624f-455b-4c8d-a730-6a8aaf2c3857 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:08.437292 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ff1e624f-455b-4c8d-a730-6a8aaf2c3857 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:08.438042 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ff1e624f-455b-4c8d-a730-6a8aaf2c3857 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:08.438492 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ff1e624f-455b-4c8d-a730-6a8aaf2c3857 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:08.466672 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-ff1e624f-455b-4c8d-a730-6a8aaf2c3857 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040952 Nov 01 01:23:08.467209 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 407/755] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:23:08 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:23:08.991786 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-517c5290-bb24-4e30-b545-d2633ebee74c tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:23:08.992396 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-517c5290-bb24-4e30-b545-d2633ebee74c tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:23:08.998142 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-517c5290-bb24-4e30-b545-d2633ebee74c tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:09.004828 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-517c5290-bb24-4e30-b545-d2633ebee74c tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:09.004828 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-517c5290-bb24-4e30-b545-d2633ebee74c tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:09.004828 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-517c5290-bb24-4e30-b545-d2633ebee74c tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:09.120227 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-517c5290-bb24-4e30-b545-d2633ebee74c tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:23:09.127454 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-517c5290-bb24-4e30-b545-d2633ebee74c tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1259 microversion: 2.1 time: 0.140080 Nov 01 01:23:09.128039 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 349/756] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:23:08 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1259 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:23:09.423739 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-613d1920-bfea-45a3-a50f-bc5c01459243 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:23:09.424348 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-613d1920-bfea-45a3-a50f-bc5c01459243 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:23:09.430175 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-613d1920-bfea-45a3-a50f-bc5c01459243 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:09.430764 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-613d1920-bfea-45a3-a50f-bc5c01459243 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:09.431389 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-613d1920-bfea-45a3-a50f-bc5c01459243 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:09.431814 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-613d1920-bfea-45a3-a50f-bc5c01459243 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:09.476906 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-8f4a8288-e1e4-436c-b5c7-05aa328f66e0 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:23:09.477810 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-8f4a8288-e1e4-436c-b5c7-05aa328f66e0 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:23:09.483677 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8f4a8288-e1e4-436c-b5c7-05aa328f66e0 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:09.484113 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8f4a8288-e1e4-436c-b5c7-05aa328f66e0 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:09.484858 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8f4a8288-e1e4-436c-b5c7-05aa328f66e0 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:09.485282 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8f4a8288-e1e4-436c-b5c7-05aa328f66e0 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:09.514161 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-8f4a8288-e1e4-436c-b5c7-05aa328f66e0 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040915 Nov 01 01:23:09.514745 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 350/757] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:23:09 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 01 01:23:09.549890 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-613d1920-bfea-45a3-a50f-bc5c01459243 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:23:09.557050 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-613d1920-bfea-45a3-a50f-bc5c01459243 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.136934 Nov 01 01:23:09.557604 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 408/758] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:23:09 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:23:10.144236 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-e18d1c04-b8cc-413b-bf11-1de2b17b7640 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:23:10.144759 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-e18d1c04-b8cc-413b-bf11-1de2b17b7640 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:23:10.150598 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e18d1c04-b8cc-413b-bf11-1de2b17b7640 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:10.151034 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e18d1c04-b8cc-413b-bf11-1de2b17b7640 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:10.151780 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e18d1c04-b8cc-413b-bf11-1de2b17b7640 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:10.152198 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e18d1c04-b8cc-413b-bf11-1de2b17b7640 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:10.275599 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-e18d1c04-b8cc-413b-bf11-1de2b17b7640 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:23:10.282850 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-e18d1c04-b8cc-413b-bf11-1de2b17b7640 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1259 microversion: 2.1 time: 0.142241 Nov 01 01:23:10.283416 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 351/759] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:23:10 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1259 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:23:10.525472 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-47d87a90-0698-45d3-8256-853299ed20f1 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:23:10.526411 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-47d87a90-0698-45d3-8256-853299ed20f1 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:23:10.532613 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-47d87a90-0698-45d3-8256-853299ed20f1 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:10.533055 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-47d87a90-0698-45d3-8256-853299ed20f1 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:10.533809 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-47d87a90-0698-45d3-8256-853299ed20f1 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:10.534239 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-47d87a90-0698-45d3-8256-853299ed20f1 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:10.562297 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-47d87a90-0698-45d3-8256-853299ed20f1 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040618 Nov 01 01:23:10.562865 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 409/760] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:23:10 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:23:10.572589 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-a23777bd-dd13-448d-b293-7955b16451b5 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:23:10.573203 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-a23777bd-dd13-448d-b293-7955b16451b5 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:23:10.579749 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a23777bd-dd13-448d-b293-7955b16451b5 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:10.580876 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a23777bd-dd13-448d-b293-7955b16451b5 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:10.581071 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a23777bd-dd13-448d-b293-7955b16451b5 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:10.582009 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a23777bd-dd13-448d-b293-7955b16451b5 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:10.705831 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-a23777bd-dd13-448d-b293-7955b16451b5 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:23:10.713599 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-a23777bd-dd13-448d-b293-7955b16451b5 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.144594 Nov 01 01:23:10.714158 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 352/761] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:23:10 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:23:11.298742 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-8db9716c-2a9e-4c52-a1ce-0505e0bc1b67 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:23:11.299351 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-8db9716c-2a9e-4c52-a1ce-0505e0bc1b67 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:23:11.305788 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8db9716c-2a9e-4c52-a1ce-0505e0bc1b67 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:11.306225 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8db9716c-2a9e-4c52-a1ce-0505e0bc1b67 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:11.307047 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8db9716c-2a9e-4c52-a1ce-0505e0bc1b67 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:11.307472 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8db9716c-2a9e-4c52-a1ce-0505e0bc1b67 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:11.425035 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-8db9716c-2a9e-4c52-a1ce-0505e0bc1b67 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:23:11.432716 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-8db9716c-2a9e-4c52-a1ce-0505e0bc1b67 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1259 microversion: 2.1 time: 0.137629 Nov 01 01:23:11.433270 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 410/762] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:23:11 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1259 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:23:11.572947 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-39e0ec15-6633-4cb8-a028-3d346cc512d6 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:23:11.573812 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-39e0ec15-6633-4cb8-a028-3d346cc512d6 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:23:11.580225 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-39e0ec15-6633-4cb8-a028-3d346cc512d6 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:11.580665 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-39e0ec15-6633-4cb8-a028-3d346cc512d6 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:11.581415 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-39e0ec15-6633-4cb8-a028-3d346cc512d6 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:11.581836 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-39e0ec15-6633-4cb8-a028-3d346cc512d6 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:11.610483 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-39e0ec15-6633-4cb8-a028-3d346cc512d6 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041303 Nov 01 01:23:11.611031 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 353/763] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:23:11 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:23:11.730027 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-b1a12d48-e21f-41c3-97d5-f39ae8018266 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:23:11.730650 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-b1a12d48-e21f-41c3-97d5-f39ae8018266 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:23:11.736877 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b1a12d48-e21f-41c3-97d5-f39ae8018266 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:11.737585 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b1a12d48-e21f-41c3-97d5-f39ae8018266 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:11.738360 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b1a12d48-e21f-41c3-97d5-f39ae8018266 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:11.739354 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b1a12d48-e21f-41c3-97d5-f39ae8018266 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:11.856408 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-b1a12d48-e21f-41c3-97d5-f39ae8018266 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:23:11.863945 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-b1a12d48-e21f-41c3-97d5-f39ae8018266 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.137576 Nov 01 01:23:11.864499 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 411/764] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:23:11 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:23:12.449581 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-5bc42101-7b97-483b-b7f5-7feccd5e5dc8 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:23:12.450184 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-5bc42101-7b97-483b-b7f5-7feccd5e5dc8 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:23:12.456010 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-5bc42101-7b97-483b-b7f5-7feccd5e5dc8 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:12.456451 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-5bc42101-7b97-483b-b7f5-7feccd5e5dc8 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:12.457802 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-5bc42101-7b97-483b-b7f5-7feccd5e5dc8 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:12.458229 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-5bc42101-7b97-483b-b7f5-7feccd5e5dc8 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:12.576988 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-5bc42101-7b97-483b-b7f5-7feccd5e5dc8 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:23:12.585311 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-5bc42101-7b97-483b-b7f5-7feccd5e5dc8 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1259 microversion: 2.1 time: 0.139432 Nov 01 01:23:12.585864 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 354/765] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:23:12 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1259 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:23:12.622537 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-e8e8538b-bcc3-4872-b25d-81e267ff5e22 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:23:12.623376 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-e8e8538b-bcc3-4872-b25d-81e267ff5e22 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:23:12.629716 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e8e8538b-bcc3-4872-b25d-81e267ff5e22 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:12.630155 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e8e8538b-bcc3-4872-b25d-81e267ff5e22 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:12.630929 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e8e8538b-bcc3-4872-b25d-81e267ff5e22 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:12.631357 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e8e8538b-bcc3-4872-b25d-81e267ff5e22 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:12.658396 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-e8e8538b-bcc3-4872-b25d-81e267ff5e22 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039675 Nov 01 01:23:12.658951 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 412/766] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:23:12 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:23:12.879933 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-0486385e-fa22-4292-9750-33940a20ea27 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:23:12.880463 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-0486385e-fa22-4292-9750-33940a20ea27 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:23:12.886309 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0486385e-fa22-4292-9750-33940a20ea27 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:12.886781 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0486385e-fa22-4292-9750-33940a20ea27 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:12.887537 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0486385e-fa22-4292-9750-33940a20ea27 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:12.887961 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0486385e-fa22-4292-9750-33940a20ea27 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:13.012115 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-0486385e-fa22-4292-9750-33940a20ea27 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:23:13.019921 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-0486385e-fa22-4292-9750-33940a20ea27 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.144094 Nov 01 01:23:13.020473 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 355/767] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:23:12 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:23:13.602200 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-a50bda4f-654f-4e28-a802-07e99e0d1031 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:23:13.602866 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-a50bda4f-654f-4e28-a802-07e99e0d1031 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:23:13.609046 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a50bda4f-654f-4e28-a802-07e99e0d1031 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:13.609488 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a50bda4f-654f-4e28-a802-07e99e0d1031 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:13.610246 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a50bda4f-654f-4e28-a802-07e99e0d1031 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:13.610705 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a50bda4f-654f-4e28-a802-07e99e0d1031 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:13.668953 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-11d3dad5-8dc9-4f2f-bbe8-3e945068a637 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:23:13.669955 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-11d3dad5-8dc9-4f2f-bbe8-3e945068a637 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:23:13.676430 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-11d3dad5-8dc9-4f2f-bbe8-3e945068a637 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:13.676935 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-11d3dad5-8dc9-4f2f-bbe8-3e945068a637 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:13.677759 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-11d3dad5-8dc9-4f2f-bbe8-3e945068a637 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:13.678273 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-11d3dad5-8dc9-4f2f-bbe8-3e945068a637 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:13.708574 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-11d3dad5-8dc9-4f2f-bbe8-3e945068a637 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043299 Nov 01 01:23:13.709210 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 356/768] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:23:13 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 01 01:23:13.730009 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-a50bda4f-654f-4e28-a802-07e99e0d1031 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:23:13.737465 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-a50bda4f-654f-4e28-a802-07e99e0d1031 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1259 microversion: 2.1 time: 0.139349 Nov 01 01:23:13.738043 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 413/769] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:23:13 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1259 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:23:14.037068 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-93f5b8ea-e933-4921-beeb-92b49bd611d5 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:23:14.041064 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-93f5b8ea-e933-4921-beeb-92b49bd611d5 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:23:14.043380 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-93f5b8ea-e933-4921-beeb-92b49bd611d5 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:14.043816 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-93f5b8ea-e933-4921-beeb-92b49bd611d5 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:14.044568 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-93f5b8ea-e933-4921-beeb-92b49bd611d5 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:14.044995 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-93f5b8ea-e933-4921-beeb-92b49bd611d5 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:14.168009 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-93f5b8ea-e933-4921-beeb-92b49bd611d5 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:23:14.175128 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-93f5b8ea-e933-4921-beeb-92b49bd611d5 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.142436 Nov 01 01:23:14.175688 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 357/770] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:23:14 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:23:14.719980 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-55d64578-3aca-44cd-b636-eceef82a81bc tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:23:14.720877 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-55d64578-3aca-44cd-b636-eceef82a81bc tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:23:14.726865 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-55d64578-3aca-44cd-b636-eceef82a81bc tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:14.727303 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-55d64578-3aca-44cd-b636-eceef82a81bc tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:14.728053 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-55d64578-3aca-44cd-b636-eceef82a81bc tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:14.728477 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-55d64578-3aca-44cd-b636-eceef82a81bc tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:14.754666 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-caabaeb3-fb33-4827-889b-29914bc11e8d tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:23:14.755277 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-caabaeb3-fb33-4827-889b-29914bc11e8d tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:23:14.756734 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-55d64578-3aca-44cd-b636-eceef82a81bc tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040501 Nov 01 01:23:14.757278 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 414/771] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:23:14 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:23:14.761490 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-caabaeb3-fb33-4827-889b-29914bc11e8d tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:14.761936 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-caabaeb3-fb33-4827-889b-29914bc11e8d tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:14.762750 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-caabaeb3-fb33-4827-889b-29914bc11e8d tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:14.763179 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-caabaeb3-fb33-4827-889b-29914bc11e8d tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:14.880430 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-caabaeb3-fb33-4827-889b-29914bc11e8d tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:23:14.891120 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-caabaeb3-fb33-4827-889b-29914bc11e8d tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1259 microversion: 2.1 time: 0.140504 Nov 01 01:23:14.891685 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 358/772] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:23:14 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1259 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:23:15.192332 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-c615b309-7db9-4379-8f6c-9dca660d1826 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:23:15.192944 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-c615b309-7db9-4379-8f6c-9dca660d1826 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:23:15.199132 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c615b309-7db9-4379-8f6c-9dca660d1826 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:15.199559 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c615b309-7db9-4379-8f6c-9dca660d1826 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:15.200323 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c615b309-7db9-4379-8f6c-9dca660d1826 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:15.200756 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c615b309-7db9-4379-8f6c-9dca660d1826 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:15.317872 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-c615b309-7db9-4379-8f6c-9dca660d1826 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:23:15.325060 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-c615b309-7db9-4379-8f6c-9dca660d1826 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.136969 Nov 01 01:23:15.325639 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 415/773] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:23:15 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:23:15.767961 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-e5854042-9622-4776-920b-8f64e624e5ef tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:23:15.768894 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-e5854042-9622-4776-920b-8f64e624e5ef tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:23:15.775067 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e5854042-9622-4776-920b-8f64e624e5ef tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:15.775503 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e5854042-9622-4776-920b-8f64e624e5ef tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:15.776246 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e5854042-9622-4776-920b-8f64e624e5ef tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:15.776668 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e5854042-9622-4776-920b-8f64e624e5ef tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:15.804718 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-e5854042-9622-4776-920b-8f64e624e5ef tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040507 Nov 01 01:23:15.805247 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 359/774] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:23:15 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:23:15.906625 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-e54806a2-3b9c-4149-92c6-b5944644ac14 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:23:15.907260 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-e54806a2-3b9c-4149-92c6-b5944644ac14 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:23:15.913593 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e54806a2-3b9c-4149-92c6-b5944644ac14 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:15.914039 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e54806a2-3b9c-4149-92c6-b5944644ac14 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:15.914836 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e54806a2-3b9c-4149-92c6-b5944644ac14 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:15.915264 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e54806a2-3b9c-4149-92c6-b5944644ac14 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:16.037253 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-e54806a2-3b9c-4149-92c6-b5944644ac14 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:23:16.044763 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-e54806a2-3b9c-4149-92c6-b5944644ac14 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1259 microversion: 2.1 time: 0.141603 Nov 01 01:23:16.045333 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 416/775] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:23:15 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1259 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:23:16.341758 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-4400e596-3263-42a0-b68c-901721315bb1 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:23:16.342379 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-4400e596-3263-42a0-b68c-901721315bb1 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:23:16.348851 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4400e596-3263-42a0-b68c-901721315bb1 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:16.349286 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4400e596-3263-42a0-b68c-901721315bb1 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:16.350047 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4400e596-3263-42a0-b68c-901721315bb1 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:16.350485 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4400e596-3263-42a0-b68c-901721315bb1 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:16.470777 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-4400e596-3263-42a0-b68c-901721315bb1 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:23:16.478603 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-4400e596-3263-42a0-b68c-901721315bb1 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.140622 Nov 01 01:23:16.479161 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 360/776] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:23:16 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:23:16.815983 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-4b359698-42b0-41ce-9e85-4a78d2125696 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:23:16.817497 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-4b359698-42b0-41ce-9e85-4a78d2125696 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:23:16.823277 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4b359698-42b0-41ce-9e85-4a78d2125696 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:16.823721 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4b359698-42b0-41ce-9e85-4a78d2125696 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:16.824475 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4b359698-42b0-41ce-9e85-4a78d2125696 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:16.824902 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4b359698-42b0-41ce-9e85-4a78d2125696 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:16.853069 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-4b359698-42b0-41ce-9e85-4a78d2125696 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040867 Nov 01 01:23:16.861137 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 417/777] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:23:16 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 01 01:23:17.060610 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-7a3c279c-a92a-4518-817b-37b43a8f797b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:23:17.063229 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-7a3c279c-a92a-4518-817b-37b43a8f797b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:23:17.068011 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-7a3c279c-a92a-4518-817b-37b43a8f797b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:17.068491 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-7a3c279c-a92a-4518-817b-37b43a8f797b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:17.069242 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-7a3c279c-a92a-4518-817b-37b43a8f797b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:17.069666 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-7a3c279c-a92a-4518-817b-37b43a8f797b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:17.187055 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-7a3c279c-a92a-4518-817b-37b43a8f797b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:23:17.195741 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-7a3c279c-a92a-4518-817b-37b43a8f797b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1259 microversion: 2.1 time: 0.138703 Nov 01 01:23:17.196307 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 361/778] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:23:17 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1259 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:23:17.496227 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-3b974def-80e0-4bd6-bddb-24ace8be5f90 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:23:17.496839 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-3b974def-80e0-4bd6-bddb-24ace8be5f90 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:23:17.503068 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3b974def-80e0-4bd6-bddb-24ace8be5f90 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:17.503509 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3b974def-80e0-4bd6-bddb-24ace8be5f90 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:17.504269 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3b974def-80e0-4bd6-bddb-24ace8be5f90 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:17.504696 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3b974def-80e0-4bd6-bddb-24ace8be5f90 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:17.625170 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-3b974def-80e0-4bd6-bddb-24ace8be5f90 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:23:17.632274 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-3b974def-80e0-4bd6-bddb-24ace8be5f90 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.139652 Nov 01 01:23:17.632828 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 418/779] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:23:17 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:23:17.870895 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-215e07da-a3c7-455c-81a6-2289117d1f67 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:23:17.871731 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-215e07da-a3c7-455c-81a6-2289117d1f67 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:23:17.877612 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-215e07da-a3c7-455c-81a6-2289117d1f67 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:17.878063 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-215e07da-a3c7-455c-81a6-2289117d1f67 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:17.878865 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-215e07da-a3c7-455c-81a6-2289117d1f67 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:17.879292 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-215e07da-a3c7-455c-81a6-2289117d1f67 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:17.907572 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-215e07da-a3c7-455c-81a6-2289117d1f67 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040533 Nov 01 01:23:17.908113 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 362/780] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:23:17 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:23:18.212593 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-f918eaea-dda8-4c48-a7ae-23a241eaa9c9 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:23:18.213194 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-f918eaea-dda8-4c48-a7ae-23a241eaa9c9 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:23:18.218935 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f918eaea-dda8-4c48-a7ae-23a241eaa9c9 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:18.219368 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f918eaea-dda8-4c48-a7ae-23a241eaa9c9 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:18.220129 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f918eaea-dda8-4c48-a7ae-23a241eaa9c9 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:18.220553 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f918eaea-dda8-4c48-a7ae-23a241eaa9c9 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:18.339161 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-f918eaea-dda8-4c48-a7ae-23a241eaa9c9 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:23:18.346694 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-f918eaea-dda8-4c48-a7ae-23a241eaa9c9 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1259 microversion: 2.1 time: 0.137691 Nov 01 01:23:18.347466 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 419/781] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:23:18 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1259 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:23:18.648824 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-08f403d3-e597-463a-a9da-d3ccf898bb64 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:23:18.649350 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-08f403d3-e597-463a-a9da-d3ccf898bb64 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:23:18.655565 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-08f403d3-e597-463a-a9da-d3ccf898bb64 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:18.656008 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-08f403d3-e597-463a-a9da-d3ccf898bb64 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:18.656766 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-08f403d3-e597-463a-a9da-d3ccf898bb64 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:18.657195 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-08f403d3-e597-463a-a9da-d3ccf898bb64 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:18.773544 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-08f403d3-e597-463a-a9da-d3ccf898bb64 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:23:18.780775 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-08f403d3-e597-463a-a9da-d3ccf898bb64 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.135683 Nov 01 01:23:18.781336 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 363/782] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:23:18 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:23:18.919110 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-96dba3b3-1415-4676-b9c5-f060a8612b9d tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:23:18.919958 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-96dba3b3-1415-4676-b9c5-f060a8612b9d tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:23:18.926709 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-96dba3b3-1415-4676-b9c5-f060a8612b9d tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:18.927154 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-96dba3b3-1415-4676-b9c5-f060a8612b9d tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:18.927908 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-96dba3b3-1415-4676-b9c5-f060a8612b9d tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:18.928335 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-96dba3b3-1415-4676-b9c5-f060a8612b9d tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:18.956761 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-96dba3b3-1415-4676-b9c5-f060a8612b9d tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041380 Nov 01 01:23:18.957295 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 420/783] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:23:18 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 01 01:23:19.363205 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-434b0200-0727-4e7c-bcde-fe25058c2f8d tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:23:19.363808 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-434b0200-0727-4e7c-bcde-fe25058c2f8d tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:23:19.369591 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-434b0200-0727-4e7c-bcde-fe25058c2f8d tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:19.370028 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-434b0200-0727-4e7c-bcde-fe25058c2f8d tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:19.370818 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-434b0200-0727-4e7c-bcde-fe25058c2f8d tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:19.371241 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-434b0200-0727-4e7c-bcde-fe25058c2f8d tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:19.491100 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-434b0200-0727-4e7c-bcde-fe25058c2f8d tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:23:19.498127 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-434b0200-0727-4e7c-bcde-fe25058c2f8d tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1259 microversion: 2.1 time: 0.138802 Nov 01 01:23:19.498709 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 364/784] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:23:19 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1259 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:23:19.797907 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-2e1df924-913b-4629-ac12-cf8864b5db97 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:23:19.798541 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-2e1df924-913b-4629-ac12-cf8864b5db97 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:23:19.804328 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2e1df924-913b-4629-ac12-cf8864b5db97 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:19.804766 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2e1df924-913b-4629-ac12-cf8864b5db97 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:19.805510 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2e1df924-913b-4629-ac12-cf8864b5db97 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:19.805931 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2e1df924-913b-4629-ac12-cf8864b5db97 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:19.926412 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-2e1df924-913b-4629-ac12-cf8864b5db97 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:23:19.933943 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-2e1df924-913b-4629-ac12-cf8864b5db97 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.139712 Nov 01 01:23:19.935164 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 421/785] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:23:19 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:23:19.968005 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-8ac8b91d-822c-49e1-a96c-f2ddb7205f64 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:23:19.969459 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-8ac8b91d-822c-49e1-a96c-f2ddb7205f64 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:23:19.976691 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8ac8b91d-822c-49e1-a96c-f2ddb7205f64 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:19.977350 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8ac8b91d-822c-49e1-a96c-f2ddb7205f64 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:19.978307 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8ac8b91d-822c-49e1-a96c-f2ddb7205f64 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:19.978915 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8ac8b91d-822c-49e1-a96c-f2ddb7205f64 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:20.009356 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-8ac8b91d-822c-49e1-a96c-f2ddb7205f64 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045126 Nov 01 01:23:20.010092 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 365/786] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:23:19 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:23:20.513621 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-615f0bd3-83e9-4496-a00f-63d51e7fa3b6 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:23:20.514217 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-615f0bd3-83e9-4496-a00f-63d51e7fa3b6 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:23:20.519864 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-615f0bd3-83e9-4496-a00f-63d51e7fa3b6 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:20.520316 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-615f0bd3-83e9-4496-a00f-63d51e7fa3b6 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:20.521051 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-615f0bd3-83e9-4496-a00f-63d51e7fa3b6 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:20.521495 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-615f0bd3-83e9-4496-a00f-63d51e7fa3b6 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:20.638003 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-615f0bd3-83e9-4496-a00f-63d51e7fa3b6 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:23:20.645183 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-615f0bd3-83e9-4496-a00f-63d51e7fa3b6 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1259 microversion: 2.1 time: 0.135115 Nov 01 01:23:20.645741 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 422/787] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:23:20 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1259 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:23:20.951527 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-279b7c9f-2ad9-4e06-9972-5b86a79f6e01 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:23:20.952184 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-279b7c9f-2ad9-4e06-9972-5b86a79f6e01 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:23:20.959515 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-279b7c9f-2ad9-4e06-9972-5b86a79f6e01 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:20.959955 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-279b7c9f-2ad9-4e06-9972-5b86a79f6e01 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:20.960700 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-279b7c9f-2ad9-4e06-9972-5b86a79f6e01 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:20.961119 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-279b7c9f-2ad9-4e06-9972-5b86a79f6e01 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:21.020748 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-7185f4ff-b486-454e-97e2-9ff3aadf94ef tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:23:21.021661 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-7185f4ff-b486-454e-97e2-9ff3aadf94ef tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:23:21.028123 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7185f4ff-b486-454e-97e2-9ff3aadf94ef tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:21.028692 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7185f4ff-b486-454e-97e2-9ff3aadf94ef tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:21.029519 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7185f4ff-b486-454e-97e2-9ff3aadf94ef tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:21.029947 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7185f4ff-b486-454e-97e2-9ff3aadf94ef tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:21.059872 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-7185f4ff-b486-454e-97e2-9ff3aadf94ef tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042801 Nov 01 01:23:21.060433 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 423/788] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:23:21 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 01 01:23:21.084471 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-279b7c9f-2ad9-4e06-9972-5b86a79f6e01 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:23:21.091782 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-279b7c9f-2ad9-4e06-9972-5b86a79f6e01 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.143844 Nov 01 01:23:21.092392 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 366/789] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:23:20 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:23:21.661605 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-4c43a1e9-b929-48aa-ad11-07b059bd8827 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:23:21.662118 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-4c43a1e9-b929-48aa-ad11-07b059bd8827 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:23:21.667900 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4c43a1e9-b929-48aa-ad11-07b059bd8827 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:21.668343 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4c43a1e9-b929-48aa-ad11-07b059bd8827 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:21.669098 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4c43a1e9-b929-48aa-ad11-07b059bd8827 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:21.669524 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4c43a1e9-b929-48aa-ad11-07b059bd8827 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:21.786827 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-4c43a1e9-b929-48aa-ad11-07b059bd8827 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:23:21.793944 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-4c43a1e9-b929-48aa-ad11-07b059bd8827 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1259 microversion: 2.1 time: 0.136735 Nov 01 01:23:21.794517 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 424/790] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:23:21 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1259 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:23:22.071857 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-bc4e1dfb-c54b-40af-aeb0-2dbdd1e5e7f1 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:23:22.072772 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-bc4e1dfb-c54b-40af-aeb0-2dbdd1e5e7f1 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:23:22.079322 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-bc4e1dfb-c54b-40af-aeb0-2dbdd1e5e7f1 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:22.079834 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-bc4e1dfb-c54b-40af-aeb0-2dbdd1e5e7f1 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:22.080588 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-bc4e1dfb-c54b-40af-aeb0-2dbdd1e5e7f1 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:22.081016 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-bc4e1dfb-c54b-40af-aeb0-2dbdd1e5e7f1 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:22.108501 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-ed24ae56-6caf-4d9d-89ec-04782369a5c2 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:23:22.109226 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-ed24ae56-6caf-4d9d-89ec-04782369a5c2 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:23:22.109803 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-bc4e1dfb-c54b-40af-aeb0-2dbdd1e5e7f1 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041716 Nov 01 01:23:22.110365 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 367/791] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:23:22 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:23:22.115786 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ed24ae56-6caf-4d9d-89ec-04782369a5c2 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:22.116222 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ed24ae56-6caf-4d9d-89ec-04782369a5c2 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:22.116977 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ed24ae56-6caf-4d9d-89ec-04782369a5c2 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:22.117417 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ed24ae56-6caf-4d9d-89ec-04782369a5c2 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:22.233780 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-ed24ae56-6caf-4d9d-89ec-04782369a5c2 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:23:22.241098 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-ed24ae56-6caf-4d9d-89ec-04782369a5c2 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.136363 Nov 01 01:23:22.241652 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 425/792] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:23:22 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:23:22.810335 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-71fe99ca-7d79-4d90-856e-d7e61c8035fc tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:23:22.810890 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-71fe99ca-7d79-4d90-856e-d7e61c8035fc tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:23:22.816668 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-71fe99ca-7d79-4d90-856e-d7e61c8035fc tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:22.817103 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-71fe99ca-7d79-4d90-856e-d7e61c8035fc tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:22.817849 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-71fe99ca-7d79-4d90-856e-d7e61c8035fc tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:22.818267 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-71fe99ca-7d79-4d90-856e-d7e61c8035fc tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:22.937319 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-71fe99ca-7d79-4d90-856e-d7e61c8035fc tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:23:22.944634 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-71fe99ca-7d79-4d90-856e-d7e61c8035fc tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1259 microversion: 2.1 time: 0.137970 Nov 01 01:23:22.945183 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 368/793] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:23:22 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1259 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:23:23.121078 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-567808f8-29a1-450d-a823-2765af73df2a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:23:23.121882 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-567808f8-29a1-450d-a823-2765af73df2a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:23:23.128099 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-567808f8-29a1-450d-a823-2765af73df2a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:23.128536 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-567808f8-29a1-450d-a823-2765af73df2a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:23.129413 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-567808f8-29a1-450d-a823-2765af73df2a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:23.129831 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-567808f8-29a1-450d-a823-2765af73df2a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:23.157703 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-567808f8-29a1-450d-a823-2765af73df2a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040472 Nov 01 01:23:23.158234 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 426/794] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:23:23 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:23:23.256715 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-bd90ab24-d4f9-4491-9730-32535c7a2a12 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:23:23.257311 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-bd90ab24-d4f9-4491-9730-32535c7a2a12 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:23:23.263526 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-bd90ab24-d4f9-4491-9730-32535c7a2a12 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:23.263967 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-bd90ab24-d4f9-4491-9730-32535c7a2a12 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:23.264711 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-bd90ab24-d4f9-4491-9730-32535c7a2a12 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:23.265132 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-bd90ab24-d4f9-4491-9730-32535c7a2a12 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:23.385140 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-bd90ab24-d4f9-4491-9730-32535c7a2a12 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:23:23.392406 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-bd90ab24-d4f9-4491-9730-32535c7a2a12 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.139377 Nov 01 01:23:23.392968 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 369/795] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:23:23 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:23:23.960683 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-326b1674-e1f9-4008-8275-180919730906 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:23:23.961277 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-326b1674-e1f9-4008-8275-180919730906 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:23:23.967369 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-326b1674-e1f9-4008-8275-180919730906 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:23.967816 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-326b1674-e1f9-4008-8275-180919730906 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:23.968579 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-326b1674-e1f9-4008-8275-180919730906 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:23.969063 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-326b1674-e1f9-4008-8275-180919730906 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:24.092516 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-326b1674-e1f9-4008-8275-180919730906 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:23:24.099951 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-326b1674-e1f9-4008-8275-180919730906 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1259 microversion: 2.1 time: 0.142836 Nov 01 01:23:24.100706 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 427/796] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:23:23 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1259 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:23:24.168910 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-4eb8d20a-6b8a-4c0f-a4fc-7f779fdd6961 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:23:24.169815 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-4eb8d20a-6b8a-4c0f-a4fc-7f779fdd6961 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:23:24.176148 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4eb8d20a-6b8a-4c0f-a4fc-7f779fdd6961 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:24.176589 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4eb8d20a-6b8a-4c0f-a4fc-7f779fdd6961 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:24.177400 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4eb8d20a-6b8a-4c0f-a4fc-7f779fdd6961 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:24.177826 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4eb8d20a-6b8a-4c0f-a4fc-7f779fdd6961 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:24.207517 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-4eb8d20a-6b8a-4c0f-a4fc-7f779fdd6961 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042292 Nov 01 01:23:24.208264 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 370/797] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:23:24 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:23:24.408902 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-e0bf9aac-6411-4e02-9cf6-795d3b44f37d tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:23:24.413477 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-e0bf9aac-6411-4e02-9cf6-795d3b44f37d tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:23:24.416603 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e0bf9aac-6411-4e02-9cf6-795d3b44f37d tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:24.417048 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e0bf9aac-6411-4e02-9cf6-795d3b44f37d tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:24.417839 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e0bf9aac-6411-4e02-9cf6-795d3b44f37d tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:24.418262 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e0bf9aac-6411-4e02-9cf6-795d3b44f37d tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:24.554035 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-e0bf9aac-6411-4e02-9cf6-795d3b44f37d tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:23:24.561390 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-e0bf9aac-6411-4e02-9cf6-795d3b44f37d tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.156126 Nov 01 01:23:24.561956 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 428/798] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:23:24 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:23:25.116567 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-ca424254-f0d4-4a32-b63e-35e72fa51429 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:23:25.117177 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-ca424254-f0d4-4a32-b63e-35e72fa51429 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:23:25.123337 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ca424254-f0d4-4a32-b63e-35e72fa51429 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:25.123783 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ca424254-f0d4-4a32-b63e-35e72fa51429 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:25.124546 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ca424254-f0d4-4a32-b63e-35e72fa51429 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:25.124977 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ca424254-f0d4-4a32-b63e-35e72fa51429 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:25.218024 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-fe40e832-2a86-47f4-bd97-dd4a09c1bc33 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:23:25.219285 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-fe40e832-2a86-47f4-bd97-dd4a09c1bc33 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:23:25.226274 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-fe40e832-2a86-47f4-bd97-dd4a09c1bc33 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:25.227337 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-fe40e832-2a86-47f4-bd97-dd4a09c1bc33 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:25.228316 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-fe40e832-2a86-47f4-bd97-dd4a09c1bc33 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:25.228969 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-fe40e832-2a86-47f4-bd97-dd4a09c1bc33 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:25.251593 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-ca424254-f0d4-4a32-b63e-35e72fa51429 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:23:25.258183 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-ca424254-f0d4-4a32-b63e-35e72fa51429 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1259 microversion: 2.1 time: 0.145279 Nov 01 01:23:25.258781 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 371/799] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:23:25 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1259 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:23:25.260538 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-fe40e832-2a86-47f4-bd97-dd4a09c1bc33 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046140 Nov 01 01:23:25.261221 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 429/800] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:23:25 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 01 01:23:25.578304 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-9d29670a-bcdb-410e-8123-5055ec3ff3e7 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:23:25.578848 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-9d29670a-bcdb-410e-8123-5055ec3ff3e7 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:23:25.584766 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9d29670a-bcdb-410e-8123-5055ec3ff3e7 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:25.585214 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9d29670a-bcdb-410e-8123-5055ec3ff3e7 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:25.585980 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9d29670a-bcdb-410e-8123-5055ec3ff3e7 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:25.586406 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9d29670a-bcdb-410e-8123-5055ec3ff3e7 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:25.711910 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-9d29670a-bcdb-410e-8123-5055ec3ff3e7 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:23:25.719100 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-9d29670a-bcdb-410e-8123-5055ec3ff3e7 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.144555 Nov 01 01:23:25.719658 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 372/801] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:23:25 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:23:26.272122 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-2458649e-23e1-4ef8-b110-f9fe15df5902 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:23:26.272769 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-2458649e-23e1-4ef8-b110-f9fe15df5902 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:23:26.274974 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-6b63919d-2255-4d14-80d5-cbe0e19c1e55 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:23:26.275587 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-6b63919d-2255-4d14-80d5-cbe0e19c1e55 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:23:26.278943 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2458649e-23e1-4ef8-b110-f9fe15df5902 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:26.279382 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2458649e-23e1-4ef8-b110-f9fe15df5902 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:26.280138 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2458649e-23e1-4ef8-b110-f9fe15df5902 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:26.280560 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2458649e-23e1-4ef8-b110-f9fe15df5902 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:26.281695 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-6b63919d-2255-4d14-80d5-cbe0e19c1e55 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:26.282140 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-6b63919d-2255-4d14-80d5-cbe0e19c1e55 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:26.282938 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-6b63919d-2255-4d14-80d5-cbe0e19c1e55 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:26.283384 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-6b63919d-2255-4d14-80d5-cbe0e19c1e55 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:26.309808 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-2458649e-23e1-4ef8-b110-f9fe15df5902 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042245 Nov 01 01:23:26.310369 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 430/802] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:23:26 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:23:26.408290 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-6b63919d-2255-4d14-80d5-cbe0e19c1e55 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:23:26.416127 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-6b63919d-2255-4d14-80d5-cbe0e19c1e55 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1259 microversion: 2.1 time: 0.144692 Nov 01 01:23:26.416690 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 373/803] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:23:26 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1259 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:23:26.736041 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-7ddb9942-6934-4cb6-88ea-639ecc896a38 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:23:26.736912 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-7ddb9942-6934-4cb6-88ea-639ecc896a38 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:23:26.742651 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7ddb9942-6934-4cb6-88ea-639ecc896a38 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:26.743098 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7ddb9942-6934-4cb6-88ea-639ecc896a38 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:26.743859 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7ddb9942-6934-4cb6-88ea-639ecc896a38 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:26.744290 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7ddb9942-6934-4cb6-88ea-639ecc896a38 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:26.860425 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-7ddb9942-6934-4cb6-88ea-639ecc896a38 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:23:26.868248 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-7ddb9942-6934-4cb6-88ea-639ecc896a38 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.135910 Nov 01 01:23:26.868811 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 431/804] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:23:26 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:23:27.320886 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-2c64ce8a-3f05-4996-96f3-fd335a0cefa9 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:23:27.321882 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-2c64ce8a-3f05-4996-96f3-fd335a0cefa9 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:23:27.328033 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-2c64ce8a-3f05-4996-96f3-fd335a0cefa9 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:27.328474 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-2c64ce8a-3f05-4996-96f3-fd335a0cefa9 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:27.329234 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-2c64ce8a-3f05-4996-96f3-fd335a0cefa9 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:27.329661 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-2c64ce8a-3f05-4996-96f3-fd335a0cefa9 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:27.358337 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-2c64ce8a-3f05-4996-96f3-fd335a0cefa9 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041157 Nov 01 01:23:27.358920 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 374/805] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:23:27 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:23:27.432378 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-34665709-8d35-48ad-9706-8256b49deb3f tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:23:27.433040 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-34665709-8d35-48ad-9706-8256b49deb3f tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:23:27.439227 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-34665709-8d35-48ad-9706-8256b49deb3f tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:27.439671 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-34665709-8d35-48ad-9706-8256b49deb3f tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:27.440428 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-34665709-8d35-48ad-9706-8256b49deb3f tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:27.440854 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-34665709-8d35-48ad-9706-8256b49deb3f tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:27.557571 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-34665709-8d35-48ad-9706-8256b49deb3f tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:23:27.564683 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-34665709-8d35-48ad-9706-8256b49deb3f tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1259 microversion: 2.1 time: 0.135921 Nov 01 01:23:27.565244 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 432/806] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:23:27 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1259 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:23:27.885539 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-a29db526-4f2b-4afa-b583-fcaa30c4e2f7 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:23:27.886132 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-a29db526-4f2b-4afa-b583-fcaa30c4e2f7 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:23:27.892674 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a29db526-4f2b-4afa-b583-fcaa30c4e2f7 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:27.893106 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a29db526-4f2b-4afa-b583-fcaa30c4e2f7 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:27.893861 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a29db526-4f2b-4afa-b583-fcaa30c4e2f7 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:27.894820 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a29db526-4f2b-4afa-b583-fcaa30c4e2f7 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:28.013971 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-a29db526-4f2b-4afa-b583-fcaa30c4e2f7 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:23:28.021751 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-a29db526-4f2b-4afa-b583-fcaa30c4e2f7 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.139873 Nov 01 01:23:28.022313 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 375/807] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:23:27 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:23:28.369913 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-d65443d4-f1e0-4e63-a670-9bcdedc9eb53 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:23:28.370857 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-d65443d4-f1e0-4e63-a670-9bcdedc9eb53 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:23:28.376662 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d65443d4-f1e0-4e63-a670-9bcdedc9eb53 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:28.377135 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d65443d4-f1e0-4e63-a670-9bcdedc9eb53 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:28.377887 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d65443d4-f1e0-4e63-a670-9bcdedc9eb53 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:28.378309 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d65443d4-f1e0-4e63-a670-9bcdedc9eb53 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:28.410261 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-d65443d4-f1e0-4e63-a670-9bcdedc9eb53 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044059 Nov 01 01:23:28.414167 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 433/808] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:23:28 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:23:28.565841 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [req-15bd270b-5a0c-41fe-b493-bf74a62f90b5 req-3dacca60-b11d-4cef-85ca-451dbbe0d7ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7554da88-1726-438a-bed5-4e30d999ba9d", "name": "network-vif-plugged", "status": "completed", "tag": "bebb1bd2-6980-4bbb-a08e-ca30b1d8aac9"}]} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:23:28.567977 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 01 01:23:28.567977 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: warnings.warn(msg) Nov 01 01:23:28.575803 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [req-15bd270b-5a0c-41fe-b493-bf74a62f90b5 req-3dacca60-b11d-4cef-85ca-451dbbe0d7ed service nova] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:28.576239 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [req-15bd270b-5a0c-41fe-b493-bf74a62f90b5 req-3dacca60-b11d-4cef-85ca-451dbbe0d7ed service nova] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:28.580920 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-fe288fe9-ee96-4fd9-84cb-9f5a9aefbb70 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:23:28.581698 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-fe288fe9-ee96-4fd9-84cb-9f5a9aefbb70 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:23:28.587095 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.compute.server_external_events [req-15bd270b-5a0c-41fe-b493-bf74a62f90b5 req-3dacca60-b11d-4cef-85ca-451dbbe0d7ed service nova] Creating event network-vif-plugged:bebb1bd2-6980-4bbb-a08e-ca30b1d8aac9 for instance 7554da88-1726-438a-bed5-4e30d999ba9d on hv-cinder-81561 Nov 01 01:23:28.587876 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-fe288fe9-ee96-4fd9-84cb-9f5a9aefbb70 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:28.588327 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-fe288fe9-ee96-4fd9-84cb-9f5a9aefbb70 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:28.589093 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-fe288fe9-ee96-4fd9-84cb-9f5a9aefbb70 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:28.589529 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-fe288fe9-ee96-4fd9-84cb-9f5a9aefbb70 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:28.596883 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [req-15bd270b-5a0c-41fe-b493-bf74a62f90b5 req-3dacca60-b11d-4cef-85ca-451dbbe0d7ed service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088484 Nov 01 01:23:28.597983 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 376/809] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Nov 1 01:23:28 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:23:28.711157 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-fe288fe9-ee96-4fd9-84cb-9f5a9aefbb70 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:23:28.718393 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-fe288fe9-ee96-4fd9-84cb-9f5a9aefbb70 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1259 microversion: 2.1 time: 0.141184 Nov 01 01:23:28.718985 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 434/810] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:23:28 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1259 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:23:29.039457 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-67fd2ee9-7aac-4d96-b21e-fcda8322d0a8 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:23:29.040181 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-67fd2ee9-7aac-4d96-b21e-fcda8322d0a8 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:23:29.046243 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-67fd2ee9-7aac-4d96-b21e-fcda8322d0a8 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:29.046714 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-67fd2ee9-7aac-4d96-b21e-fcda8322d0a8 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:29.047461 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-67fd2ee9-7aac-4d96-b21e-fcda8322d0a8 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:29.047892 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-67fd2ee9-7aac-4d96-b21e-fcda8322d0a8 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:29.166234 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-67fd2ee9-7aac-4d96-b21e-fcda8322d0a8 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:23:29.173357 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-67fd2ee9-7aac-4d96-b21e-fcda8322d0a8 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.138404 Nov 01 01:23:29.173916 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 377/811] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:23:29 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:23:29.421706 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-5dfea78b-42d6-41ca-8165-4d4c76450c0c tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:23:29.422588 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-5dfea78b-42d6-41ca-8165-4d4c76450c0c tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:23:29.428440 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5dfea78b-42d6-41ca-8165-4d4c76450c0c tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:29.428884 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5dfea78b-42d6-41ca-8165-4d4c76450c0c tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:29.429636 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5dfea78b-42d6-41ca-8165-4d4c76450c0c tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:29.430063 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5dfea78b-42d6-41ca-8165-4d4c76450c0c tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:29.458407 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-5dfea78b-42d6-41ca-8165-4d4c76450c0c tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040487 Nov 01 01:23:29.458982 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 435/812] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:23:29 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:23:29.735585 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-ed5a297f-0a93-42e7-bbbb-288f71e54304 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:23:29.736193 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-ed5a297f-0a93-42e7-bbbb-288f71e54304 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:23:29.742734 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ed5a297f-0a93-42e7-bbbb-288f71e54304 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:29.743174 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ed5a297f-0a93-42e7-bbbb-288f71e54304 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:29.743927 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ed5a297f-0a93-42e7-bbbb-288f71e54304 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:29.744356 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ed5a297f-0a93-42e7-bbbb-288f71e54304 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:29.866770 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-ed5a297f-0a93-42e7-bbbb-288f71e54304 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:23:29.874068 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-ed5a297f-0a93-42e7-bbbb-288f71e54304 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1259 microversion: 2.1 time: 0.142093 Nov 01 01:23:29.874646 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 378/813] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:23:29 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1259 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:23:30.188922 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-c05ee4a1-2a5e-43ee-9de5-120f2452becc tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:23:30.189548 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-c05ee4a1-2a5e-43ee-9de5-120f2452becc tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:23:30.196449 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c05ee4a1-2a5e-43ee-9de5-120f2452becc tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:30.196886 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c05ee4a1-2a5e-43ee-9de5-120f2452becc tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:30.197667 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c05ee4a1-2a5e-43ee-9de5-120f2452becc tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:30.198089 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c05ee4a1-2a5e-43ee-9de5-120f2452becc tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:30.314640 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-c05ee4a1-2a5e-43ee-9de5-120f2452becc tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:23:30.321731 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-c05ee4a1-2a5e-43ee-9de5-120f2452becc tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.136459 Nov 01 01:23:30.322287 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 436/814] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:23:30 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:23:30.469608 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-3edaaed3-e6a7-46de-82ac-f71905af15b1 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:23:30.470599 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-3edaaed3-e6a7-46de-82ac-f71905af15b1 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:23:30.476945 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3edaaed3-e6a7-46de-82ac-f71905af15b1 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:30.477385 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3edaaed3-e6a7-46de-82ac-f71905af15b1 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:30.478137 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3edaaed3-e6a7-46de-82ac-f71905af15b1 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:30.478593 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3edaaed3-e6a7-46de-82ac-f71905af15b1 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:30.507000 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-3edaaed3-e6a7-46de-82ac-f71905af15b1 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041131 Nov 01 01:23:30.507531 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 379/815] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:23:30 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:23:30.895094 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-da0baab8-5f95-46a6-a48c-6424eb350821 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:23:30.895728 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-da0baab8-5f95-46a6-a48c-6424eb350821 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:23:30.901709 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-da0baab8-5f95-46a6-a48c-6424eb350821 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:30.902158 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-da0baab8-5f95-46a6-a48c-6424eb350821 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:30.902959 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-da0baab8-5f95-46a6-a48c-6424eb350821 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:30.903505 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-da0baab8-5f95-46a6-a48c-6424eb350821 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:31.022577 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-da0baab8-5f95-46a6-a48c-6424eb350821 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:23:31.029855 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-da0baab8-5f95-46a6-a48c-6424eb350821 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1443 microversion: 2.1 time: 0.139122 Nov 01 01:23:31.030415 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 437/816] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:23:30 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1443 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:23:31.045777 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-8620605d-3eca-4398-9722-53ab1f1bebe1 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:23:31.046408 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-8620605d-3eca-4398-9722-53ab1f1bebe1 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:23:31.052788 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8620605d-3eca-4398-9722-53ab1f1bebe1 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:31.053223 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8620605d-3eca-4398-9722-53ab1f1bebe1 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:31.053973 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8620605d-3eca-4398-9722-53ab1f1bebe1 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:31.054395 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8620605d-3eca-4398-9722-53ab1f1bebe1 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:31.178452 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-8620605d-3eca-4398-9722-53ab1f1bebe1 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:23:31.185850 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-8620605d-3eca-4398-9722-53ab1f1bebe1 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1443 microversion: 2.1 time: 0.143612 Nov 01 01:23:31.186410 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 380/817] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:23:31 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1443 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:23:31.338615 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-fea6b2b5-458a-46bb-bafe-a087d98ba705 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:23:31.339217 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-fea6b2b5-458a-46bb-bafe-a087d98ba705 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:23:31.345676 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-fea6b2b5-458a-46bb-bafe-a087d98ba705 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:31.346120 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-fea6b2b5-458a-46bb-bafe-a087d98ba705 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:31.346902 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-fea6b2b5-458a-46bb-bafe-a087d98ba705 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:31.347386 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-fea6b2b5-458a-46bb-bafe-a087d98ba705 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:31.507803 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-fea6b2b5-458a-46bb-bafe-a087d98ba705 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:23:31.516090 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-fea6b2b5-458a-46bb-bafe-a087d98ba705 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.181096 Nov 01 01:23:31.516822 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 438/818] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:23:31 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:23:31.518102 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-ef849f50-c359-4573-8a6c-a1c47c1f4185 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:23:31.519090 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-ef849f50-c359-4573-8a6c-a1c47c1f4185 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:23:31.524801 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ef849f50-c359-4573-8a6c-a1c47c1f4185 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:31.525242 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ef849f50-c359-4573-8a6c-a1c47c1f4185 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:31.526002 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ef849f50-c359-4573-8a6c-a1c47c1f4185 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:31.526450 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ef849f50-c359-4573-8a6c-a1c47c1f4185 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:31.555910 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-ef849f50-c359-4573-8a6c-a1c47c1f4185 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041495 Nov 01 01:23:31.556674 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 381/819] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:23:31 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 01 01:23:32.532682 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-fb0c2ba9-0327-4864-8f5d-4e17a3204200 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:23:32.533334 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-fb0c2ba9-0327-4864-8f5d-4e17a3204200 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:23:32.539593 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-fb0c2ba9-0327-4864-8f5d-4e17a3204200 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:32.540130 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-fb0c2ba9-0327-4864-8f5d-4e17a3204200 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:32.540958 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-fb0c2ba9-0327-4864-8f5d-4e17a3204200 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:32.541456 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-fb0c2ba9-0327-4864-8f5d-4e17a3204200 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:32.567121 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-5d9ac3c9-fb86-4694-a584-10c84eea2d4b tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:23:32.568011 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-5d9ac3c9-fb86-4694-a584-10c84eea2d4b tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:23:32.574215 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-5d9ac3c9-fb86-4694-a584-10c84eea2d4b tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:32.574683 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-5d9ac3c9-fb86-4694-a584-10c84eea2d4b tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:32.575440 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-5d9ac3c9-fb86-4694-a584-10c84eea2d4b tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:32.575862 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-5d9ac3c9-fb86-4694-a584-10c84eea2d4b tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:32.606981 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-5d9ac3c9-fb86-4694-a584-10c84eea2d4b tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044003 Nov 01 01:23:32.607708 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 382/820] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:23:32 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 01 01:23:32.730194 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-fb0c2ba9-0327-4864-8f5d-4e17a3204200 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:23:32.738123 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-fb0c2ba9-0327-4864-8f5d-4e17a3204200 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.209115 Nov 01 01:23:32.739383 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 439/821] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:23:32 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:23:33.323027 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [req-47841ee3-d639-490d-b3b6-4c77ca130000 req-9addcccb-5f18-4797-abe7-32baa5f2e8f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7554da88-1726-438a-bed5-4e30d999ba9d", "tag": "bebb1bd2-6980-4bbb-a08e-ca30b1d8aac9"}]} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:23:33.324560 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 01 01:23:33.324560 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: warnings.warn(msg) Nov 01 01:23:33.331119 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [req-47841ee3-d639-490d-b3b6-4c77ca130000 req-9addcccb-5f18-4797-abe7-32baa5f2e8f6 service nova] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:33.332170 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [req-47841ee3-d639-490d-b3b6-4c77ca130000 req-9addcccb-5f18-4797-abe7-32baa5f2e8f6 service nova] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:33.343148 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.compute.server_external_events [req-47841ee3-d639-490d-b3b6-4c77ca130000 req-9addcccb-5f18-4797-abe7-32baa5f2e8f6 service nova] Creating event network-changed:bebb1bd2-6980-4bbb-a08e-ca30b1d8aac9 for instance 7554da88-1726-438a-bed5-4e30d999ba9d on hv-cinder-81561 Nov 01 01:23:33.348822 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [req-47841ee3-d639-490d-b3b6-4c77ca130000 req-9addcccb-5f18-4797-abe7-32baa5f2e8f6 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084711 Nov 01 01:23:33.349407 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 383/822] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Nov 1 01:23:33 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 01 01:23:33.619047 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-841422d1-f6de-4aa6-934e-33bd2b730032 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:23:33.619957 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-841422d1-f6de-4aa6-934e-33bd2b730032 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:23:33.626138 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-841422d1-f6de-4aa6-934e-33bd2b730032 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:33.626937 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-841422d1-f6de-4aa6-934e-33bd2b730032 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:33.627722 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-841422d1-f6de-4aa6-934e-33bd2b730032 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:33.628140 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-841422d1-f6de-4aa6-934e-33bd2b730032 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:33.658023 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-841422d1-f6de-4aa6-934e-33bd2b730032 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042703 Nov 01 01:23:33.658614 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 440/823] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:23:33 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:23:33.757283 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-23c5ea63-1967-4476-a575-3d5ad699f931 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:23:33.758715 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-23c5ea63-1967-4476-a575-3d5ad699f931 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:23:33.765842 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-23c5ea63-1967-4476-a575-3d5ad699f931 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:33.766536 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-23c5ea63-1967-4476-a575-3d5ad699f931 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:33.767476 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-23c5ea63-1967-4476-a575-3d5ad699f931 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:33.767900 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-23c5ea63-1967-4476-a575-3d5ad699f931 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:33.892589 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-23c5ea63-1967-4476-a575-3d5ad699f931 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:23:33.906685 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-23c5ea63-1967-4476-a575-3d5ad699f931 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.155026 Nov 01 01:23:33.907488 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 384/824] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:23:33 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:23:34.669322 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-c94aaa5f-a801-417b-8c85-8db3ff4fefc4 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:23:34.670146 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-c94aaa5f-a801-417b-8c85-8db3ff4fefc4 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:23:34.676303 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c94aaa5f-a801-417b-8c85-8db3ff4fefc4 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:34.676828 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c94aaa5f-a801-417b-8c85-8db3ff4fefc4 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:34.677526 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c94aaa5f-a801-417b-8c85-8db3ff4fefc4 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:34.677950 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c94aaa5f-a801-417b-8c85-8db3ff4fefc4 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:34.708285 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-c94aaa5f-a801-417b-8c85-8db3ff4fefc4 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042759 Nov 01 01:23:34.708822 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 441/825] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:23:34 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:23:34.923471 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-9740e24d-1836-4134-987d-68bd71d5c95f tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:23:34.924000 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-9740e24d-1836-4134-987d-68bd71d5c95f tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:23:34.930354 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9740e24d-1836-4134-987d-68bd71d5c95f tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:34.930818 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9740e24d-1836-4134-987d-68bd71d5c95f tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:34.931565 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9740e24d-1836-4134-987d-68bd71d5c95f tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:34.931993 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9740e24d-1836-4134-987d-68bd71d5c95f tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:35.052360 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-9740e24d-1836-4134-987d-68bd71d5c95f tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:23:35.059561 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-9740e24d-1836-4134-987d-68bd71d5c95f tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.139710 Nov 01 01:23:35.060123 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 385/826] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:23:34 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:23:35.719598 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-27be7f39-cdc1-4ea3-bdc7-0c24849a7e55 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:23:35.720434 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-27be7f39-cdc1-4ea3-bdc7-0c24849a7e55 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:23:35.727141 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-27be7f39-cdc1-4ea3-bdc7-0c24849a7e55 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:35.727587 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-27be7f39-cdc1-4ea3-bdc7-0c24849a7e55 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:35.728369 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-27be7f39-cdc1-4ea3-bdc7-0c24849a7e55 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:35.728797 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-27be7f39-cdc1-4ea3-bdc7-0c24849a7e55 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:35.757166 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-27be7f39-cdc1-4ea3-bdc7-0c24849a7e55 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041416 Nov 01 01:23:35.757703 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 442/827] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:23:35 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:23:36.076902 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-d9782128-c420-4f4c-baae-e0ab59bf4833 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:23:36.077411 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-d9782128-c420-4f4c-baae-e0ab59bf4833 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:23:36.085019 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d9782128-c420-4f4c-baae-e0ab59bf4833 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:36.085019 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d9782128-c420-4f4c-baae-e0ab59bf4833 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:36.085581 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d9782128-c420-4f4c-baae-e0ab59bf4833 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:36.086011 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d9782128-c420-4f4c-baae-e0ab59bf4833 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:36.203797 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-d9782128-c420-4f4c-baae-e0ab59bf4833 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:23:36.211777 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-d9782128-c420-4f4c-baae-e0ab59bf4833 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.138658 Nov 01 01:23:36.212338 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 386/828] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:23:36 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:23:36.768468 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-4dbb80f9-be5e-431d-9ee0-a218616989cf tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:23:36.769375 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-4dbb80f9-be5e-431d-9ee0-a218616989cf tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:23:36.775557 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4dbb80f9-be5e-431d-9ee0-a218616989cf tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:36.776001 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4dbb80f9-be5e-431d-9ee0-a218616989cf tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:36.776764 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4dbb80f9-be5e-431d-9ee0-a218616989cf tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:36.777194 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4dbb80f9-be5e-431d-9ee0-a218616989cf tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:36.805157 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-4dbb80f9-be5e-431d-9ee0-a218616989cf tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040460 Nov 01 01:23:36.805687 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 443/829] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:23:36 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:23:37.228467 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-c216f842-0f10-4fec-991e-d3ff0f4dadc6 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:23:37.229095 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-c216f842-0f10-4fec-991e-d3ff0f4dadc6 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:23:37.235231 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c216f842-0f10-4fec-991e-d3ff0f4dadc6 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:37.235663 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c216f842-0f10-4fec-991e-d3ff0f4dadc6 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:37.236697 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c216f842-0f10-4fec-991e-d3ff0f4dadc6 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:37.237117 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c216f842-0f10-4fec-991e-d3ff0f4dadc6 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:37.354400 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-c216f842-0f10-4fec-991e-d3ff0f4dadc6 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:23:37.361867 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-c216f842-0f10-4fec-991e-d3ff0f4dadc6 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.136703 Nov 01 01:23:37.362449 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 387/830] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:23:37 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:23:37.817304 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-15dba3c7-4504-4261-bace-f15b62fe7061 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:23:37.818131 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-15dba3c7-4504-4261-bace-f15b62fe7061 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:23:37.824402 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-15dba3c7-4504-4261-bace-f15b62fe7061 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:37.824843 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-15dba3c7-4504-4261-bace-f15b62fe7061 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:37.825602 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-15dba3c7-4504-4261-bace-f15b62fe7061 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:37.826028 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-15dba3c7-4504-4261-bace-f15b62fe7061 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:37.854488 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-15dba3c7-4504-4261-bace-f15b62fe7061 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041509 Nov 01 01:23:37.855034 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 444/831] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:23:37 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:23:38.378206 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-1f73edb8-76fa-4a1c-b560-c8a413192030 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:23:38.379466 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-1f73edb8-76fa-4a1c-b560-c8a413192030 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:23:38.385681 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-1f73edb8-76fa-4a1c-b560-c8a413192030 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:38.386122 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-1f73edb8-76fa-4a1c-b560-c8a413192030 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:38.386928 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-1f73edb8-76fa-4a1c-b560-c8a413192030 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:38.387370 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-1f73edb8-76fa-4a1c-b560-c8a413192030 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:38.513111 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-1f73edb8-76fa-4a1c-b560-c8a413192030 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:23:38.520285 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-1f73edb8-76fa-4a1c-b560-c8a413192030 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.145720 Nov 01 01:23:38.520842 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 388/832] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:23:38 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:23:38.866004 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-4b06f9f9-2fd4-4947-b351-af29bd2d36ca tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:23:38.866860 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-4b06f9f9-2fd4-4947-b351-af29bd2d36ca tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:23:38.873010 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4b06f9f9-2fd4-4947-b351-af29bd2d36ca tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:38.873451 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4b06f9f9-2fd4-4947-b351-af29bd2d36ca tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:38.874205 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4b06f9f9-2fd4-4947-b351-af29bd2d36ca tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:38.874664 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4b06f9f9-2fd4-4947-b351-af29bd2d36ca tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:38.902490 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-4b06f9f9-2fd4-4947-b351-af29bd2d36ca tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040284 Nov 01 01:23:38.903026 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 445/833] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:23:38 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:23:39.537276 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-512e8c3e-a410-41f0-80f6-40c5848a0f76 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:23:39.537901 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-512e8c3e-a410-41f0-80f6-40c5848a0f76 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:23:39.544182 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-512e8c3e-a410-41f0-80f6-40c5848a0f76 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:39.544626 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-512e8c3e-a410-41f0-80f6-40c5848a0f76 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:39.545377 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-512e8c3e-a410-41f0-80f6-40c5848a0f76 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:39.545802 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-512e8c3e-a410-41f0-80f6-40c5848a0f76 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:39.662903 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-512e8c3e-a410-41f0-80f6-40c5848a0f76 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:23:39.670068 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-512e8c3e-a410-41f0-80f6-40c5848a0f76 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.136604 Nov 01 01:23:39.670665 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 389/834] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:23:39 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:23:39.914059 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-14ae680f-a8b6-4710-b229-f7a6ab07e446 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:23:39.914906 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-14ae680f-a8b6-4710-b229-f7a6ab07e446 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:23:39.921047 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-14ae680f-a8b6-4710-b229-f7a6ab07e446 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:39.921490 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-14ae680f-a8b6-4710-b229-f7a6ab07e446 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:39.922247 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-14ae680f-a8b6-4710-b229-f7a6ab07e446 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:39.922711 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-14ae680f-a8b6-4710-b229-f7a6ab07e446 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:39.950744 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-14ae680f-a8b6-4710-b229-f7a6ab07e446 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040995 Nov 01 01:23:39.951280 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 446/835] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:23:39 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:23:40.686962 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-0fd62bee-ea9c-4223-b6e2-12dbb117dc09 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:23:40.687630 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-0fd62bee-ea9c-4223-b6e2-12dbb117dc09 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:23:40.694484 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0fd62bee-ea9c-4223-b6e2-12dbb117dc09 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:40.694921 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0fd62bee-ea9c-4223-b6e2-12dbb117dc09 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:40.695676 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0fd62bee-ea9c-4223-b6e2-12dbb117dc09 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:40.696082 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0fd62bee-ea9c-4223-b6e2-12dbb117dc09 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:40.816228 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-0fd62bee-ea9c-4223-b6e2-12dbb117dc09 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:23:40.823930 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-0fd62bee-ea9c-4223-b6e2-12dbb117dc09 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.140549 Nov 01 01:23:40.824492 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 390/836] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:23:40 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:23:40.962483 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-8b553026-9018-4ad4-8692-0a6c0eecef99 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:23:40.963388 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-8b553026-9018-4ad4-8692-0a6c0eecef99 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:23:40.969531 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8b553026-9018-4ad4-8692-0a6c0eecef99 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:40.969975 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8b553026-9018-4ad4-8692-0a6c0eecef99 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:40.970770 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8b553026-9018-4ad4-8692-0a6c0eecef99 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:40.971196 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8b553026-9018-4ad4-8692-0a6c0eecef99 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:40.999393 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-8b553026-9018-4ad4-8692-0a6c0eecef99 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041238 Nov 01 01:23:41.000200 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 447/837] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:23:40 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:23:41.840804 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-678a6aa3-fa0c-4930-b30e-17b18346ee37 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:23:41.841440 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-678a6aa3-fa0c-4930-b30e-17b18346ee37 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:23:41.847721 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-678a6aa3-fa0c-4930-b30e-17b18346ee37 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:41.848154 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-678a6aa3-fa0c-4930-b30e-17b18346ee37 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:41.848898 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-678a6aa3-fa0c-4930-b30e-17b18346ee37 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:41.849319 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-678a6aa3-fa0c-4930-b30e-17b18346ee37 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:41.969305 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-678a6aa3-fa0c-4930-b30e-17b18346ee37 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:23:41.977167 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-678a6aa3-fa0c-4930-b30e-17b18346ee37 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.140097 Nov 01 01:23:41.977717 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 391/838] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:23:41 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:23:42.010618 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-ccba8d43-834c-40fe-978b-2bd894086457 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:23:42.011524 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-ccba8d43-834c-40fe-978b-2bd894086457 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:23:42.017709 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ccba8d43-834c-40fe-978b-2bd894086457 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:42.018157 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ccba8d43-834c-40fe-978b-2bd894086457 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:42.018957 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ccba8d43-834c-40fe-978b-2bd894086457 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:42.019389 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ccba8d43-834c-40fe-978b-2bd894086457 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:42.048069 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-ccba8d43-834c-40fe-978b-2bd894086457 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041226 Nov 01 01:23:42.048614 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 448/839] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:23:42 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 01 01:23:42.993984 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-3d70d34c-e3f1-4283-913e-b7054de7cb52 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:23:42.994650 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-3d70d34c-e3f1-4283-913e-b7054de7cb52 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:23:43.000877 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3d70d34c-e3f1-4283-913e-b7054de7cb52 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:43.001323 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3d70d34c-e3f1-4283-913e-b7054de7cb52 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:43.002084 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3d70d34c-e3f1-4283-913e-b7054de7cb52 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:43.002554 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3d70d34c-e3f1-4283-913e-b7054de7cb52 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:43.059285 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-dd7c7061-6655-47ee-a531-eac59e7826e9 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:23:43.060197 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-dd7c7061-6655-47ee-a531-eac59e7826e9 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:23:43.066334 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-dd7c7061-6655-47ee-a531-eac59e7826e9 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:43.066813 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-dd7c7061-6655-47ee-a531-eac59e7826e9 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:43.067575 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-dd7c7061-6655-47ee-a531-eac59e7826e9 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:43.068003 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-dd7c7061-6655-47ee-a531-eac59e7826e9 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:43.098106 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-dd7c7061-6655-47ee-a531-eac59e7826e9 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042506 Nov 01 01:23:43.098726 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 449/840] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:23:43 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 01 01:23:43.120807 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-3d70d34c-e3f1-4283-913e-b7054de7cb52 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:23:43.127999 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-3d70d34c-e3f1-4283-913e-b7054de7cb52 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.137842 Nov 01 01:23:43.128556 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 392/841] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:23:42 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:23:44.109564 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-83a86554-f1c4-43f0-a2d7-6b5d0ccfaac7 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:23:44.110477 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-83a86554-f1c4-43f0-a2d7-6b5d0ccfaac7 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:23:44.116582 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-83a86554-f1c4-43f0-a2d7-6b5d0ccfaac7 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:44.117017 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-83a86554-f1c4-43f0-a2d7-6b5d0ccfaac7 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:44.117761 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-83a86554-f1c4-43f0-a2d7-6b5d0ccfaac7 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:44.118349 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-83a86554-f1c4-43f0-a2d7-6b5d0ccfaac7 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:44.144883 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-4bbd4224-d620-40bf-aacc-d5a35eb9c3ae tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:23:44.145615 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-4bbd4224-d620-40bf-aacc-d5a35eb9c3ae tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:23:44.145929 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-83a86554-f1c4-43f0-a2d7-6b5d0ccfaac7 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040041 Nov 01 01:23:44.146505 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 450/842] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:23:44 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 01 01:23:44.152480 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4bbd4224-d620-40bf-aacc-d5a35eb9c3ae tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:44.152926 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4bbd4224-d620-40bf-aacc-d5a35eb9c3ae tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:44.153691 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4bbd4224-d620-40bf-aacc-d5a35eb9c3ae tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:44.154124 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4bbd4224-d620-40bf-aacc-d5a35eb9c3ae tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:44.270102 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-4bbd4224-d620-40bf-aacc-d5a35eb9c3ae tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:23:44.277816 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-4bbd4224-d620-40bf-aacc-d5a35eb9c3ae tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.136577 Nov 01 01:23:44.278381 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 393/843] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:23:44 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:23:45.157022 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-4c95026f-f73c-40ad-b85c-24c8185d9ba5 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:23:45.157915 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-4c95026f-f73c-40ad-b85c-24c8185d9ba5 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:23:45.164075 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4c95026f-f73c-40ad-b85c-24c8185d9ba5 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:45.165549 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4c95026f-f73c-40ad-b85c-24c8185d9ba5 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:45.165791 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4c95026f-f73c-40ad-b85c-24c8185d9ba5 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:45.166212 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4c95026f-f73c-40ad-b85c-24c8185d9ba5 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:45.194630 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-4c95026f-f73c-40ad-b85c-24c8185d9ba5 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041378 Nov 01 01:23:45.195174 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 451/844] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:23:45 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:23:45.293567 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-ef7aa86a-0d13-474a-b255-93e7c8c089b6 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:23:45.294173 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-ef7aa86a-0d13-474a-b255-93e7c8c089b6 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:23:45.300558 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ef7aa86a-0d13-474a-b255-93e7c8c089b6 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:45.300997 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ef7aa86a-0d13-474a-b255-93e7c8c089b6 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:45.301747 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ef7aa86a-0d13-474a-b255-93e7c8c089b6 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:45.302172 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ef7aa86a-0d13-474a-b255-93e7c8c089b6 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:45.422005 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-ef7aa86a-0d13-474a-b255-93e7c8c089b6 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:23:45.429365 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-ef7aa86a-0d13-474a-b255-93e7c8c089b6 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.139909 Nov 01 01:23:45.429930 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 394/845] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:23:45 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:23:46.205808 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-96127381-e821-4215-9b1d-6714c166c329 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:23:46.206739 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-96127381-e821-4215-9b1d-6714c166c329 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:23:46.213428 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-96127381-e821-4215-9b1d-6714c166c329 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:46.213802 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-96127381-e821-4215-9b1d-6714c166c329 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:46.214583 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-96127381-e821-4215-9b1d-6714c166c329 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:46.215007 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-96127381-e821-4215-9b1d-6714c166c329 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:46.243065 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-96127381-e821-4215-9b1d-6714c166c329 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041090 Nov 01 01:23:46.243591 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 452/846] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:23:46 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 01 01:23:46.446226 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-6f5cd183-fd15-45a3-ae16-dcf914c5d074 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:23:46.446853 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-6f5cd183-fd15-45a3-ae16-dcf914c5d074 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:23:46.453018 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-6f5cd183-fd15-45a3-ae16-dcf914c5d074 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:46.453452 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-6f5cd183-fd15-45a3-ae16-dcf914c5d074 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:46.454196 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-6f5cd183-fd15-45a3-ae16-dcf914c5d074 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:46.454649 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-6f5cd183-fd15-45a3-ae16-dcf914c5d074 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:46.579934 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-6f5cd183-fd15-45a3-ae16-dcf914c5d074 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:23:46.587861 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-6f5cd183-fd15-45a3-ae16-dcf914c5d074 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.145183 Nov 01 01:23:46.588449 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 395/847] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:23:46 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:23:47.254240 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-6982e466-e43e-4561-80f1-3c858691961d tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:23:47.255175 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-6982e466-e43e-4561-80f1-3c858691961d tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:23:47.262019 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6982e466-e43e-4561-80f1-3c858691961d tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:47.262485 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6982e466-e43e-4561-80f1-3c858691961d tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:47.263237 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6982e466-e43e-4561-80f1-3c858691961d tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:47.263659 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6982e466-e43e-4561-80f1-3c858691961d tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:47.291651 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-6982e466-e43e-4561-80f1-3c858691961d tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041178 Nov 01 01:23:47.292196 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 453/848] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:23:47 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:23:47.604666 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-0fca047a-ff6f-442e-9193-de4c26823829 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:23:47.605697 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-0fca047a-ff6f-442e-9193-de4c26823829 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:23:47.611883 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0fca047a-ff6f-442e-9193-de4c26823829 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:47.612324 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0fca047a-ff6f-442e-9193-de4c26823829 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:47.613073 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0fca047a-ff6f-442e-9193-de4c26823829 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:47.613498 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0fca047a-ff6f-442e-9193-de4c26823829 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:47.733094 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-0fca047a-ff6f-442e-9193-de4c26823829 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:23:47.740592 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-0fca047a-ff6f-442e-9193-de4c26823829 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.139832 Nov 01 01:23:47.744310 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 396/849] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:23:47 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:23:48.304032 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-0a680681-74bf-4dbe-b6e6-d68a40e35777 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:23:48.304863 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-0a680681-74bf-4dbe-b6e6-d68a40e35777 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:23:48.312385 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0a680681-74bf-4dbe-b6e6-d68a40e35777 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:48.312836 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0a680681-74bf-4dbe-b6e6-d68a40e35777 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:48.316746 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0a680681-74bf-4dbe-b6e6-d68a40e35777 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:48.316746 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0a680681-74bf-4dbe-b6e6-d68a40e35777 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:48.343743 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-0a680681-74bf-4dbe-b6e6-d68a40e35777 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043579 Nov 01 01:23:48.344312 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 454/850] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:23:48 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:23:48.758326 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-ac2b7d06-ffff-4211-80f7-e5a17d767810 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:23:48.758960 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-ac2b7d06-ffff-4211-80f7-e5a17d767810 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:23:48.765524 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ac2b7d06-ffff-4211-80f7-e5a17d767810 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:48.765965 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ac2b7d06-ffff-4211-80f7-e5a17d767810 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:48.766748 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ac2b7d06-ffff-4211-80f7-e5a17d767810 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:48.767172 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ac2b7d06-ffff-4211-80f7-e5a17d767810 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:48.886003 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-ac2b7d06-ffff-4211-80f7-e5a17d767810 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:23:48.893636 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-ac2b7d06-ffff-4211-80f7-e5a17d767810 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.138931 Nov 01 01:23:48.894190 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 397/851] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:23:48 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:23:49.355156 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-eaf1749b-b8ef-4867-88f3-56c80c0ee60a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:23:49.356065 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-eaf1749b-b8ef-4867-88f3-56c80c0ee60a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:23:49.362558 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-eaf1749b-b8ef-4867-88f3-56c80c0ee60a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:49.363003 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-eaf1749b-b8ef-4867-88f3-56c80c0ee60a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:49.363758 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-eaf1749b-b8ef-4867-88f3-56c80c0ee60a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:49.364185 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-eaf1749b-b8ef-4867-88f3-56c80c0ee60a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:49.393483 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-eaf1749b-b8ef-4867-88f3-56c80c0ee60a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042064 Nov 01 01:23:49.393966 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 455/852] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:23:49 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:23:49.909591 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-d31f974f-99fe-4c5f-a4f3-4a1743c35c11 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:23:49.910196 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-d31f974f-99fe-4c5f-a4f3-4a1743c35c11 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:23:49.916670 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d31f974f-99fe-4c5f-a4f3-4a1743c35c11 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:49.917112 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d31f974f-99fe-4c5f-a4f3-4a1743c35c11 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:49.918491 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d31f974f-99fe-4c5f-a4f3-4a1743c35c11 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:49.918922 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d31f974f-99fe-4c5f-a4f3-4a1743c35c11 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:50.035498 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-d31f974f-99fe-4c5f-a4f3-4a1743c35c11 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:23:50.043631 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-d31f974f-99fe-4c5f-a4f3-4a1743c35c11 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.137740 Nov 01 01:23:50.044199 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 398/853] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:23:49 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:23:50.405261 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-a0f79f00-80c6-4371-ad76-24d78e3b7b0b tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:23:50.406186 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-a0f79f00-80c6-4371-ad76-24d78e3b7b0b tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:23:50.412421 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a0f79f00-80c6-4371-ad76-24d78e3b7b0b tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:50.412859 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a0f79f00-80c6-4371-ad76-24d78e3b7b0b tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:50.413616 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a0f79f00-80c6-4371-ad76-24d78e3b7b0b tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:50.414042 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a0f79f00-80c6-4371-ad76-24d78e3b7b0b tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:50.441313 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-a0f79f00-80c6-4371-ad76-24d78e3b7b0b tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040453 Nov 01 01:23:50.441850 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 456/854] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:23:50 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:23:51.060469 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-67160369-4010-4deb-a837-3abbe75661a8 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:23:51.061058 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-67160369-4010-4deb-a837-3abbe75661a8 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:23:51.067829 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-67160369-4010-4deb-a837-3abbe75661a8 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:51.068300 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-67160369-4010-4deb-a837-3abbe75661a8 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:51.069054 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-67160369-4010-4deb-a837-3abbe75661a8 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:51.069478 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-67160369-4010-4deb-a837-3abbe75661a8 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:51.187494 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-67160369-4010-4deb-a837-3abbe75661a8 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:23:51.194817 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-67160369-4010-4deb-a837-3abbe75661a8 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.138041 Nov 01 01:23:51.195383 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 399/855] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:23:51 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:23:51.452336 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-05e4f5c7-2bbf-4377-9589-f1d5c485a968 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:23:51.453249 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-05e4f5c7-2bbf-4377-9589-f1d5c485a968 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:23:51.459539 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-05e4f5c7-2bbf-4377-9589-f1d5c485a968 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:51.459976 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-05e4f5c7-2bbf-4377-9589-f1d5c485a968 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:51.460725 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-05e4f5c7-2bbf-4377-9589-f1d5c485a968 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:51.461150 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-05e4f5c7-2bbf-4377-9589-f1d5c485a968 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:51.489900 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-05e4f5c7-2bbf-4377-9589-f1d5c485a968 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041329 Nov 01 01:23:51.490439 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 457/856] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:23:51 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:23:52.211025 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-fdd42569-81c9-4646-8afb-8eb3edc62ef1 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:23:52.211667 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-fdd42569-81c9-4646-8afb-8eb3edc62ef1 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:23:52.218451 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-fdd42569-81c9-4646-8afb-8eb3edc62ef1 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:52.218907 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-fdd42569-81c9-4646-8afb-8eb3edc62ef1 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:52.219666 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-fdd42569-81c9-4646-8afb-8eb3edc62ef1 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:52.220097 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-fdd42569-81c9-4646-8afb-8eb3edc62ef1 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:52.338089 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-fdd42569-81c9-4646-8afb-8eb3edc62ef1 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:23:52.345847 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-fdd42569-81c9-4646-8afb-8eb3edc62ef1 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.138501 Nov 01 01:23:52.346416 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 400/857] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:23:52 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:23:52.501078 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-c19238b0-4481-4055-b1fc-e659f5eff210 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:23:52.501926 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-c19238b0-4481-4055-b1fc-e659f5eff210 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:23:52.508051 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c19238b0-4481-4055-b1fc-e659f5eff210 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:52.508515 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c19238b0-4481-4055-b1fc-e659f5eff210 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:52.509263 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c19238b0-4481-4055-b1fc-e659f5eff210 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:52.509687 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c19238b0-4481-4055-b1fc-e659f5eff210 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:52.537944 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-c19238b0-4481-4055-b1fc-e659f5eff210 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040647 Nov 01 01:23:52.538507 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 458/858] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:23:52 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:23:53.363293 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-cf2355ee-e227-474a-84d9-a011d59e4e88 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:23:53.363907 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-cf2355ee-e227-474a-84d9-a011d59e4e88 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:23:53.370209 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-cf2355ee-e227-474a-84d9-a011d59e4e88 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:53.371325 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-cf2355ee-e227-474a-84d9-a011d59e4e88 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:53.372087 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-cf2355ee-e227-474a-84d9-a011d59e4e88 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:53.372517 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-cf2355ee-e227-474a-84d9-a011d59e4e88 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:53.488969 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-cf2355ee-e227-474a-84d9-a011d59e4e88 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:23:53.496727 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-cf2355ee-e227-474a-84d9-a011d59e4e88 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.137383 Nov 01 01:23:53.497289 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 401/859] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:23:53 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:23:53.549248 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-d01367e7-4c39-4ed8-9cf5-ec9c6d016e08 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:23:53.550144 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-d01367e7-4c39-4ed8-9cf5-ec9c6d016e08 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:23:53.556194 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d01367e7-4c39-4ed8-9cf5-ec9c6d016e08 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:53.556634 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d01367e7-4c39-4ed8-9cf5-ec9c6d016e08 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:53.557380 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d01367e7-4c39-4ed8-9cf5-ec9c6d016e08 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:53.557801 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d01367e7-4c39-4ed8-9cf5-ec9c6d016e08 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:53.585766 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-d01367e7-4c39-4ed8-9cf5-ec9c6d016e08 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040290 Nov 01 01:23:53.586326 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 459/860] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:23:53 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:23:54.512617 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-66b058f1-8695-4b86-a665-2aa38b4642cf tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:23:54.513217 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-66b058f1-8695-4b86-a665-2aa38b4642cf tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:23:54.520007 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-66b058f1-8695-4b86-a665-2aa38b4642cf tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:54.520440 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-66b058f1-8695-4b86-a665-2aa38b4642cf tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:54.521187 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-66b058f1-8695-4b86-a665-2aa38b4642cf tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:54.521608 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-66b058f1-8695-4b86-a665-2aa38b4642cf tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:54.597058 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-d6381dba-51ec-458e-a20e-d656a822c80b tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:23:54.597964 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-d6381dba-51ec-458e-a20e-d656a822c80b tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:23:54.604183 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d6381dba-51ec-458e-a20e-d656a822c80b tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:54.604625 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d6381dba-51ec-458e-a20e-d656a822c80b tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:54.605387 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d6381dba-51ec-458e-a20e-d656a822c80b tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:54.605813 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d6381dba-51ec-458e-a20e-d656a822c80b tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:54.634704 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-d6381dba-51ec-458e-a20e-d656a822c80b tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041315 Nov 01 01:23:54.635186 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 460/861] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:23:54 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 01 01:23:54.641288 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-66b058f1-8695-4b86-a665-2aa38b4642cf tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:23:54.648544 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-66b058f1-8695-4b86-a665-2aa38b4642cf tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.139567 Nov 01 01:23:54.649171 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 402/862] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:23:54 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:23:55.664670 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-ee4c5181-57cc-4734-9b20-e77954102931 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:23:55.665370 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-ee4c5181-57cc-4734-9b20-e77954102931 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:23:55.671899 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ee4c5181-57cc-4734-9b20-e77954102931 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:55.672266 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ee4c5181-57cc-4734-9b20-e77954102931 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:55.673012 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ee4c5181-57cc-4734-9b20-e77954102931 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:55.673431 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ee4c5181-57cc-4734-9b20-e77954102931 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:55.749147 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-ec4d4aff-7969-4c78-bdf8-93370b34836d tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:23:55.750103 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-ec4d4aff-7969-4c78-bdf8-93370b34836d tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:23:55.755930 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ec4d4aff-7969-4c78-bdf8-93370b34836d tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:55.756224 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ec4d4aff-7969-4c78-bdf8-93370b34836d tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:55.756975 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ec4d4aff-7969-4c78-bdf8-93370b34836d tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:55.757395 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ec4d4aff-7969-4c78-bdf8-93370b34836d tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:55.785383 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-ec4d4aff-7969-4c78-bdf8-93370b34836d tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.143246 Nov 01 01:23:55.785939 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 461/863] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:23:55 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:23:55.798560 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-ee4c5181-57cc-4734-9b20-e77954102931 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:23:55.805769 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-ee4c5181-57cc-4734-9b20-e77954102931 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.144623 Nov 01 01:23:55.806313 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 403/864] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:23:55 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:23:56.797782 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-c7e465c6-b481-4e8b-801c-876854daef3f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:23:56.798722 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-c7e465c6-b481-4e8b-801c-876854daef3f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:23:56.805354 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c7e465c6-b481-4e8b-801c-876854daef3f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:56.806447 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c7e465c6-b481-4e8b-801c-876854daef3f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:56.806634 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c7e465c6-b481-4e8b-801c-876854daef3f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:56.807066 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c7e465c6-b481-4e8b-801c-876854daef3f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:56.822873 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-ab1406b7-859e-4384-a0f8-419a6a3ec546 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:23:56.823562 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-ab1406b7-859e-4384-a0f8-419a6a3ec546 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:23:56.831269 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ab1406b7-859e-4384-a0f8-419a6a3ec546 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:56.831709 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ab1406b7-859e-4384-a0f8-419a6a3ec546 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:56.832462 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ab1406b7-859e-4384-a0f8-419a6a3ec546 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:56.832883 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ab1406b7-859e-4384-a0f8-419a6a3ec546 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:56.837387 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-c7e465c6-b481-4e8b-801c-876854daef3f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044383 Nov 01 01:23:56.837947 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 462/865] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:23:56 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:23:56.957713 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-ab1406b7-859e-4384-a0f8-419a6a3ec546 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:23:56.964973 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-ab1406b7-859e-4384-a0f8-419a6a3ec546 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.145682 Nov 01 01:23:56.965523 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 404/866] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:23:56 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:23:57.848842 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-9f66910a-c459-491c-881b-013f3f86fe3d tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:23:57.849745 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-9f66910a-c459-491c-881b-013f3f86fe3d tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:23:57.855931 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9f66910a-c459-491c-881b-013f3f86fe3d tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:57.856374 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9f66910a-c459-491c-881b-013f3f86fe3d tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:57.857129 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9f66910a-c459-491c-881b-013f3f86fe3d tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:57.857556 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9f66910a-c459-491c-881b-013f3f86fe3d tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:57.886434 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-9f66910a-c459-491c-881b-013f3f86fe3d tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040865 Nov 01 01:23:57.886991 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 463/867] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:23:57 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:23:57.981525 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-71448f66-c7d0-43a9-92b3-07ac91b7baf9 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:23:57.982463 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-71448f66-c7d0-43a9-92b3-07ac91b7baf9 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:23:57.989118 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-71448f66-c7d0-43a9-92b3-07ac91b7baf9 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:57.989566 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-71448f66-c7d0-43a9-92b3-07ac91b7baf9 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:57.990338 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-71448f66-c7d0-43a9-92b3-07ac91b7baf9 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:57.990798 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-71448f66-c7d0-43a9-92b3-07ac91b7baf9 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:58.115587 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-71448f66-c7d0-43a9-92b3-07ac91b7baf9 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:23:58.124313 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-71448f66-c7d0-43a9-92b3-07ac91b7baf9 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.146404 Nov 01 01:23:58.124997 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 405/868] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:23:57 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:23:58.897112 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-fd93441c-deed-400c-ac68-c50d7f862ef5 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:23:58.898007 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-fd93441c-deed-400c-ac68-c50d7f862ef5 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:23:58.904696 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-fd93441c-deed-400c-ac68-c50d7f862ef5 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:58.905131 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-fd93441c-deed-400c-ac68-c50d7f862ef5 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:58.905879 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-fd93441c-deed-400c-ac68-c50d7f862ef5 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:58.906305 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-fd93441c-deed-400c-ac68-c50d7f862ef5 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:58.934271 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-fd93441c-deed-400c-ac68-c50d7f862ef5 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040925 Nov 01 01:23:58.934836 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 464/869] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:23:58 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:23:59.141279 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-0b95d8ca-4955-4f56-bb96-c41f8dea4536 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:23:59.141886 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-0b95d8ca-4955-4f56-bb96-c41f8dea4536 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:23:59.148157 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0b95d8ca-4955-4f56-bb96-c41f8dea4536 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:59.148554 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0b95d8ca-4955-4f56-bb96-c41f8dea4536 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:59.149315 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0b95d8ca-4955-4f56-bb96-c41f8dea4536 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:59.149746 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0b95d8ca-4955-4f56-bb96-c41f8dea4536 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:59.275549 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-0b95d8ca-4955-4f56-bb96-c41f8dea4536 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:23:59.285543 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-0b95d8ca-4955-4f56-bb96-c41f8dea4536 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.147926 Nov 01 01:23:59.286097 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 406/870] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:23:59 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:23:59.945012 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-bb256eac-ac95-4c1e-a548-799f972c3ac4 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:23:59.945912 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-bb256eac-ac95-4c1e-a548-799f972c3ac4 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:23:59.952767 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-bb256eac-ac95-4c1e-a548-799f972c3ac4 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:59.955837 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-bb256eac-ac95-4c1e-a548-799f972c3ac4 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:59.955837 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-bb256eac-ac95-4c1e-a548-799f972c3ac4 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:23:59.955837 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-bb256eac-ac95-4c1e-a548-799f972c3ac4 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:23:59.990067 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-bb256eac-ac95-4c1e-a548-799f972c3ac4 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048809 Nov 01 01:23:59.990655 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 465/871] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:23:59 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:24:00.300597 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-2caa98c1-66b6-4ba2-9492-c1cffc7d8f93 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:24:00.301075 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-2caa98c1-66b6-4ba2-9492-c1cffc7d8f93 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:24:00.307317 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-2caa98c1-66b6-4ba2-9492-c1cffc7d8f93 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:00.308428 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-2caa98c1-66b6-4ba2-9492-c1cffc7d8f93 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:00.309185 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-2caa98c1-66b6-4ba2-9492-c1cffc7d8f93 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:00.309606 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-2caa98c1-66b6-4ba2-9492-c1cffc7d8f93 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:00.426645 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-2caa98c1-66b6-4ba2-9492-c1cffc7d8f93 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:24:00.433734 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-2caa98c1-66b6-4ba2-9492-c1cffc7d8f93 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.136775 Nov 01 01:24:00.434291 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 407/872] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:24:00 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:24:01.001432 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-a706b64e-e22f-43ca-a8eb-b6267008d9c9 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:24:01.002337 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-a706b64e-e22f-43ca-a8eb-b6267008d9c9 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:24:01.008661 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a706b64e-e22f-43ca-a8eb-b6267008d9c9 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:01.009105 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a706b64e-e22f-43ca-a8eb-b6267008d9c9 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:01.009871 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a706b64e-e22f-43ca-a8eb-b6267008d9c9 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:01.010299 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a706b64e-e22f-43ca-a8eb-b6267008d9c9 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:01.039302 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-a706b64e-e22f-43ca-a8eb-b6267008d9c9 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041638 Nov 01 01:24:01.039820 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 466/873] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:24:00 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:24:01.449450 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-520b5069-f2dd-4067-b665-f16ddf39f755 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:24:01.450054 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-520b5069-f2dd-4067-b665-f16ddf39f755 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:24:01.456973 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-520b5069-f2dd-4067-b665-f16ddf39f755 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:01.457411 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-520b5069-f2dd-4067-b665-f16ddf39f755 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:01.458160 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-520b5069-f2dd-4067-b665-f16ddf39f755 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:01.458611 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-520b5069-f2dd-4067-b665-f16ddf39f755 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:01.582771 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-520b5069-f2dd-4067-b665-f16ddf39f755 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:24:01.590629 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-520b5069-f2dd-4067-b665-f16ddf39f755 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.144630 Nov 01 01:24:01.591220 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 408/874] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:24:01 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:24:02.050954 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-30ff1e14-776d-44a2-a380-3b941ca60d90 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:24:02.051926 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-30ff1e14-776d-44a2-a380-3b941ca60d90 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:24:02.058149 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-30ff1e14-776d-44a2-a380-3b941ca60d90 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:02.058632 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-30ff1e14-776d-44a2-a380-3b941ca60d90 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:02.059395 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-30ff1e14-776d-44a2-a380-3b941ca60d90 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:02.059823 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-30ff1e14-776d-44a2-a380-3b941ca60d90 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:02.087635 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-30ff1e14-776d-44a2-a380-3b941ca60d90 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040473 Nov 01 01:24:02.088181 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 467/875] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:24:02 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:24:02.607371 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-820c4539-515b-4fa8-bfab-26e4ba9f0e9a tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:24:02.607876 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-820c4539-515b-4fa8-bfab-26e4ba9f0e9a tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:24:02.614325 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-820c4539-515b-4fa8-bfab-26e4ba9f0e9a tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:02.614800 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-820c4539-515b-4fa8-bfab-26e4ba9f0e9a tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:02.615551 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-820c4539-515b-4fa8-bfab-26e4ba9f0e9a tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:02.615979 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-820c4539-515b-4fa8-bfab-26e4ba9f0e9a tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:02.737384 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-820c4539-515b-4fa8-bfab-26e4ba9f0e9a tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:24:02.744682 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-820c4539-515b-4fa8-bfab-26e4ba9f0e9a tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.140986 Nov 01 01:24:02.745744 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 409/876] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:24:02 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:24:03.099456 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-991d21f9-9af1-409f-8607-22275dc6c548 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:24:03.100352 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-991d21f9-9af1-409f-8607-22275dc6c548 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:24:03.107001 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-991d21f9-9af1-409f-8607-22275dc6c548 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:03.107437 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-991d21f9-9af1-409f-8607-22275dc6c548 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:03.108190 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-991d21f9-9af1-409f-8607-22275dc6c548 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:03.108614 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-991d21f9-9af1-409f-8607-22275dc6c548 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:03.136349 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-991d21f9-9af1-409f-8607-22275dc6c548 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040657 Nov 01 01:24:03.136876 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 468/877] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:24:03 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:24:03.761451 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-e7fa3a20-ee89-4ea1-82bd-a6923008fc65 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:24:03.761844 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-e7fa3a20-ee89-4ea1-82bd-a6923008fc65 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:24:03.768085 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e7fa3a20-ee89-4ea1-82bd-a6923008fc65 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:03.768526 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e7fa3a20-ee89-4ea1-82bd-a6923008fc65 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:03.769275 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e7fa3a20-ee89-4ea1-82bd-a6923008fc65 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:03.769720 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e7fa3a20-ee89-4ea1-82bd-a6923008fc65 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:03.888513 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-e7fa3a20-ee89-4ea1-82bd-a6923008fc65 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:24:03.895979 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-e7fa3a20-ee89-4ea1-82bd-a6923008fc65 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.138835 Nov 01 01:24:03.896548 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 410/878] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:24:03 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:24:04.147683 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-aa65c209-aa61-4881-9d8c-9b62954e0d3a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:24:04.148547 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-aa65c209-aa61-4881-9d8c-9b62954e0d3a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:24:04.155404 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-aa65c209-aa61-4881-9d8c-9b62954e0d3a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:04.155848 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-aa65c209-aa61-4881-9d8c-9b62954e0d3a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:04.156617 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-aa65c209-aa61-4881-9d8c-9b62954e0d3a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:04.157046 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-aa65c209-aa61-4881-9d8c-9b62954e0d3a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:04.185185 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-aa65c209-aa61-4881-9d8c-9b62954e0d3a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041417 Nov 01 01:24:04.185719 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 469/879] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:24:04 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:24:04.912580 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-89207740-434e-4cdd-bed8-610e9d618228 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:24:04.913183 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-89207740-434e-4cdd-bed8-610e9d618228 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:24:04.919394 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-89207740-434e-4cdd-bed8-610e9d618228 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:04.919837 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-89207740-434e-4cdd-bed8-610e9d618228 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:04.920581 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-89207740-434e-4cdd-bed8-610e9d618228 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:04.921002 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-89207740-434e-4cdd-bed8-610e9d618228 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:05.040267 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-89207740-434e-4cdd-bed8-610e9d618228 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:24:05.047363 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-89207740-434e-4cdd-bed8-610e9d618228 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.138369 Nov 01 01:24:05.047921 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 411/880] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:24:04 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:24:05.196438 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-3b7a17ac-eeed-4e51-9807-21c285603437 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:24:05.197344 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-3b7a17ac-eeed-4e51-9807-21c285603437 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:24:05.204945 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3b7a17ac-eeed-4e51-9807-21c285603437 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:05.206390 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3b7a17ac-eeed-4e51-9807-21c285603437 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:05.206390 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3b7a17ac-eeed-4e51-9807-21c285603437 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:05.206736 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3b7a17ac-eeed-4e51-9807-21c285603437 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:05.235246 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-3b7a17ac-eeed-4e51-9807-21c285603437 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042544 Nov 01 01:24:05.236061 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 470/881] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:24:05 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:24:06.063152 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-80b48f80-664a-4350-94a4-e2a6403ba011 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:24:06.063787 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-80b48f80-664a-4350-94a4-e2a6403ba011 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:24:06.069982 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-80b48f80-664a-4350-94a4-e2a6403ba011 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:06.070451 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-80b48f80-664a-4350-94a4-e2a6403ba011 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:06.071239 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-80b48f80-664a-4350-94a4-e2a6403ba011 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:06.071664 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-80b48f80-664a-4350-94a4-e2a6403ba011 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:06.190928 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-80b48f80-664a-4350-94a4-e2a6403ba011 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:24:06.198069 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-80b48f80-664a-4350-94a4-e2a6403ba011 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.138572 Nov 01 01:24:06.199154 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 412/882] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:24:06 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:24:06.246863 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-4bb95a7d-7f51-4d18-b4a9-5e14d1cdabf7 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:24:06.247696 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-4bb95a7d-7f51-4d18-b4a9-5e14d1cdabf7 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:24:06.253818 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4bb95a7d-7f51-4d18-b4a9-5e14d1cdabf7 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:06.254261 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4bb95a7d-7f51-4d18-b4a9-5e14d1cdabf7 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:06.255092 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4bb95a7d-7f51-4d18-b4a9-5e14d1cdabf7 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:06.255521 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4bb95a7d-7f51-4d18-b4a9-5e14d1cdabf7 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:06.284961 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-4bb95a7d-7f51-4d18-b4a9-5e14d1cdabf7 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041878 Nov 01 01:24:06.285510 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 471/883] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:24:06 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:24:07.215851 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-c5f8a049-88ab-47bd-b74e-e5e6340eec3b tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:24:07.216460 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-c5f8a049-88ab-47bd-b74e-e5e6340eec3b tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:24:07.222719 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c5f8a049-88ab-47bd-b74e-e5e6340eec3b tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:07.223168 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c5f8a049-88ab-47bd-b74e-e5e6340eec3b tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:07.223934 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c5f8a049-88ab-47bd-b74e-e5e6340eec3b tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:07.224388 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c5f8a049-88ab-47bd-b74e-e5e6340eec3b tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:07.296889 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-b09b82b6-f49e-4c2e-8616-44140f2cba37 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:24:07.297791 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-b09b82b6-f49e-4c2e-8616-44140f2cba37 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:24:07.303897 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b09b82b6-f49e-4c2e-8616-44140f2cba37 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:07.304770 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b09b82b6-f49e-4c2e-8616-44140f2cba37 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:07.305071 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b09b82b6-f49e-4c2e-8616-44140f2cba37 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:07.305488 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b09b82b6-f49e-4c2e-8616-44140f2cba37 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:07.336464 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-b09b82b6-f49e-4c2e-8616-44140f2cba37 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043078 Nov 01 01:24:07.337103 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 472/884] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:24:07 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 01 01:24:07.347472 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-c5f8a049-88ab-47bd-b74e-e5e6340eec3b tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:24:07.355340 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-c5f8a049-88ab-47bd-b74e-e5e6340eec3b tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.143092 Nov 01 01:24:07.355897 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 413/885] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:24:07 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:24:08.348753 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-f74b605e-0879-427e-8c0f-afe517e7fb53 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:24:08.349637 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-f74b605e-0879-427e-8c0f-afe517e7fb53 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:24:08.355873 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f74b605e-0879-427e-8c0f-afe517e7fb53 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:08.356308 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f74b605e-0879-427e-8c0f-afe517e7fb53 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:08.357063 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f74b605e-0879-427e-8c0f-afe517e7fb53 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:08.357487 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f74b605e-0879-427e-8c0f-afe517e7fb53 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:08.372809 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-55ef5ff9-b0dc-485e-84a8-5b7ed1d857bf tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:24:08.373422 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-55ef5ff9-b0dc-485e-84a8-5b7ed1d857bf tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:24:08.380224 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-55ef5ff9-b0dc-485e-84a8-5b7ed1d857bf tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:08.380669 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-55ef5ff9-b0dc-485e-84a8-5b7ed1d857bf tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:08.381436 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-55ef5ff9-b0dc-485e-84a8-5b7ed1d857bf tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:08.381863 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-55ef5ff9-b0dc-485e-84a8-5b7ed1d857bf tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:08.387181 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-f74b605e-0879-427e-8c0f-afe517e7fb53 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042450 Nov 01 01:24:08.387734 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 473/886] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:24:08 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:24:08.497285 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-55ef5ff9-b0dc-485e-84a8-5b7ed1d857bf tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:24:08.508642 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-55ef5ff9-b0dc-485e-84a8-5b7ed1d857bf tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.139444 Nov 01 01:24:08.509218 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 414/887] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:24:08 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:24:09.398546 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-f4c2b9f8-e80d-48d5-9c5f-ce14daee0d79 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:24:09.399449 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-f4c2b9f8-e80d-48d5-9c5f-ce14daee0d79 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:24:09.405600 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f4c2b9f8-e80d-48d5-9c5f-ce14daee0d79 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:09.406039 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f4c2b9f8-e80d-48d5-9c5f-ce14daee0d79 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:09.406808 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f4c2b9f8-e80d-48d5-9c5f-ce14daee0d79 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:09.407233 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f4c2b9f8-e80d-48d5-9c5f-ce14daee0d79 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:09.434586 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-f4c2b9f8-e80d-48d5-9c5f-ce14daee0d79 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039688 Nov 01 01:24:09.435118 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 474/888] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:24:09 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:24:09.525050 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-18c44e83-e630-45a8-bd01-6bf18d344182 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:24:09.525648 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-18c44e83-e630-45a8-bd01-6bf18d344182 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:24:09.531834 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-18c44e83-e630-45a8-bd01-6bf18d344182 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:09.532273 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-18c44e83-e630-45a8-bd01-6bf18d344182 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:09.533024 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-18c44e83-e630-45a8-bd01-6bf18d344182 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:09.533456 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-18c44e83-e630-45a8-bd01-6bf18d344182 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:09.660730 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-18c44e83-e630-45a8-bd01-6bf18d344182 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:24:09.667849 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-18c44e83-e630-45a8-bd01-6bf18d344182 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.146456 Nov 01 01:24:09.668405 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 415/889] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:24:09 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:24:10.446654 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-413f52ba-60ea-468b-a1ad-efdeb49232b5 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:24:10.447585 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-413f52ba-60ea-468b-a1ad-efdeb49232b5 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:24:10.454266 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-413f52ba-60ea-468b-a1ad-efdeb49232b5 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:10.454749 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-413f52ba-60ea-468b-a1ad-efdeb49232b5 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:10.455510 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-413f52ba-60ea-468b-a1ad-efdeb49232b5 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:10.455937 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-413f52ba-60ea-468b-a1ad-efdeb49232b5 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:10.484130 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-413f52ba-60ea-468b-a1ad-efdeb49232b5 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041252 Nov 01 01:24:10.484667 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 475/890] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:24:10 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:24:10.684912 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-13d29ef0-7138-4e69-b1f9-6351f18b4110 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:24:10.685499 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-13d29ef0-7138-4e69-b1f9-6351f18b4110 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:24:10.691623 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-13d29ef0-7138-4e69-b1f9-6351f18b4110 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:10.692060 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-13d29ef0-7138-4e69-b1f9-6351f18b4110 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:10.692830 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-13d29ef0-7138-4e69-b1f9-6351f18b4110 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:10.693233 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-13d29ef0-7138-4e69-b1f9-6351f18b4110 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:10.814951 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-13d29ef0-7138-4e69-b1f9-6351f18b4110 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:24:10.822055 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-13d29ef0-7138-4e69-b1f9-6351f18b4110 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.140905 Nov 01 01:24:10.822626 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 416/891] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:24:10 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:24:11.495565 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-e9e3e773-d299-45b1-b789-86f9f6b3ffa6 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:24:11.496465 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-e9e3e773-d299-45b1-b789-86f9f6b3ffa6 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:24:11.503201 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e9e3e773-d299-45b1-b789-86f9f6b3ffa6 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:11.503640 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e9e3e773-d299-45b1-b789-86f9f6b3ffa6 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:11.504390 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e9e3e773-d299-45b1-b789-86f9f6b3ffa6 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:11.504812 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e9e3e773-d299-45b1-b789-86f9f6b3ffa6 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:11.532694 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-e9e3e773-d299-45b1-b789-86f9f6b3ffa6 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040876 Nov 01 01:24:11.533220 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 476/892] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:24:11 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:24:11.838977 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-b25e50e1-ee3a-40e3-8049-eac67424ee6d tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:24:11.839673 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-b25e50e1-ee3a-40e3-8049-eac67424ee6d tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:24:11.846318 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b25e50e1-ee3a-40e3-8049-eac67424ee6d tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:11.846813 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b25e50e1-ee3a-40e3-8049-eac67424ee6d tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:11.847579 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b25e50e1-ee3a-40e3-8049-eac67424ee6d tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:11.848009 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b25e50e1-ee3a-40e3-8049-eac67424ee6d tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:11.966864 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-b25e50e1-ee3a-40e3-8049-eac67424ee6d tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:24:11.974733 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-b25e50e1-ee3a-40e3-8049-eac67424ee6d tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.139232 Nov 01 01:24:11.975288 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 417/893] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:24:11 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:24:12.543902 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-a10bdcb1-2ee5-46f7-a255-9a9a38841e73 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:24:12.544805 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-a10bdcb1-2ee5-46f7-a255-9a9a38841e73 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:24:12.551074 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a10bdcb1-2ee5-46f7-a255-9a9a38841e73 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:12.551527 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a10bdcb1-2ee5-46f7-a255-9a9a38841e73 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:12.552281 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a10bdcb1-2ee5-46f7-a255-9a9a38841e73 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:12.552706 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a10bdcb1-2ee5-46f7-a255-9a9a38841e73 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:12.581923 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-a10bdcb1-2ee5-46f7-a255-9a9a38841e73 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041804 Nov 01 01:24:12.582502 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 477/894] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:24:12 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:24:12.991782 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-59e583dd-2d76-42b1-94ec-c9c8c565bbe7 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:24:12.992386 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-59e583dd-2d76-42b1-94ec-c9c8c565bbe7 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:24:12.998581 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-59e583dd-2d76-42b1-94ec-c9c8c565bbe7 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:12.999025 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-59e583dd-2d76-42b1-94ec-c9c8c565bbe7 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:12.999783 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-59e583dd-2d76-42b1-94ec-c9c8c565bbe7 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:13.000208 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-59e583dd-2d76-42b1-94ec-c9c8c565bbe7 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:13.120991 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-59e583dd-2d76-42b1-94ec-c9c8c565bbe7 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:24:13.128139 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-59e583dd-2d76-42b1-94ec-c9c8c565bbe7 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.139915 Nov 01 01:24:13.128695 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 418/895] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:24:12 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:24:13.593209 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-60c78735-ac40-4b9c-9882-3b3342421806 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:24:13.594115 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-60c78735-ac40-4b9c-9882-3b3342421806 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:24:13.600873 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-60c78735-ac40-4b9c-9882-3b3342421806 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:13.601317 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-60c78735-ac40-4b9c-9882-3b3342421806 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:13.602089 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-60c78735-ac40-4b9c-9882-3b3342421806 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:13.602551 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-60c78735-ac40-4b9c-9882-3b3342421806 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:13.632392 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-60c78735-ac40-4b9c-9882-3b3342421806 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042847 Nov 01 01:24:13.632874 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 478/896] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:24:13 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:24:14.144558 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-5e333577-d917-4ee7-8e08-94d4c071ad3a tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:24:14.145121 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-5e333577-d917-4ee7-8e08-94d4c071ad3a tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:24:14.151312 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-5e333577-d917-4ee7-8e08-94d4c071ad3a tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:14.151752 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-5e333577-d917-4ee7-8e08-94d4c071ad3a tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:14.152503 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-5e333577-d917-4ee7-8e08-94d4c071ad3a tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:14.152930 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-5e333577-d917-4ee7-8e08-94d4c071ad3a tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:14.268135 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-5e333577-d917-4ee7-8e08-94d4c071ad3a tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:24:14.275234 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-5e333577-d917-4ee7-8e08-94d4c071ad3a tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.134379 Nov 01 01:24:14.275792 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 419/897] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:24:14 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:24:14.643631 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-9b28884e-0a3a-4bba-b99f-f7d9ce732757 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:24:14.644539 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-9b28884e-0a3a-4bba-b99f-f7d9ce732757 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:24:14.651545 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9b28884e-0a3a-4bba-b99f-f7d9ce732757 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:14.651990 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9b28884e-0a3a-4bba-b99f-f7d9ce732757 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:14.652760 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9b28884e-0a3a-4bba-b99f-f7d9ce732757 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:14.655213 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9b28884e-0a3a-4bba-b99f-f7d9ce732757 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:14.684933 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-9b28884e-0a3a-4bba-b99f-f7d9ce732757 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045024 Nov 01 01:24:14.685485 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 479/898] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:24:14 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:24:15.291672 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-df04a165-69d8-4753-a6a7-572cc4036038 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:24:15.292299 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-df04a165-69d8-4753-a6a7-572cc4036038 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:24:15.298548 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-df04a165-69d8-4753-a6a7-572cc4036038 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:15.298984 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-df04a165-69d8-4753-a6a7-572cc4036038 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:15.299808 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-df04a165-69d8-4753-a6a7-572cc4036038 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:15.300227 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-df04a165-69d8-4753-a6a7-572cc4036038 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:15.417596 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-df04a165-69d8-4753-a6a7-572cc4036038 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:24:15.424715 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-df04a165-69d8-4753-a6a7-572cc4036038 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.136682 Nov 01 01:24:15.425258 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 420/899] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:24:15 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:24:15.696719 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-159bb255-d9fd-4b17-b6d6-cf0c7a20495e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:24:15.697768 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-159bb255-d9fd-4b17-b6d6-cf0c7a20495e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:24:15.703961 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-159bb255-d9fd-4b17-b6d6-cf0c7a20495e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:15.704404 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-159bb255-d9fd-4b17-b6d6-cf0c7a20495e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:15.705164 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-159bb255-d9fd-4b17-b6d6-cf0c7a20495e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:15.705598 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-159bb255-d9fd-4b17-b6d6-cf0c7a20495e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:15.733060 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-159bb255-d9fd-4b17-b6d6-cf0c7a20495e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040067 Nov 01 01:24:15.733600 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 480/900] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:24:15 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:24:16.441255 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-68777a55-8ddc-46a7-b295-586f3429d84c tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:24:16.441860 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-68777a55-8ddc-46a7-b295-586f3429d84c tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:24:16.448201 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-68777a55-8ddc-46a7-b295-586f3429d84c tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:16.448642 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-68777a55-8ddc-46a7-b295-586f3429d84c tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:16.449481 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-68777a55-8ddc-46a7-b295-586f3429d84c tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:16.449911 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-68777a55-8ddc-46a7-b295-586f3429d84c tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:16.570657 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-68777a55-8ddc-46a7-b295-586f3429d84c tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:24:16.577875 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-68777a55-8ddc-46a7-b295-586f3429d84c tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.140292 Nov 01 01:24:16.578460 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 421/901] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:24:16 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:24:16.745031 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-67ec9664-fb72-4ce8-a01d-52541e30ed33 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:24:16.745942 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-67ec9664-fb72-4ce8-a01d-52541e30ed33 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:24:16.752172 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-67ec9664-fb72-4ce8-a01d-52541e30ed33 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:16.752620 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-67ec9664-fb72-4ce8-a01d-52541e30ed33 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:16.753380 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-67ec9664-fb72-4ce8-a01d-52541e30ed33 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:16.753813 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-67ec9664-fb72-4ce8-a01d-52541e30ed33 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:16.782511 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-67ec9664-fb72-4ce8-a01d-52541e30ed33 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041288 Nov 01 01:24:16.783055 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 481/902] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:24:16 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:24:17.595425 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-4202c0cc-f770-4852-beb8-1846c7e9645b tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:24:17.595935 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-4202c0cc-f770-4852-beb8-1846c7e9645b tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:24:17.602380 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4202c0cc-f770-4852-beb8-1846c7e9645b tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:17.602848 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4202c0cc-f770-4852-beb8-1846c7e9645b tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:17.603604 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4202c0cc-f770-4852-beb8-1846c7e9645b tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:17.604029 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4202c0cc-f770-4852-beb8-1846c7e9645b tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:17.793857 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-50e5f4e8-ebe9-4f11-a323-84dfbc14e165 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:24:17.811191 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-50e5f4e8-ebe9-4f11-a323-84dfbc14e165 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:24:17.817891 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-50e5f4e8-ebe9-4f11-a323-84dfbc14e165 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:17.818365 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-50e5f4e8-ebe9-4f11-a323-84dfbc14e165 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:17.819242 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-50e5f4e8-ebe9-4f11-a323-84dfbc14e165 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:17.819667 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-50e5f4e8-ebe9-4f11-a323-84dfbc14e165 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:17.850053 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-50e5f4e8-ebe9-4f11-a323-84dfbc14e165 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060539 Nov 01 01:24:17.850566 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 482/903] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:24:17 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 01 01:24:17.932964 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-4202c0cc-f770-4852-beb8-1846c7e9645b tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:24:17.940120 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-4202c0cc-f770-4852-beb8-1846c7e9645b tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.348645 Nov 01 01:24:17.940683 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 422/904] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:24:17 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:24:18.862374 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-cf6e1267-1dfd-461d-867b-64d4711e9f33 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:24:18.863332 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-cf6e1267-1dfd-461d-867b-64d4711e9f33 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:24:18.870094 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-cf6e1267-1dfd-461d-867b-64d4711e9f33 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:18.870574 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-cf6e1267-1dfd-461d-867b-64d4711e9f33 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:18.871343 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-cf6e1267-1dfd-461d-867b-64d4711e9f33 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:18.871778 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-cf6e1267-1dfd-461d-867b-64d4711e9f33 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:18.900149 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-cf6e1267-1dfd-461d-867b-64d4711e9f33 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041746 Nov 01 01:24:18.900699 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 483/905] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:24:18 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:24:18.956634 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-47ffb0eb-e216-4051-b3df-89cffd2d122c tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:24:18.957233 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-47ffb0eb-e216-4051-b3df-89cffd2d122c tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:24:18.963422 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-47ffb0eb-e216-4051-b3df-89cffd2d122c tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:18.963857 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-47ffb0eb-e216-4051-b3df-89cffd2d122c tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:18.964607 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-47ffb0eb-e216-4051-b3df-89cffd2d122c tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:18.965030 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-47ffb0eb-e216-4051-b3df-89cffd2d122c tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:19.082809 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-47ffb0eb-e216-4051-b3df-89cffd2d122c tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:24:19.089947 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-47ffb0eb-e216-4051-b3df-89cffd2d122c tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.136838 Nov 01 01:24:19.090578 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 423/906] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:24:18 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:24:19.911397 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-09135ea9-5360-458f-8114-a393049b8e13 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:24:19.912300 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-09135ea9-5360-458f-8114-a393049b8e13 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:24:19.918444 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-09135ea9-5360-458f-8114-a393049b8e13 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:19.918906 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-09135ea9-5360-458f-8114-a393049b8e13 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:19.919669 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-09135ea9-5360-458f-8114-a393049b8e13 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:19.920099 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-09135ea9-5360-458f-8114-a393049b8e13 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:19.948720 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-09135ea9-5360-458f-8114-a393049b8e13 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041097 Nov 01 01:24:19.949259 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 484/907] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:24:19 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:24:20.106262 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-2c25a689-762e-4990-9dcd-bb46008b4402 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:24:20.106889 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-2c25a689-762e-4990-9dcd-bb46008b4402 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:24:20.113584 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-2c25a689-762e-4990-9dcd-bb46008b4402 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:20.114143 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-2c25a689-762e-4990-9dcd-bb46008b4402 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:20.114941 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-2c25a689-762e-4990-9dcd-bb46008b4402 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:20.115373 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-2c25a689-762e-4990-9dcd-bb46008b4402 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:20.249073 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-2c25a689-762e-4990-9dcd-bb46008b4402 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:24:20.257333 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-2c25a689-762e-4990-9dcd-bb46008b4402 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.154566 Nov 01 01:24:20.259812 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 424/908] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:24:20 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:24:20.959876 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-a00cb2b4-9c05-4e35-83a8-fa6b87f1a578 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:24:20.960770 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-a00cb2b4-9c05-4e35-83a8-fa6b87f1a578 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:24:20.967499 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a00cb2b4-9c05-4e35-83a8-fa6b87f1a578 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:20.967939 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a00cb2b4-9c05-4e35-83a8-fa6b87f1a578 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:20.968691 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a00cb2b4-9c05-4e35-83a8-fa6b87f1a578 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:20.969115 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a00cb2b4-9c05-4e35-83a8-fa6b87f1a578 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:20.998237 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-a00cb2b4-9c05-4e35-83a8-fa6b87f1a578 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042030 Nov 01 01:24:21.004741 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 485/909] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:24:20 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:24:21.275673 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-c31c2e2c-1523-4586-bb15-f5347beb5758 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:24:21.276294 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-c31c2e2c-1523-4586-bb15-f5347beb5758 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:24:21.282689 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c31c2e2c-1523-4586-bb15-f5347beb5758 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:21.283191 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c31c2e2c-1523-4586-bb15-f5347beb5758 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:21.283963 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c31c2e2c-1523-4586-bb15-f5347beb5758 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:21.284394 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c31c2e2c-1523-4586-bb15-f5347beb5758 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:21.402607 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-c31c2e2c-1523-4586-bb15-f5347beb5758 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:24:21.409671 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-c31c2e2c-1523-4586-bb15-f5347beb5758 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.138544 Nov 01 01:24:21.410248 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 425/910] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:24:21 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:24:22.009655 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-4a69002f-44c1-4aa4-8374-b9819ce87645 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:24:22.010645 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-4a69002f-44c1-4aa4-8374-b9819ce87645 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:24:22.016882 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4a69002f-44c1-4aa4-8374-b9819ce87645 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:22.017325 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4a69002f-44c1-4aa4-8374-b9819ce87645 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:22.018084 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4a69002f-44c1-4aa4-8374-b9819ce87645 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:22.018549 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4a69002f-44c1-4aa4-8374-b9819ce87645 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:22.047695 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-4a69002f-44c1-4aa4-8374-b9819ce87645 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041875 Nov 01 01:24:22.048250 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 486/911] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:24:22 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:24:22.426046 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-ba4c1156-7c94-4f23-9994-94ed21fb2186 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:24:22.426666 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-ba4c1156-7c94-4f23-9994-94ed21fb2186 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:24:22.432830 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ba4c1156-7c94-4f23-9994-94ed21fb2186 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:22.433269 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ba4c1156-7c94-4f23-9994-94ed21fb2186 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:22.434014 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ba4c1156-7c94-4f23-9994-94ed21fb2186 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:22.434445 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ba4c1156-7c94-4f23-9994-94ed21fb2186 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:22.553325 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-ba4c1156-7c94-4f23-9994-94ed21fb2186 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:24:22.560574 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-ba4c1156-7c94-4f23-9994-94ed21fb2186 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.138171 Nov 01 01:24:22.561129 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 426/912] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:24:22 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:24:23.058684 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-1c6bb98e-ae60-4851-9ba6-63fe8533f783 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:24:23.059590 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-1c6bb98e-ae60-4851-9ba6-63fe8533f783 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:24:23.065705 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1c6bb98e-ae60-4851-9ba6-63fe8533f783 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:23.066144 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1c6bb98e-ae60-4851-9ba6-63fe8533f783 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:23.066936 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1c6bb98e-ae60-4851-9ba6-63fe8533f783 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:23.067368 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1c6bb98e-ae60-4851-9ba6-63fe8533f783 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:23.095925 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-1c6bb98e-ae60-4851-9ba6-63fe8533f783 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041482 Nov 01 01:24:23.096464 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 487/913] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:24:23 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:24:23.577034 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-f9045654-078b-4c1a-b38a-53428100946e tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:24:23.577621 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-f9045654-078b-4c1a-b38a-53428100946e tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:24:23.584417 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f9045654-078b-4c1a-b38a-53428100946e tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:23.584856 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f9045654-078b-4c1a-b38a-53428100946e tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:23.585602 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f9045654-078b-4c1a-b38a-53428100946e tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:23.586687 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f9045654-078b-4c1a-b38a-53428100946e tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:23.709359 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-f9045654-078b-4c1a-b38a-53428100946e tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:24:23.716493 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-f9045654-078b-4c1a-b38a-53428100946e tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.143109 Nov 01 01:24:23.717051 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 427/914] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:24:23 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:24:24.107622 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-ffd7972b-ebd4-4325-8aa6-bb7266c6d06a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:24:24.108556 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-ffd7972b-ebd4-4325-8aa6-bb7266c6d06a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:24:24.114996 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ffd7972b-ebd4-4325-8aa6-bb7266c6d06a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:24.115435 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ffd7972b-ebd4-4325-8aa6-bb7266c6d06a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:24.116183 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ffd7972b-ebd4-4325-8aa6-bb7266c6d06a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:24.116602 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ffd7972b-ebd4-4325-8aa6-bb7266c6d06a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:24.144473 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-ffd7972b-ebd4-4325-8aa6-bb7266c6d06a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040578 Nov 01 01:24:24.145007 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 488/915] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:24:24 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:24:24.733521 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-2f41291c-2a24-4272-b175-1aa31e5f1680 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:24:24.734115 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-2f41291c-2a24-4272-b175-1aa31e5f1680 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:24:24.740556 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-2f41291c-2a24-4272-b175-1aa31e5f1680 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:24.740991 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-2f41291c-2a24-4272-b175-1aa31e5f1680 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:24.741739 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-2f41291c-2a24-4272-b175-1aa31e5f1680 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:24.742200 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-2f41291c-2a24-4272-b175-1aa31e5f1680 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:24.857795 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-2f41291c-2a24-4272-b175-1aa31e5f1680 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:24:24.865246 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-2f41291c-2a24-4272-b175-1aa31e5f1680 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.135390 Nov 01 01:24:24.865806 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 428/916] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:24:24 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:24:25.156460 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-6a7bdcbb-70e8-4890-85b3-0fd2d2dbd0c6 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:24:25.157336 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-6a7bdcbb-70e8-4890-85b3-0fd2d2dbd0c6 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:24:25.163580 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6a7bdcbb-70e8-4890-85b3-0fd2d2dbd0c6 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:25.164086 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6a7bdcbb-70e8-4890-85b3-0fd2d2dbd0c6 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:25.164845 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6a7bdcbb-70e8-4890-85b3-0fd2d2dbd0c6 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:25.165275 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6a7bdcbb-70e8-4890-85b3-0fd2d2dbd0c6 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:25.193955 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-6a7bdcbb-70e8-4890-85b3-0fd2d2dbd0c6 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041435 Nov 01 01:24:25.194521 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 489/917] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:24:25 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 01 01:24:25.880991 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-9ca0b214-ca01-456e-835b-06b9c839daad tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:24:25.881595 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-9ca0b214-ca01-456e-835b-06b9c839daad tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:24:25.887825 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9ca0b214-ca01-456e-835b-06b9c839daad tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:25.888290 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9ca0b214-ca01-456e-835b-06b9c839daad tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:25.889068 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9ca0b214-ca01-456e-835b-06b9c839daad tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:25.889495 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9ca0b214-ca01-456e-835b-06b9c839daad tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:26.008538 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-9ca0b214-ca01-456e-835b-06b9c839daad tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:24:26.014237 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-9ca0b214-ca01-456e-835b-06b9c839daad tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.136909 Nov 01 01:24:26.014821 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 429/918] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:24:25 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:24:26.205896 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-0c136e97-3522-413b-bed5-4a72d06367b1 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:24:26.206875 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-0c136e97-3522-413b-bed5-4a72d06367b1 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:24:26.213608 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0c136e97-3522-413b-bed5-4a72d06367b1 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:26.214049 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0c136e97-3522-413b-bed5-4a72d06367b1 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:26.214832 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0c136e97-3522-413b-bed5-4a72d06367b1 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:26.215258 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0c136e97-3522-413b-bed5-4a72d06367b1 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:26.243729 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-0c136e97-3522-413b-bed5-4a72d06367b1 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041638 Nov 01 01:24:26.244259 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 490/919] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:24:26 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:24:27.036641 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-375c3027-6759-4314-9b1f-7bd5d441a3c0 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:24:27.037188 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-375c3027-6759-4314-9b1f-7bd5d441a3c0 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:24:27.043890 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-375c3027-6759-4314-9b1f-7bd5d441a3c0 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:27.044326 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-375c3027-6759-4314-9b1f-7bd5d441a3c0 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:27.045119 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-375c3027-6759-4314-9b1f-7bd5d441a3c0 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:27.045539 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-375c3027-6759-4314-9b1f-7bd5d441a3c0 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:27.167154 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-375c3027-6759-4314-9b1f-7bd5d441a3c0 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:24:27.174222 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-375c3027-6759-4314-9b1f-7bd5d441a3c0 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.146923 Nov 01 01:24:27.174809 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 430/920] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:24:27 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:24:27.254779 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-a98b3515-9ff3-4064-953c-f8c50532d999 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:24:27.255669 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-a98b3515-9ff3-4064-953c-f8c50532d999 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:24:27.262040 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a98b3515-9ff3-4064-953c-f8c50532d999 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:27.262497 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a98b3515-9ff3-4064-953c-f8c50532d999 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:27.263252 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a98b3515-9ff3-4064-953c-f8c50532d999 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:27.263673 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a98b3515-9ff3-4064-953c-f8c50532d999 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:27.296760 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-a98b3515-9ff3-4064-953c-f8c50532d999 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040685 Nov 01 01:24:27.296760 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 491/921] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:24:27 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:24:28.191197 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-9e64d56b-65ec-43d5-b6ae-a6185468744d tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:24:28.191796 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-9e64d56b-65ec-43d5-b6ae-a6185468744d tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:24:28.197923 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9e64d56b-65ec-43d5-b6ae-a6185468744d tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:28.198338 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9e64d56b-65ec-43d5-b6ae-a6185468744d tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:28.199119 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9e64d56b-65ec-43d5-b6ae-a6185468744d tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:28.199539 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9e64d56b-65ec-43d5-b6ae-a6185468744d tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:28.306087 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-658b02cf-1b9b-4100-90a4-e062395026e2 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:24:28.307023 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-658b02cf-1b9b-4100-90a4-e062395026e2 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:24:28.313166 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-658b02cf-1b9b-4100-90a4-e062395026e2 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:28.313606 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-658b02cf-1b9b-4100-90a4-e062395026e2 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:28.314371 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-658b02cf-1b9b-4100-90a4-e062395026e2 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:28.314828 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-658b02cf-1b9b-4100-90a4-e062395026e2 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:28.320020 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-9e64d56b-65ec-43d5-b6ae-a6185468744d tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:24:28.327650 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-9e64d56b-65ec-43d5-b6ae-a6185468744d tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.140132 Nov 01 01:24:28.328221 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 431/922] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:24:28 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:24:28.343624 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-658b02cf-1b9b-4100-90a4-e062395026e2 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041214 Nov 01 01:24:28.344178 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 492/923] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:24:28 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 01 01:24:29.344304 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-b9ce8195-40d2-4dc7-aabc-a68fa0c35880 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:24:29.345002 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-b9ce8195-40d2-4dc7-aabc-a68fa0c35880 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:24:29.351542 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b9ce8195-40d2-4dc7-aabc-a68fa0c35880 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:29.351988 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b9ce8195-40d2-4dc7-aabc-a68fa0c35880 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:29.352771 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b9ce8195-40d2-4dc7-aabc-a68fa0c35880 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:29.353191 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b9ce8195-40d2-4dc7-aabc-a68fa0c35880 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:29.354846 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-94d79327-77cb-4beb-ac1d-f8c9ccf75112 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:24:29.355977 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-94d79327-77cb-4beb-ac1d-f8c9ccf75112 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:24:29.362830 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-94d79327-77cb-4beb-ac1d-f8c9ccf75112 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:29.363281 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-94d79327-77cb-4beb-ac1d-f8c9ccf75112 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:29.364647 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-94d79327-77cb-4beb-ac1d-f8c9ccf75112 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:29.365090 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-94d79327-77cb-4beb-ac1d-f8c9ccf75112 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:29.394558 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-94d79327-77cb-4beb-ac1d-f8c9ccf75112 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043325 Nov 01 01:24:29.395127 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 493/924] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:24:29 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 01 01:24:29.473272 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-b9ce8195-40d2-4dc7-aabc-a68fa0c35880 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:24:29.480514 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-b9ce8195-40d2-4dc7-aabc-a68fa0c35880 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.139948 Nov 01 01:24:29.481077 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 432/925] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:24:29 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:24:30.405477 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-f1fe9548-0431-4940-b6bc-8144699ddc4f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:24:30.406411 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-f1fe9548-0431-4940-b6bc-8144699ddc4f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:24:30.412610 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f1fe9548-0431-4940-b6bc-8144699ddc4f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:30.413052 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f1fe9548-0431-4940-b6bc-8144699ddc4f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:30.413807 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f1fe9548-0431-4940-b6bc-8144699ddc4f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:30.414235 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f1fe9548-0431-4940-b6bc-8144699ddc4f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:30.442164 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-f1fe9548-0431-4940-b6bc-8144699ddc4f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040390 Nov 01 01:24:30.442736 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 494/926] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:24:30 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:24:30.496695 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-d8d8c54f-21b1-41c4-8130-d659317ec0bc tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:24:30.497318 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-d8d8c54f-21b1-41c4-8130-d659317ec0bc tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:24:30.503534 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d8d8c54f-21b1-41c4-8130-d659317ec0bc tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:30.503979 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d8d8c54f-21b1-41c4-8130-d659317ec0bc tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:30.504733 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d8d8c54f-21b1-41c4-8130-d659317ec0bc tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:30.505159 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d8d8c54f-21b1-41c4-8130-d659317ec0bc tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:30.634105 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-d8d8c54f-21b1-41c4-8130-d659317ec0bc tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:24:30.641392 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-d8d8c54f-21b1-41c4-8130-d659317ec0bc tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.148339 Nov 01 01:24:30.641953 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 433/927] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:24:30 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:24:31.453817 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-90be2ea2-1e88-4512-8f59-c8cfa0e6b5de tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:24:31.454756 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-90be2ea2-1e88-4512-8f59-c8cfa0e6b5de tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:24:31.461213 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-90be2ea2-1e88-4512-8f59-c8cfa0e6b5de tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:31.461656 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-90be2ea2-1e88-4512-8f59-c8cfa0e6b5de tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:31.462435 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-90be2ea2-1e88-4512-8f59-c8cfa0e6b5de tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:31.462873 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-90be2ea2-1e88-4512-8f59-c8cfa0e6b5de tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:31.490717 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-90be2ea2-1e88-4512-8f59-c8cfa0e6b5de tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040789 Nov 01 01:24:31.491260 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 495/928] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:24:31 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:24:31.658122 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-c99d6a20-c9f0-48da-bdfc-9a86b91bc640 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:24:31.658692 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-c99d6a20-c9f0-48da-bdfc-9a86b91bc640 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:24:31.665140 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c99d6a20-c9f0-48da-bdfc-9a86b91bc640 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:31.666087 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c99d6a20-c9f0-48da-bdfc-9a86b91bc640 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:31.666875 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c99d6a20-c9f0-48da-bdfc-9a86b91bc640 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:31.667316 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c99d6a20-c9f0-48da-bdfc-9a86b91bc640 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:31.788743 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-c99d6a20-c9f0-48da-bdfc-9a86b91bc640 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:24:31.797057 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-c99d6a20-c9f0-48da-bdfc-9a86b91bc640 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.142622 Nov 01 01:24:31.797624 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 434/929] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:24:31 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:24:32.501939 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-485aff06-13ca-49dd-a1f4-bfae7038084a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:24:32.502863 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-485aff06-13ca-49dd-a1f4-bfae7038084a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:24:32.509478 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-485aff06-13ca-49dd-a1f4-bfae7038084a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:32.509923 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-485aff06-13ca-49dd-a1f4-bfae7038084a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:32.510698 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-485aff06-13ca-49dd-a1f4-bfae7038084a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:32.511179 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-485aff06-13ca-49dd-a1f4-bfae7038084a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:32.539009 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-485aff06-13ca-49dd-a1f4-bfae7038084a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040837 Nov 01 01:24:32.539538 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 496/930] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:24:32 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:24:32.814165 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-8f47ad34-5de8-44d1-b604-9694b4105a78 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:24:32.814808 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-8f47ad34-5de8-44d1-b604-9694b4105a78 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:24:32.820909 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8f47ad34-5de8-44d1-b604-9694b4105a78 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:32.821470 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8f47ad34-5de8-44d1-b604-9694b4105a78 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:32.822853 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8f47ad34-5de8-44d1-b604-9694b4105a78 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:32.823367 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8f47ad34-5de8-44d1-b604-9694b4105a78 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:32.949353 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-8f47ad34-5de8-44d1-b604-9694b4105a78 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:24:32.956389 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-8f47ad34-5de8-44d1-b604-9694b4105a78 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.146138 Nov 01 01:24:32.956938 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 435/931] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:24:32 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:24:33.549929 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-76091d73-a584-40a1-8a66-bb73de34fe6e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:24:33.551012 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-76091d73-a584-40a1-8a66-bb73de34fe6e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:24:33.557221 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-76091d73-a584-40a1-8a66-bb73de34fe6e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:33.557660 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-76091d73-a584-40a1-8a66-bb73de34fe6e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:33.558409 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-76091d73-a584-40a1-8a66-bb73de34fe6e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:33.558854 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-76091d73-a584-40a1-8a66-bb73de34fe6e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:33.586672 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-76091d73-a584-40a1-8a66-bb73de34fe6e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040494 Nov 01 01:24:33.587725 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 497/932] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:24:33 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:24:33.972875 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-5d127d3f-4d08-4cbe-b13a-4d8ed0075522 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:24:33.973512 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-5d127d3f-4d08-4cbe-b13a-4d8ed0075522 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:24:33.979805 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-5d127d3f-4d08-4cbe-b13a-4d8ed0075522 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:33.980248 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-5d127d3f-4d08-4cbe-b13a-4d8ed0075522 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:33.981028 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-5d127d3f-4d08-4cbe-b13a-4d8ed0075522 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:33.981831 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-5d127d3f-4d08-4cbe-b13a-4d8ed0075522 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:34.108019 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-5d127d3f-4d08-4cbe-b13a-4d8ed0075522 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:24:34.115599 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-5d127d3f-4d08-4cbe-b13a-4d8ed0075522 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.146432 Nov 01 01:24:34.116155 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 436/933] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:24:33 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:24:34.598339 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-59a58d62-1231-4705-8731-6c2370cea560 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:24:34.599300 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-59a58d62-1231-4705-8731-6c2370cea560 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:24:34.605948 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-59a58d62-1231-4705-8731-6c2370cea560 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:34.606387 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-59a58d62-1231-4705-8731-6c2370cea560 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:34.607159 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-59a58d62-1231-4705-8731-6c2370cea560 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:34.607582 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-59a58d62-1231-4705-8731-6c2370cea560 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:34.635976 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-59a58d62-1231-4705-8731-6c2370cea560 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041257 Nov 01 01:24:34.636433 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 498/934] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:24:34 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:24:35.131716 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-fa8873a2-de16-405f-bb60-c0416fe2d5bc tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:24:35.132317 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-fa8873a2-de16-405f-bb60-c0416fe2d5bc tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:24:35.139111 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-fa8873a2-de16-405f-bb60-c0416fe2d5bc tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:35.139553 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-fa8873a2-de16-405f-bb60-c0416fe2d5bc tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:35.140358 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-fa8873a2-de16-405f-bb60-c0416fe2d5bc tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:35.140737 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-fa8873a2-de16-405f-bb60-c0416fe2d5bc tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:35.260250 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-fa8873a2-de16-405f-bb60-c0416fe2d5bc tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:24:35.267430 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-fa8873a2-de16-405f-bb60-c0416fe2d5bc tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.139335 Nov 01 01:24:35.268014 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 437/935] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:24:35 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:24:35.647129 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-048d8ad0-77e0-4783-9ef6-bfc8111fd928 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:24:35.648061 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-048d8ad0-77e0-4783-9ef6-bfc8111fd928 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:24:35.654748 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-048d8ad0-77e0-4783-9ef6-bfc8111fd928 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:35.655190 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-048d8ad0-77e0-4783-9ef6-bfc8111fd928 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:35.655949 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-048d8ad0-77e0-4783-9ef6-bfc8111fd928 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:35.656375 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-048d8ad0-77e0-4783-9ef6-bfc8111fd928 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:35.685008 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-048d8ad0-77e0-4783-9ef6-bfc8111fd928 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041567 Nov 01 01:24:35.685553 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 499/936] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:24:35 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:24:36.284173 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-43a338f5-ba5c-4ce4-93e7-60448acc80b1 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:24:36.284802 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-43a338f5-ba5c-4ce4-93e7-60448acc80b1 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:24:36.290962 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-43a338f5-ba5c-4ce4-93e7-60448acc80b1 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:36.291405 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-43a338f5-ba5c-4ce4-93e7-60448acc80b1 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:36.292156 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-43a338f5-ba5c-4ce4-93e7-60448acc80b1 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:36.292586 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-43a338f5-ba5c-4ce4-93e7-60448acc80b1 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:36.412720 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-43a338f5-ba5c-4ce4-93e7-60448acc80b1 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:24:36.419892 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-43a338f5-ba5c-4ce4-93e7-60448acc80b1 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.139456 Nov 01 01:24:36.420458 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 438/937] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:24:36 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:24:36.695996 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-6d1ed23c-bfb9-488b-a096-06cfe454051e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:24:36.697582 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-6d1ed23c-bfb9-488b-a096-06cfe454051e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:24:36.703812 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6d1ed23c-bfb9-488b-a096-06cfe454051e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:36.704255 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6d1ed23c-bfb9-488b-a096-06cfe454051e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:36.705007 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6d1ed23c-bfb9-488b-a096-06cfe454051e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:36.705434 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6d1ed23c-bfb9-488b-a096-06cfe454051e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:36.733582 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-6d1ed23c-bfb9-488b-a096-06cfe454051e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041370 Nov 01 01:24:36.734122 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 500/938] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:24:36 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:24:37.436590 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-bf47d910-e620-48c9-96c4-d53dd4fdc537 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:24:37.437198 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-bf47d910-e620-48c9-96c4-d53dd4fdc537 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:24:37.443476 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-bf47d910-e620-48c9-96c4-d53dd4fdc537 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:37.443915 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-bf47d910-e620-48c9-96c4-d53dd4fdc537 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:37.444666 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-bf47d910-e620-48c9-96c4-d53dd4fdc537 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:37.445090 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-bf47d910-e620-48c9-96c4-d53dd4fdc537 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:37.564644 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-bf47d910-e620-48c9-96c4-d53dd4fdc537 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:24:37.572323 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-bf47d910-e620-48c9-96c4-d53dd4fdc537 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.138977 Nov 01 01:24:37.572887 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 439/939] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:24:37 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:24:37.745077 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-83199538-2f00-4951-b681-119cf85de938 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:24:37.745985 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-83199538-2f00-4951-b681-119cf85de938 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:24:37.752233 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-83199538-2f00-4951-b681-119cf85de938 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:37.752685 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-83199538-2f00-4951-b681-119cf85de938 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:37.753445 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-83199538-2f00-4951-b681-119cf85de938 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:37.753879 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-83199538-2f00-4951-b681-119cf85de938 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:37.783422 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-83199538-2f00-4951-b681-119cf85de938 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042080 Nov 01 01:24:37.783983 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 501/940] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:24:37 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:24:38.589703 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-c5d2520b-35eb-448d-a949-c0a4a4f33cfd tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:24:38.590386 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-c5d2520b-35eb-448d-a949-c0a4a4f33cfd tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:24:38.596609 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c5d2520b-35eb-448d-a949-c0a4a4f33cfd tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:38.597049 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c5d2520b-35eb-448d-a949-c0a4a4f33cfd tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:38.597800 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c5d2520b-35eb-448d-a949-c0a4a4f33cfd tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:38.598229 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c5d2520b-35eb-448d-a949-c0a4a4f33cfd tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:38.721255 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-c5d2520b-35eb-448d-a949-c0a4a4f33cfd tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:24:38.729076 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-c5d2520b-35eb-448d-a949-c0a4a4f33cfd tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.142470 Nov 01 01:24:38.729637 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 440/941] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:24:38 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:24:38.795266 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-d2871fd7-303e-4f45-a8b5-da3b06037367 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:24:38.796170 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-d2871fd7-303e-4f45-a8b5-da3b06037367 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:24:38.802346 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d2871fd7-303e-4f45-a8b5-da3b06037367 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:38.803066 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d2871fd7-303e-4f45-a8b5-da3b06037367 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:38.803829 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d2871fd7-303e-4f45-a8b5-da3b06037367 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:38.804259 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d2871fd7-303e-4f45-a8b5-da3b06037367 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:38.831987 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-d2871fd7-303e-4f45-a8b5-da3b06037367 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041041 Nov 01 01:24:38.832810 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 502/942] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:24:38 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 01 01:24:39.745402 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-bbce2b55-ad1e-4072-bb29-7832090e33c1 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:24:39.746005 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-bbce2b55-ad1e-4072-bb29-7832090e33c1 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:24:39.752225 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-bbce2b55-ad1e-4072-bb29-7832090e33c1 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:39.752667 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-bbce2b55-ad1e-4072-bb29-7832090e33c1 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:39.753416 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-bbce2b55-ad1e-4072-bb29-7832090e33c1 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:39.753844 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-bbce2b55-ad1e-4072-bb29-7832090e33c1 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:39.843411 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-743de591-852f-42c0-b93c-c9368c39e014 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:24:39.844302 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-743de591-852f-42c0-b93c-c9368c39e014 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:24:39.850465 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-743de591-852f-42c0-b93c-c9368c39e014 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:39.850915 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-743de591-852f-42c0-b93c-c9368c39e014 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:39.851677 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-743de591-852f-42c0-b93c-c9368c39e014 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:39.852107 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-743de591-852f-42c0-b93c-c9368c39e014 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:39.871345 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-bbce2b55-ad1e-4072-bb29-7832090e33c1 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:24:39.878551 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-bbce2b55-ad1e-4072-bb29-7832090e33c1 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.137341 Nov 01 01:24:39.879090 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 441/943] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:24:39 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:24:39.881675 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-743de591-852f-42c0-b93c-c9368c39e014 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041907 Nov 01 01:24:39.882228 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 503/944] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:24:39 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 01 01:24:40.893194 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-c32e50f0-3fe7-4723-978c-04e08472c463 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:24:40.894156 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-c32e50f0-3fe7-4723-978c-04e08472c463 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:24:40.894831 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-5f1e5a98-7953-4c8b-8069-4c88b13296b7 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:24:40.895443 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-5f1e5a98-7953-4c8b-8069-4c88b13296b7 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:24:40.900426 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c32e50f0-3fe7-4723-978c-04e08472c463 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:40.900940 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c32e50f0-3fe7-4723-978c-04e08472c463 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:40.901528 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5f1e5a98-7953-4c8b-8069-4c88b13296b7 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:40.901638 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c32e50f0-3fe7-4723-978c-04e08472c463 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:40.901971 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5f1e5a98-7953-4c8b-8069-4c88b13296b7 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:40.902089 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c32e50f0-3fe7-4723-978c-04e08472c463 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:40.902758 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5f1e5a98-7953-4c8b-8069-4c88b13296b7 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:40.903180 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5f1e5a98-7953-4c8b-8069-4c88b13296b7 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:40.930075 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-c32e50f0-3fe7-4723-978c-04e08472c463 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040815 Nov 01 01:24:40.930659 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 442/945] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:24:40 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:24:41.024052 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-5f1e5a98-7953-4c8b-8069-4c88b13296b7 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:24:41.031176 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-5f1e5a98-7953-4c8b-8069-4c88b13296b7 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.140093 Nov 01 01:24:41.031726 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 504/946] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:24:40 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:24:41.941860 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-185779af-0582-4386-8f24-2dfb6f490d35 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:24:41.942787 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-185779af-0582-4386-8f24-2dfb6f490d35 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:24:41.949617 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-185779af-0582-4386-8f24-2dfb6f490d35 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:41.950065 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-185779af-0582-4386-8f24-2dfb6f490d35 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:41.950839 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-185779af-0582-4386-8f24-2dfb6f490d35 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:41.951263 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-185779af-0582-4386-8f24-2dfb6f490d35 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:41.978716 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-185779af-0582-4386-8f24-2dfb6f490d35 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040559 Nov 01 01:24:41.979250 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 443/947] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:24:41 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:24:42.047394 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-b4142c77-da50-46f5-a191-867393aa5189 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:24:42.047992 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-b4142c77-da50-46f5-a191-867393aa5189 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:24:42.054184 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b4142c77-da50-46f5-a191-867393aa5189 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:42.054656 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b4142c77-da50-46f5-a191-867393aa5189 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:42.055448 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b4142c77-da50-46f5-a191-867393aa5189 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:42.055865 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b4142c77-da50-46f5-a191-867393aa5189 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:42.190605 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-b4142c77-da50-46f5-a191-867393aa5189 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:24:42.197673 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-b4142c77-da50-46f5-a191-867393aa5189 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.153847 Nov 01 01:24:42.198161 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 505/948] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:24:42 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:24:42.990137 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-fb7dc413-6e1b-4971-9aca-507aa61566b1 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:24:42.991102 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-fb7dc413-6e1b-4971-9aca-507aa61566b1 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:24:42.997255 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-fb7dc413-6e1b-4971-9aca-507aa61566b1 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:42.997705 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-fb7dc413-6e1b-4971-9aca-507aa61566b1 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:42.998479 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-fb7dc413-6e1b-4971-9aca-507aa61566b1 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:42.998911 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-fb7dc413-6e1b-4971-9aca-507aa61566b1 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:43.027944 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-fb7dc413-6e1b-4971-9aca-507aa61566b1 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041534 Nov 01 01:24:43.028493 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 444/949] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:24:42 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:24:43.213769 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-a37cf252-63fe-4e07-8bc7-32131724479e tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:24:43.214407 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-a37cf252-63fe-4e07-8bc7-32131724479e tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:24:43.220605 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a37cf252-63fe-4e07-8bc7-32131724479e tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:43.221048 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a37cf252-63fe-4e07-8bc7-32131724479e tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:43.221812 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a37cf252-63fe-4e07-8bc7-32131724479e tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:43.222244 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a37cf252-63fe-4e07-8bc7-32131724479e tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:43.340968 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-a37cf252-63fe-4e07-8bc7-32131724479e tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:24:43.348589 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-a37cf252-63fe-4e07-8bc7-32131724479e tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.138392 Nov 01 01:24:43.349166 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 506/950] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:24:43 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:24:44.039191 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-8f392901-5ae8-4028-9750-27a295eef507 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:24:44.040108 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-8f392901-5ae8-4028-9750-27a295eef507 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:24:44.046953 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8f392901-5ae8-4028-9750-27a295eef507 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:44.047413 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8f392901-5ae8-4028-9750-27a295eef507 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:44.048152 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8f392901-5ae8-4028-9750-27a295eef507 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:44.048578 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8f392901-5ae8-4028-9750-27a295eef507 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:44.077876 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-8f392901-5ae8-4028-9750-27a295eef507 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042453 Nov 01 01:24:44.078397 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 445/951] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:24:44 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:24:44.365171 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-66263ed3-b74c-49db-a986-6825b578ff23 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:24:44.365648 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-66263ed3-b74c-49db-a986-6825b578ff23 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:24:44.371611 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-66263ed3-b74c-49db-a986-6825b578ff23 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:44.372057 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-66263ed3-b74c-49db-a986-6825b578ff23 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:44.372819 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-66263ed3-b74c-49db-a986-6825b578ff23 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:44.373247 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-66263ed3-b74c-49db-a986-6825b578ff23 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:44.494723 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-66263ed3-b74c-49db-a986-6825b578ff23 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:24:44.501917 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-66263ed3-b74c-49db-a986-6825b578ff23 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.140620 Nov 01 01:24:44.502503 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 507/952] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:24:44 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:24:45.089528 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-956a7902-8b5d-4b78-9205-fd7db3944ee4 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:24:45.090468 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-956a7902-8b5d-4b78-9205-fd7db3944ee4 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:24:45.096871 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-956a7902-8b5d-4b78-9205-fd7db3944ee4 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:45.097317 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-956a7902-8b5d-4b78-9205-fd7db3944ee4 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:45.098081 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-956a7902-8b5d-4b78-9205-fd7db3944ee4 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:45.098544 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-956a7902-8b5d-4b78-9205-fd7db3944ee4 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:45.126694 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-956a7902-8b5d-4b78-9205-fd7db3944ee4 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041449 Nov 01 01:24:45.127235 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 446/953] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:24:45 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:24:45.518002 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-38bad1ed-d6de-48c0-ba25-ef503da7ec10 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:24:45.518634 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-38bad1ed-d6de-48c0-ba25-ef503da7ec10 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:24:45.524786 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-38bad1ed-d6de-48c0-ba25-ef503da7ec10 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:45.525229 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-38bad1ed-d6de-48c0-ba25-ef503da7ec10 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:45.525986 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-38bad1ed-d6de-48c0-ba25-ef503da7ec10 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:45.526472 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-38bad1ed-d6de-48c0-ba25-ef503da7ec10 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:45.643148 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-38bad1ed-d6de-48c0-ba25-ef503da7ec10 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:24:45.650252 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-38bad1ed-d6de-48c0-ba25-ef503da7ec10 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.135822 Nov 01 01:24:45.650843 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 508/954] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:24:45 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:24:46.138124 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-6cf012ca-1bab-4137-add3-2ce8bbbafac1 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:24:46.139109 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-6cf012ca-1bab-4137-add3-2ce8bbbafac1 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:24:46.145300 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-6cf012ca-1bab-4137-add3-2ce8bbbafac1 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:46.145746 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-6cf012ca-1bab-4137-add3-2ce8bbbafac1 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:46.146539 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-6cf012ca-1bab-4137-add3-2ce8bbbafac1 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:46.146970 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-6cf012ca-1bab-4137-add3-2ce8bbbafac1 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:46.174774 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-6cf012ca-1bab-4137-add3-2ce8bbbafac1 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041079 Nov 01 01:24:46.175326 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 447/955] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:24:46 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:24:46.667257 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-9c2e455a-a77c-4fa9-a139-a41073ca1906 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:24:46.667807 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-9c2e455a-a77c-4fa9-a139-a41073ca1906 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:24:46.674624 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9c2e455a-a77c-4fa9-a139-a41073ca1906 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:46.675061 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9c2e455a-a77c-4fa9-a139-a41073ca1906 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:46.675808 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9c2e455a-a77c-4fa9-a139-a41073ca1906 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:46.676316 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9c2e455a-a77c-4fa9-a139-a41073ca1906 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:46.794306 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-9c2e455a-a77c-4fa9-a139-a41073ca1906 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:24:46.801317 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-9c2e455a-a77c-4fa9-a139-a41073ca1906 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.138240 Nov 01 01:24:46.801872 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 509/956] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:24:46 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:24:47.186108 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-31a65faf-9ded-4211-a5a3-099eec6bf520 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:24:47.187049 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-31a65faf-9ded-4211-a5a3-099eec6bf520 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:24:47.192850 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-31a65faf-9ded-4211-a5a3-099eec6bf520 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:47.193322 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-31a65faf-9ded-4211-a5a3-099eec6bf520 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:47.194073 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-31a65faf-9ded-4211-a5a3-099eec6bf520 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:47.194523 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-31a65faf-9ded-4211-a5a3-099eec6bf520 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:47.224360 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-31a65faf-9ded-4211-a5a3-099eec6bf520 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042161 Nov 01 01:24:47.224899 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 448/957] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:24:47 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:24:47.818907 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-af417fb3-7f5f-4a18-ace8-30846606a158 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:24:47.819452 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-af417fb3-7f5f-4a18-ace8-30846606a158 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:24:47.825528 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-af417fb3-7f5f-4a18-ace8-30846606a158 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:47.825967 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-af417fb3-7f5f-4a18-ace8-30846606a158 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:47.826756 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-af417fb3-7f5f-4a18-ace8-30846606a158 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:47.827180 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-af417fb3-7f5f-4a18-ace8-30846606a158 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:47.947964 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-af417fb3-7f5f-4a18-ace8-30846606a158 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:24:47.955724 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-af417fb3-7f5f-4a18-ace8-30846606a158 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.140778 Nov 01 01:24:47.956273 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 510/958] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:24:47 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:24:48.236349 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-05ed65bb-6947-4937-9b40-b781df307580 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:24:48.237256 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-05ed65bb-6947-4937-9b40-b781df307580 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:24:48.243412 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-05ed65bb-6947-4937-9b40-b781df307580 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:48.243855 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-05ed65bb-6947-4937-9b40-b781df307580 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:48.244611 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-05ed65bb-6947-4937-9b40-b781df307580 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:48.245034 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-05ed65bb-6947-4937-9b40-b781df307580 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:48.273512 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-05ed65bb-6947-4937-9b40-b781df307580 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041167 Nov 01 01:24:48.274049 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 449/959] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:24:48 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:24:48.973616 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-fd981e0c-20c6-4062-898c-6f1ea02b38cd tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:24:48.974704 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-fd981e0c-20c6-4062-898c-6f1ea02b38cd tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:24:48.981421 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-fd981e0c-20c6-4062-898c-6f1ea02b38cd tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:48.981882 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-fd981e0c-20c6-4062-898c-6f1ea02b38cd tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:48.982661 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-fd981e0c-20c6-4062-898c-6f1ea02b38cd tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:48.983095 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-fd981e0c-20c6-4062-898c-6f1ea02b38cd tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:49.114934 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-fd981e0c-20c6-4062-898c-6f1ea02b38cd tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:24:49.123073 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-fd981e0c-20c6-4062-898c-6f1ea02b38cd tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.154558 Nov 01 01:24:49.123644 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 511/960] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:24:48 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:24:49.285153 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-ddc557cd-9d12-4948-b412-5661f5e15061 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:24:49.286040 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-ddc557cd-9d12-4948-b412-5661f5e15061 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:24:49.292373 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ddc557cd-9d12-4948-b412-5661f5e15061 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:49.292821 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ddc557cd-9d12-4948-b412-5661f5e15061 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:49.294223 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ddc557cd-9d12-4948-b412-5661f5e15061 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:49.294686 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ddc557cd-9d12-4948-b412-5661f5e15061 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:49.322981 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-ddc557cd-9d12-4948-b412-5661f5e15061 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041606 Nov 01 01:24:49.323536 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 450/961] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:24:49 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:24:50.140600 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-48a3496e-f991-41b1-8045-d60251e19039 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:24:50.141225 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-48a3496e-f991-41b1-8045-d60251e19039 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:24:50.147579 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-48a3496e-f991-41b1-8045-d60251e19039 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:50.148034 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-48a3496e-f991-41b1-8045-d60251e19039 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:50.148798 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-48a3496e-f991-41b1-8045-d60251e19039 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:50.149228 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-48a3496e-f991-41b1-8045-d60251e19039 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:50.265649 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-48a3496e-f991-41b1-8045-d60251e19039 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:24:50.272824 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-48a3496e-f991-41b1-8045-d60251e19039 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.136862 Nov 01 01:24:50.273386 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 512/962] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:24:50 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:24:50.333925 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-75c04651-a52b-4559-ad66-2254b4a2d909 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:24:50.334889 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-75c04651-a52b-4559-ad66-2254b4a2d909 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:24:50.341111 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-75c04651-a52b-4559-ad66-2254b4a2d909 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:50.341553 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-75c04651-a52b-4559-ad66-2254b4a2d909 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:50.342348 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-75c04651-a52b-4559-ad66-2254b4a2d909 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:50.342803 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-75c04651-a52b-4559-ad66-2254b4a2d909 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:50.372391 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-75c04651-a52b-4559-ad66-2254b4a2d909 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042114 Nov 01 01:24:50.372947 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 451/963] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:24:50 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:24:51.288388 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-f762bb2c-aeb6-4f5d-b6e4-b16ef245badd tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:24:51.288996 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-f762bb2c-aeb6-4f5d-b6e4-b16ef245badd tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:24:51.295859 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f762bb2c-aeb6-4f5d-b6e4-b16ef245badd tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:51.296307 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f762bb2c-aeb6-4f5d-b6e4-b16ef245badd tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:51.297066 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f762bb2c-aeb6-4f5d-b6e4-b16ef245badd tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:51.297495 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f762bb2c-aeb6-4f5d-b6e4-b16ef245badd tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:51.383820 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-9534840e-9504-4c40-a039-700dd63a9b5b tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:24:51.384832 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-9534840e-9504-4c40-a039-700dd63a9b5b tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:24:51.391045 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9534840e-9504-4c40-a039-700dd63a9b5b tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:51.391576 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9534840e-9504-4c40-a039-700dd63a9b5b tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:51.392403 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9534840e-9504-4c40-a039-700dd63a9b5b tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:51.392897 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9534840e-9504-4c40-a039-700dd63a9b5b tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:51.419446 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-f762bb2c-aeb6-4f5d-b6e4-b16ef245badd tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:24:51.423062 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-9534840e-9504-4c40-a039-700dd63a9b5b tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042970 Nov 01 01:24:51.423758 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 452/964] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:24:51 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 01 01:24:51.426573 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-f762bb2c-aeb6-4f5d-b6e4-b16ef245badd tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.141783 Nov 01 01:24:51.427124 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 513/965] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:24:51 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:24:52.434887 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-f18dc72e-fa07-4a66-973c-4027e7d97ebe tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:24:52.435794 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-f18dc72e-fa07-4a66-973c-4027e7d97ebe tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:24:52.442070 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f18dc72e-fa07-4a66-973c-4027e7d97ebe tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:52.442546 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f18dc72e-fa07-4a66-973c-4027e7d97ebe tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:52.442765 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-4d5f9209-1194-440b-ae01-b89ca08f338d tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:24:52.443313 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f18dc72e-fa07-4a66-973c-4027e7d97ebe tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:52.443423 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-4d5f9209-1194-440b-ae01-b89ca08f338d tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:24:52.443742 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f18dc72e-fa07-4a66-973c-4027e7d97ebe tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:52.449987 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4d5f9209-1194-440b-ae01-b89ca08f338d tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:52.450449 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4d5f9209-1194-440b-ae01-b89ca08f338d tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:52.451213 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4d5f9209-1194-440b-ae01-b89ca08f338d tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:52.451637 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4d5f9209-1194-440b-ae01-b89ca08f338d tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:52.472615 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-f18dc72e-fa07-4a66-973c-4027e7d97ebe tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041986 Nov 01 01:24:52.473176 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 453/966] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:24:52 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:24:52.568229 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-4d5f9209-1194-440b-ae01-b89ca08f338d tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:24:52.575388 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-4d5f9209-1194-440b-ae01-b89ca08f338d tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.136341 Nov 01 01:24:52.575947 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 514/967] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:24:52 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:24:53.484727 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-152c64b3-cd1b-4827-a16d-d1861be05333 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:24:53.485631 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-152c64b3-cd1b-4827-a16d-d1861be05333 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:24:53.491822 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-152c64b3-cd1b-4827-a16d-d1861be05333 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:53.492268 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-152c64b3-cd1b-4827-a16d-d1861be05333 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:53.493020 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-152c64b3-cd1b-4827-a16d-d1861be05333 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:53.493446 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-152c64b3-cd1b-4827-a16d-d1861be05333 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:53.521671 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-152c64b3-cd1b-4827-a16d-d1861be05333 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041522 Nov 01 01:24:53.522213 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 454/968] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:24:53 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:24:53.592014 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-b0691c9d-010a-47b6-85a1-60fca0079580 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:24:53.592624 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-b0691c9d-010a-47b6-85a1-60fca0079580 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:24:53.598985 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b0691c9d-010a-47b6-85a1-60fca0079580 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:53.599428 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b0691c9d-010a-47b6-85a1-60fca0079580 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:53.600179 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b0691c9d-010a-47b6-85a1-60fca0079580 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:53.600604 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b0691c9d-010a-47b6-85a1-60fca0079580 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:53.717783 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-b0691c9d-010a-47b6-85a1-60fca0079580 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:24:53.724886 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-b0691c9d-010a-47b6-85a1-60fca0079580 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.136927 Nov 01 01:24:53.725477 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 515/969] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:24:53 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:24:54.533827 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-aa1bc992-d41e-40da-b697-e4dd196612ff tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:24:54.534787 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-aa1bc992-d41e-40da-b697-e4dd196612ff tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:24:54.540890 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-aa1bc992-d41e-40da-b697-e4dd196612ff tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:54.541325 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-aa1bc992-d41e-40da-b697-e4dd196612ff tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:54.542076 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-aa1bc992-d41e-40da-b697-e4dd196612ff tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:54.542533 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-aa1bc992-d41e-40da-b697-e4dd196612ff tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:54.570230 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-aa1bc992-d41e-40da-b697-e4dd196612ff tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040260 Nov 01 01:24:54.570786 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 455/970] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:24:54 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:24:54.742119 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-fbfc5880-937b-4331-b006-2844b11c34a8 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:24:54.742781 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-fbfc5880-937b-4331-b006-2844b11c34a8 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:24:54.748963 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-fbfc5880-937b-4331-b006-2844b11c34a8 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:54.749407 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-fbfc5880-937b-4331-b006-2844b11c34a8 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:54.750162 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-fbfc5880-937b-4331-b006-2844b11c34a8 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:54.750633 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-fbfc5880-937b-4331-b006-2844b11c34a8 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:54.873964 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-fbfc5880-937b-4331-b006-2844b11c34a8 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:24:54.881234 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-fbfc5880-937b-4331-b006-2844b11c34a8 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.142728 Nov 01 01:24:54.881973 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 516/971] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:24:54 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:24:55.581177 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-ad2d8ef1-3df2-4cfd-93a3-fa6d3bf295a6 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:24:55.582079 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-ad2d8ef1-3df2-4cfd-93a3-fa6d3bf295a6 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:24:55.588285 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ad2d8ef1-3df2-4cfd-93a3-fa6d3bf295a6 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:55.588719 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ad2d8ef1-3df2-4cfd-93a3-fa6d3bf295a6 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:55.589467 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ad2d8ef1-3df2-4cfd-93a3-fa6d3bf295a6 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:55.589949 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ad2d8ef1-3df2-4cfd-93a3-fa6d3bf295a6 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:55.619259 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-ad2d8ef1-3df2-4cfd-93a3-fa6d3bf295a6 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041846 Nov 01 01:24:55.619728 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 456/972] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:24:55 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:24:55.897970 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-1b586d52-ff11-4aba-bb68-4fe8ee5b63ed tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:24:55.898709 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-1b586d52-ff11-4aba-bb68-4fe8ee5b63ed tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:24:55.905639 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1b586d52-ff11-4aba-bb68-4fe8ee5b63ed tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:55.906078 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1b586d52-ff11-4aba-bb68-4fe8ee5b63ed tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:55.906860 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1b586d52-ff11-4aba-bb68-4fe8ee5b63ed tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:55.907287 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1b586d52-ff11-4aba-bb68-4fe8ee5b63ed tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:56.025895 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-1b586d52-ff11-4aba-bb68-4fe8ee5b63ed tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:24:56.033731 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-1b586d52-ff11-4aba-bb68-4fe8ee5b63ed tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.139332 Nov 01 01:24:56.034289 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 517/973] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:24:55 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:24:56.631142 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-5d3764b2-3653-427e-be08-85dfe7be45b8 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:24:56.632017 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-5d3764b2-3653-427e-be08-85dfe7be45b8 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:24:56.638866 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-5d3764b2-3653-427e-be08-85dfe7be45b8 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:56.639319 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-5d3764b2-3653-427e-be08-85dfe7be45b8 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:56.640075 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-5d3764b2-3653-427e-be08-85dfe7be45b8 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:56.640506 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-5d3764b2-3653-427e-be08-85dfe7be45b8 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:56.668957 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-5d3764b2-3653-427e-be08-85dfe7be45b8 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041697 Nov 01 01:24:56.669510 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 457/974] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:24:56 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:24:57.050670 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-f2ff32e9-bace-4651-bc65-8ebb03105833 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:24:57.051267 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-f2ff32e9-bace-4651-bc65-8ebb03105833 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:24:57.057395 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f2ff32e9-bace-4651-bc65-8ebb03105833 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:57.057836 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f2ff32e9-bace-4651-bc65-8ebb03105833 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:57.059240 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f2ff32e9-bace-4651-bc65-8ebb03105833 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:57.059668 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f2ff32e9-bace-4651-bc65-8ebb03105833 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:57.178510 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-f2ff32e9-bace-4651-bc65-8ebb03105833 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:24:57.186190 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-f2ff32e9-bace-4651-bc65-8ebb03105833 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.139130 Nov 01 01:24:57.186783 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 518/975] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:24:57 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:24:57.679367 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-9e4d0007-e145-4976-a0af-0f58e8d9f171 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:24:57.680307 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-9e4d0007-e145-4976-a0af-0f58e8d9f171 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:24:57.686494 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9e4d0007-e145-4976-a0af-0f58e8d9f171 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:57.686935 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9e4d0007-e145-4976-a0af-0f58e8d9f171 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:57.687692 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9e4d0007-e145-4976-a0af-0f58e8d9f171 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:57.688120 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9e4d0007-e145-4976-a0af-0f58e8d9f171 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:57.716867 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-9e4d0007-e145-4976-a0af-0f58e8d9f171 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041232 Nov 01 01:24:57.717401 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 458/976] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:24:57 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 01 01:24:58.203129 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-5dcfbd88-591b-4adb-8544-89a81de8812b tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:24:58.203670 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-5dcfbd88-591b-4adb-8544-89a81de8812b tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:24:58.209860 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5dcfbd88-591b-4adb-8544-89a81de8812b tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:58.210298 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5dcfbd88-591b-4adb-8544-89a81de8812b tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:58.211122 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5dcfbd88-591b-4adb-8544-89a81de8812b tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:58.211545 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5dcfbd88-591b-4adb-8544-89a81de8812b tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:58.333262 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-5dcfbd88-591b-4adb-8544-89a81de8812b tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:24:58.341028 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-5dcfbd88-591b-4adb-8544-89a81de8812b tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.141654 Nov 01 01:24:58.341588 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 519/977] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:24:58 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:24:58.728070 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-111df636-0e25-4d85-801d-1e00e8a18009 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:24:58.728987 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-111df636-0e25-4d85-801d-1e00e8a18009 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:24:58.735965 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-111df636-0e25-4d85-801d-1e00e8a18009 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:58.736410 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-111df636-0e25-4d85-801d-1e00e8a18009 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:58.737322 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-111df636-0e25-4d85-801d-1e00e8a18009 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:58.737794 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-111df636-0e25-4d85-801d-1e00e8a18009 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:58.766908 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-111df636-0e25-4d85-801d-1e00e8a18009 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042538 Nov 01 01:24:58.767460 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 459/978] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:24:58 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:24:59.356969 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-538a1304-dc6b-412b-b0cb-e544fd3fe632 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:24:59.357491 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-538a1304-dc6b-412b-b0cb-e544fd3fe632 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:24:59.364019 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-538a1304-dc6b-412b-b0cb-e544fd3fe632 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:59.364462 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-538a1304-dc6b-412b-b0cb-e544fd3fe632 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:59.365358 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-538a1304-dc6b-412b-b0cb-e544fd3fe632 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:59.365786 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-538a1304-dc6b-412b-b0cb-e544fd3fe632 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:59.489666 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-538a1304-dc6b-412b-b0cb-e544fd3fe632 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:24:59.497150 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-538a1304-dc6b-412b-b0cb-e544fd3fe632 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.143901 Nov 01 01:24:59.497702 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 520/979] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:24:59 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:24:59.778521 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-2df3c0e8-d6b1-4fb8-92f6-943d07e9df09 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:24:59.779421 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-2df3c0e8-d6b1-4fb8-92f6-943d07e9df09 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:24:59.785622 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-2df3c0e8-d6b1-4fb8-92f6-943d07e9df09 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:59.786128 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-2df3c0e8-d6b1-4fb8-92f6-943d07e9df09 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:59.787274 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-2df3c0e8-d6b1-4fb8-92f6-943d07e9df09 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:24:59.787768 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-2df3c0e8-d6b1-4fb8-92f6-943d07e9df09 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:24:59.816351 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-2df3c0e8-d6b1-4fb8-92f6-943d07e9df09 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041701 Nov 01 01:24:59.816889 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 460/980] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:24:59 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:25:00.513288 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-a99e4649-9217-4803-8507-36efcb43cd4c tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:25:00.514024 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-a99e4649-9217-4803-8507-36efcb43cd4c tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:25:00.520686 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a99e4649-9217-4803-8507-36efcb43cd4c tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:00.521127 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a99e4649-9217-4803-8507-36efcb43cd4c tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:00.521884 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a99e4649-9217-4803-8507-36efcb43cd4c tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:00.522306 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a99e4649-9217-4803-8507-36efcb43cd4c tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:00.642369 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-a99e4649-9217-4803-8507-36efcb43cd4c tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:25:00.649998 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-a99e4649-9217-4803-8507-36efcb43cd4c tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.140563 Nov 01 01:25:00.650581 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 521/981] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:25:00 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:25:00.827090 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-981b8746-80b0-4b4a-a3b3-8da3f4c69cd2 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:25:00.828141 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-981b8746-80b0-4b4a-a3b3-8da3f4c69cd2 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:25:00.834566 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-981b8746-80b0-4b4a-a3b3-8da3f4c69cd2 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:00.835021 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-981b8746-80b0-4b4a-a3b3-8da3f4c69cd2 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:00.835782 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-981b8746-80b0-4b4a-a3b3-8da3f4c69cd2 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:00.836213 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-981b8746-80b0-4b4a-a3b3-8da3f4c69cd2 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:00.865418 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-981b8746-80b0-4b4a-a3b3-8da3f4c69cd2 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042112 Nov 01 01:25:00.865970 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 461/982] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:25:00 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:25:01.666560 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-f2c38ad6-e7cc-42c5-b17a-cb0fc12c3160 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:25:01.667119 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-f2c38ad6-e7cc-42c5-b17a-cb0fc12c3160 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:25:01.673352 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f2c38ad6-e7cc-42c5-b17a-cb0fc12c3160 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:01.673797 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f2c38ad6-e7cc-42c5-b17a-cb0fc12c3160 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:01.674581 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f2c38ad6-e7cc-42c5-b17a-cb0fc12c3160 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:01.675011 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f2c38ad6-e7cc-42c5-b17a-cb0fc12c3160 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:01.797027 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-f2c38ad6-e7cc-42c5-b17a-cb0fc12c3160 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:25:01.804181 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-f2c38ad6-e7cc-42c5-b17a-cb0fc12c3160 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.141351 Nov 01 01:25:01.804744 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 522/983] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:25:01 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:25:01.876626 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-32e3a5a9-fac7-464b-a03f-d65789d24806 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:25:01.877541 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-32e3a5a9-fac7-464b-a03f-d65789d24806 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:25:01.883696 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-32e3a5a9-fac7-464b-a03f-d65789d24806 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:01.884143 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-32e3a5a9-fac7-464b-a03f-d65789d24806 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:01.884907 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-32e3a5a9-fac7-464b-a03f-d65789d24806 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:01.885342 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-32e3a5a9-fac7-464b-a03f-d65789d24806 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:01.913752 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-32e3a5a9-fac7-464b-a03f-d65789d24806 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040797 Nov 01 01:25:01.914295 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 462/984] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:25:01 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:25:02.821199 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-74ef0f84-e028-4dd2-abd0-17c94bf2758b tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:25:02.822409 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-74ef0f84-e028-4dd2-abd0-17c94bf2758b tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:25:02.829209 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-74ef0f84-e028-4dd2-abd0-17c94bf2758b tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:02.829668 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-74ef0f84-e028-4dd2-abd0-17c94bf2758b tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:02.830447 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-74ef0f84-e028-4dd2-abd0-17c94bf2758b tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:02.830891 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-74ef0f84-e028-4dd2-abd0-17c94bf2758b tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:02.924821 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-6e341689-cf0d-4759-aa9f-eca4fb39c0d2 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:25:02.925720 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-6e341689-cf0d-4759-aa9f-eca4fb39c0d2 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:25:02.931778 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-6e341689-cf0d-4759-aa9f-eca4fb39c0d2 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:02.932215 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-6e341689-cf0d-4759-aa9f-eca4fb39c0d2 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:02.932984 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-6e341689-cf0d-4759-aa9f-eca4fb39c0d2 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:02.933967 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-6e341689-cf0d-4759-aa9f-eca4fb39c0d2 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:02.948179 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-74ef0f84-e028-4dd2-abd0-17c94bf2758b tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:25:02.956123 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-74ef0f84-e028-4dd2-abd0-17c94bf2758b tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.138654 Nov 01 01:25:02.956869 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 523/985] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:25:02 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:25:02.963423 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-6e341689-cf0d-4759-aa9f-eca4fb39c0d2 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042213 Nov 01 01:25:02.963906 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 463/986] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:25:02 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 01 01:25:03.972871 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-dcc7b61e-8b5e-4858-af3b-79048485962c tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:25:03.973478 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-dcc7b61e-8b5e-4858-af3b-79048485962c tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:25:03.973999 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-5ffcc96b-635c-4d1c-9c15-80538c795fdc tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:25:03.974948 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-5ffcc96b-635c-4d1c-9c15-80538c795fdc tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:25:03.979772 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-dcc7b61e-8b5e-4858-af3b-79048485962c tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:03.980843 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-dcc7b61e-8b5e-4858-af3b-79048485962c tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:03.981620 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-dcc7b61e-8b5e-4858-af3b-79048485962c tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:03.981832 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-5ffcc96b-635c-4d1c-9c15-80538c795fdc tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:03.982057 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-dcc7b61e-8b5e-4858-af3b-79048485962c tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:03.982272 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-5ffcc96b-635c-4d1c-9c15-80538c795fdc tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:03.983060 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-5ffcc96b-635c-4d1c-9c15-80538c795fdc tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:03.983487 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-5ffcc96b-635c-4d1c-9c15-80538c795fdc tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:04.013718 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-5ffcc96b-635c-4d1c-9c15-80538c795fdc tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043457 Nov 01 01:25:04.014280 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 464/987] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:25:03 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 01 01:25:04.102360 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-dcc7b61e-8b5e-4858-af3b-79048485962c tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:25:04.110540 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-dcc7b61e-8b5e-4858-af3b-79048485962c tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.141454 Nov 01 01:25:04.111130 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 524/988] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:25:03 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:25:05.025036 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-cbf3f892-43bc-4788-a7f9-3c8dd812eb0b tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:25:05.025942 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-cbf3f892-43bc-4788-a7f9-3c8dd812eb0b tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:25:05.035857 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-cbf3f892-43bc-4788-a7f9-3c8dd812eb0b tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:05.036296 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-cbf3f892-43bc-4788-a7f9-3c8dd812eb0b tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:05.037077 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-cbf3f892-43bc-4788-a7f9-3c8dd812eb0b tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:05.037489 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-cbf3f892-43bc-4788-a7f9-3c8dd812eb0b tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:05.065796 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-cbf3f892-43bc-4788-a7f9-3c8dd812eb0b tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044557 Nov 01 01:25:05.066357 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 465/989] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:25:05 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:25:05.127471 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-5e9aa9e9-dc9a-4db1-b80a-f6fe993c4345 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:25:05.128075 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-5e9aa9e9-dc9a-4db1-b80a-f6fe993c4345 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:25:05.134158 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5e9aa9e9-dc9a-4db1-b80a-f6fe993c4345 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:05.134642 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5e9aa9e9-dc9a-4db1-b80a-f6fe993c4345 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:05.135392 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5e9aa9e9-dc9a-4db1-b80a-f6fe993c4345 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:05.135813 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5e9aa9e9-dc9a-4db1-b80a-f6fe993c4345 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:05.260803 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-5e9aa9e9-dc9a-4db1-b80a-f6fe993c4345 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:25:05.268069 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-5e9aa9e9-dc9a-4db1-b80a-f6fe993c4345 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.144190 Nov 01 01:25:05.270411 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 525/990] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:25:05 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:25:06.077191 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-d4b00ab6-65cb-4be3-9b32-4c25a989bd8b tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:25:06.078116 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-d4b00ab6-65cb-4be3-9b32-4c25a989bd8b tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:25:06.084297 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d4b00ab6-65cb-4be3-9b32-4c25a989bd8b tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:06.084740 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d4b00ab6-65cb-4be3-9b32-4c25a989bd8b tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:06.085498 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d4b00ab6-65cb-4be3-9b32-4c25a989bd8b tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:06.085926 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d4b00ab6-65cb-4be3-9b32-4c25a989bd8b tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:06.114362 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-d4b00ab6-65cb-4be3-9b32-4c25a989bd8b tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040995 Nov 01 01:25:06.114930 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 466/991] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:25:06 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:25:06.284796 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-d3294ecf-c0b7-4c68-b39d-70875c072cfd tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:25:06.285325 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-d3294ecf-c0b7-4c68-b39d-70875c072cfd tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:25:06.291683 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d3294ecf-c0b7-4c68-b39d-70875c072cfd tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:06.292124 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d3294ecf-c0b7-4c68-b39d-70875c072cfd tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:06.293377 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d3294ecf-c0b7-4c68-b39d-70875c072cfd tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:06.293800 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d3294ecf-c0b7-4c68-b39d-70875c072cfd tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:06.417156 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-d3294ecf-c0b7-4c68-b39d-70875c072cfd tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:25:06.425025 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-d3294ecf-c0b7-4c68-b39d-70875c072cfd tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.144041 Nov 01 01:25:06.425956 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 526/992] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:25:06 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:25:07.126105 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-5d5490e9-a2fa-4669-b32e-8bd0952240f6 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:25:07.126963 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-5d5490e9-a2fa-4669-b32e-8bd0952240f6 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:25:07.133142 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-5d5490e9-a2fa-4669-b32e-8bd0952240f6 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:07.133583 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-5d5490e9-a2fa-4669-b32e-8bd0952240f6 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:07.134337 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-5d5490e9-a2fa-4669-b32e-8bd0952240f6 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:07.134790 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-5d5490e9-a2fa-4669-b32e-8bd0952240f6 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:07.163408 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-5d5490e9-a2fa-4669-b32e-8bd0952240f6 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041070 Nov 01 01:25:07.163949 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 467/993] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:25:07 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:25:07.445818 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-40af9cd4-2135-4879-ae28-c34e33b22fb6 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:25:07.446992 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-40af9cd4-2135-4879-ae28-c34e33b22fb6 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:25:07.453518 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-40af9cd4-2135-4879-ae28-c34e33b22fb6 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:07.453962 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-40af9cd4-2135-4879-ae28-c34e33b22fb6 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:07.454757 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-40af9cd4-2135-4879-ae28-c34e33b22fb6 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:07.455165 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-40af9cd4-2135-4879-ae28-c34e33b22fb6 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:07.572535 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-40af9cd4-2135-4879-ae28-c34e33b22fb6 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:25:07.579754 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-40af9cd4-2135-4879-ae28-c34e33b22fb6 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.137494 Nov 01 01:25:07.580316 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 527/994] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:25:07 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:25:08.174393 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-22686eff-da60-4058-9997-794e13921468 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:25:08.175339 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-22686eff-da60-4058-9997-794e13921468 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:25:08.181538 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-22686eff-da60-4058-9997-794e13921468 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:08.181981 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-22686eff-da60-4058-9997-794e13921468 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:08.182780 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-22686eff-da60-4058-9997-794e13921468 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:08.183322 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-22686eff-da60-4058-9997-794e13921468 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:08.216100 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-22686eff-da60-4058-9997-794e13921468 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045393 Nov 01 01:25:08.216648 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 468/995] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:25:08 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:25:08.595457 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-65be731d-2a52-46be-874c-f2604926656e tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:25:08.596051 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-65be731d-2a52-46be-874c-f2604926656e tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:25:08.602248 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-65be731d-2a52-46be-874c-f2604926656e tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:08.602861 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-65be731d-2a52-46be-874c-f2604926656e tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:08.603610 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-65be731d-2a52-46be-874c-f2604926656e tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:08.604034 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-65be731d-2a52-46be-874c-f2604926656e tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:08.724061 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-65be731d-2a52-46be-874c-f2604926656e tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:25:08.731462 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-65be731d-2a52-46be-874c-f2604926656e tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.139660 Nov 01 01:25:08.732016 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 528/996] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:25:08 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:25:09.227361 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-6434938b-2bc2-46a7-821b-c77953cc82c8 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:25:09.228285 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-6434938b-2bc2-46a7-821b-c77953cc82c8 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:25:09.235295 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-6434938b-2bc2-46a7-821b-c77953cc82c8 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:09.235739 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-6434938b-2bc2-46a7-821b-c77953cc82c8 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:09.236500 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-6434938b-2bc2-46a7-821b-c77953cc82c8 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:09.236933 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-6434938b-2bc2-46a7-821b-c77953cc82c8 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:09.265907 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-6434938b-2bc2-46a7-821b-c77953cc82c8 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042326 Nov 01 01:25:09.266472 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 469/997] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:25:09 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:25:09.747979 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-11e00995-023e-462a-9583-1c467e7b3ce4 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:25:09.748581 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-11e00995-023e-462a-9583-1c467e7b3ce4 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:25:09.754902 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-11e00995-023e-462a-9583-1c467e7b3ce4 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:09.755286 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-11e00995-023e-462a-9583-1c467e7b3ce4 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:09.756048 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-11e00995-023e-462a-9583-1c467e7b3ce4 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:09.756475 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-11e00995-023e-462a-9583-1c467e7b3ce4 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:09.886831 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-11e00995-023e-462a-9583-1c467e7b3ce4 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:25:09.893895 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-11e00995-023e-462a-9583-1c467e7b3ce4 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.149544 Nov 01 01:25:09.894473 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 529/998] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:25:09 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:25:10.277710 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-d9373160-6fb8-49b6-acf9-9caaf062fa2d tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:25:10.278582 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-d9373160-6fb8-49b6-acf9-9caaf062fa2d tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:25:10.284977 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d9373160-6fb8-49b6-acf9-9caaf062fa2d tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:10.285436 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d9373160-6fb8-49b6-acf9-9caaf062fa2d tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:10.286214 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d9373160-6fb8-49b6-acf9-9caaf062fa2d tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:10.286663 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d9373160-6fb8-49b6-acf9-9caaf062fa2d tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:10.315672 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-d9373160-6fb8-49b6-acf9-9caaf062fa2d tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042251 Nov 01 01:25:10.316220 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 470/999] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:25:10 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:25:10.911240 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-5b3b3e83-65c2-4f3a-aaff-3e7c35aef858 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:25:10.911772 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-5b3b3e83-65c2-4f3a-aaff-3e7c35aef858 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:25:10.918523 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5b3b3e83-65c2-4f3a-aaff-3e7c35aef858 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:10.918970 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5b3b3e83-65c2-4f3a-aaff-3e7c35aef858 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:10.919729 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5b3b3e83-65c2-4f3a-aaff-3e7c35aef858 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:10.920158 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5b3b3e83-65c2-4f3a-aaff-3e7c35aef858 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:11.038628 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-5b3b3e83-65c2-4f3a-aaff-3e7c35aef858 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:25:11.046462 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-5b3b3e83-65c2-4f3a-aaff-3e7c35aef858 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.139006 Nov 01 01:25:11.047020 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 530/1000] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:25:10 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:25:11.327020 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-e1c0ecd3-96e5-4eba-8606-185e325b94c8 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:25:11.327928 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-e1c0ecd3-96e5-4eba-8606-185e325b94c8 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:25:11.334093 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e1c0ecd3-96e5-4eba-8606-185e325b94c8 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:11.334571 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e1c0ecd3-96e5-4eba-8606-185e325b94c8 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:11.335326 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e1c0ecd3-96e5-4eba-8606-185e325b94c8 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:11.335834 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e1c0ecd3-96e5-4eba-8606-185e325b94c8 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:11.365862 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-e1c0ecd3-96e5-4eba-8606-185e325b94c8 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043058 Nov 01 01:25:11.367202 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 471/1001] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:25:11 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:25:12.063545 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-1814df79-06c6-4b81-99aa-f1e69b4e597c tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:25:12.064147 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-1814df79-06c6-4b81-99aa-f1e69b4e597c tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:25:12.070322 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1814df79-06c6-4b81-99aa-f1e69b4e597c tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:12.070790 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1814df79-06c6-4b81-99aa-f1e69b4e597c tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:12.071539 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1814df79-06c6-4b81-99aa-f1e69b4e597c tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:12.071968 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1814df79-06c6-4b81-99aa-f1e69b4e597c tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:12.192520 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-1814df79-06c6-4b81-99aa-f1e69b4e597c tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:25:12.199595 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-1814df79-06c6-4b81-99aa-f1e69b4e597c tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.139647 Nov 01 01:25:12.200168 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 531/1002] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:25:12 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:25:12.377017 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-48d4423f-7398-4aba-8792-4f350ad6fbfd tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:25:12.377931 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-48d4423f-7398-4aba-8792-4f350ad6fbfd tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:25:12.384113 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-48d4423f-7398-4aba-8792-4f350ad6fbfd tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:12.384555 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-48d4423f-7398-4aba-8792-4f350ad6fbfd tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:12.385312 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-48d4423f-7398-4aba-8792-4f350ad6fbfd tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:12.385740 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-48d4423f-7398-4aba-8792-4f350ad6fbfd tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:12.413743 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-48d4423f-7398-4aba-8792-4f350ad6fbfd tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040510 Nov 01 01:25:12.414279 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 472/1003] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:25:12 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:25:13.222015 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-945fbfa9-48dc-4a01-9afe-526af2c8555e tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:25:13.222659 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-945fbfa9-48dc-4a01-9afe-526af2c8555e tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:25:13.228850 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-945fbfa9-48dc-4a01-9afe-526af2c8555e tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:13.229294 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-945fbfa9-48dc-4a01-9afe-526af2c8555e tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:13.230052 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-945fbfa9-48dc-4a01-9afe-526af2c8555e tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:13.230518 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-945fbfa9-48dc-4a01-9afe-526af2c8555e tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:13.348551 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-945fbfa9-48dc-4a01-9afe-526af2c8555e tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:25:13.355762 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-945fbfa9-48dc-4a01-9afe-526af2c8555e tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.137356 Nov 01 01:25:13.356324 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 532/1004] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:25:13 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:25:13.425734 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-35652766-3dbe-4427-9eb6-bc1bfe863d43 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:25:13.426990 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-35652766-3dbe-4427-9eb6-bc1bfe863d43 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:25:13.433152 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-35652766-3dbe-4427-9eb6-bc1bfe863d43 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:13.433589 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-35652766-3dbe-4427-9eb6-bc1bfe863d43 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:13.435077 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-35652766-3dbe-4427-9eb6-bc1bfe863d43 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:13.435501 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-35652766-3dbe-4427-9eb6-bc1bfe863d43 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:13.464284 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-35652766-3dbe-4427-9eb6-bc1bfe863d43 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042604 Nov 01 01:25:13.464820 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 473/1005] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:25:13 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:25:14.371849 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-e297ae19-4187-4111-9d41-87d8ac116b6c tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:25:14.372452 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-e297ae19-4187-4111-9d41-87d8ac116b6c tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:25:14.378346 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e297ae19-4187-4111-9d41-87d8ac116b6c tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:14.378823 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e297ae19-4187-4111-9d41-87d8ac116b6c tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:14.379581 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e297ae19-4187-4111-9d41-87d8ac116b6c tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:14.380010 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e297ae19-4187-4111-9d41-87d8ac116b6c tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:14.475789 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-b4b8c7e2-d7ac-43c4-ae1a-cb7362fb687a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:25:14.476937 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-b4b8c7e2-d7ac-43c4-ae1a-cb7362fb687a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:25:14.484407 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b4b8c7e2-d7ac-43c4-ae1a-cb7362fb687a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:14.484843 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b4b8c7e2-d7ac-43c4-ae1a-cb7362fb687a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:14.485609 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b4b8c7e2-d7ac-43c4-ae1a-cb7362fb687a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:14.486029 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b4b8c7e2-d7ac-43c4-ae1a-cb7362fb687a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:14.501195 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-e297ae19-4187-4111-9d41-87d8ac116b6c tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:25:14.510552 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-e297ae19-4187-4111-9d41-87d8ac116b6c tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.142306 Nov 01 01:25:14.511383 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 533/1006] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:25:14 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:25:14.514546 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-b4b8c7e2-d7ac-43c4-ae1a-cb7362fb687a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042420 Nov 01 01:25:14.517590 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 474/1007] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:25:14 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 01 01:25:15.527448 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-0b951e5d-da4c-4cbd-83a3-29d281c11e44 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:25:15.528003 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-0b951e5d-da4c-4cbd-83a3-29d281c11e44 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:25:15.528675 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-ffdcb0c3-3bb1-4f2d-810a-e0eba68f7ddd tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:25:15.529583 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-ffdcb0c3-3bb1-4f2d-810a-e0eba68f7ddd tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:25:15.534473 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0b951e5d-da4c-4cbd-83a3-29d281c11e44 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:15.534921 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0b951e5d-da4c-4cbd-83a3-29d281c11e44 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:15.535694 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0b951e5d-da4c-4cbd-83a3-29d281c11e44 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:15.535805 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ffdcb0c3-3bb1-4f2d-810a-e0eba68f7ddd tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:15.536123 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0b951e5d-da4c-4cbd-83a3-29d281c11e44 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:15.536236 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ffdcb0c3-3bb1-4f2d-810a-e0eba68f7ddd tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:15.536912 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ffdcb0c3-3bb1-4f2d-810a-e0eba68f7ddd tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:15.537342 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ffdcb0c3-3bb1-4f2d-810a-e0eba68f7ddd tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:15.566848 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-ffdcb0c3-3bb1-4f2d-810a-e0eba68f7ddd tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041767 Nov 01 01:25:15.567409 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 475/1008] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:25:15 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 01 01:25:15.659043 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-0b951e5d-da4c-4cbd-83a3-29d281c11e44 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:25:15.666214 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-0b951e5d-da4c-4cbd-83a3-29d281c11e44 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.142434 Nov 01 01:25:15.666801 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 534/1009] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:25:15 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:25:16.579327 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-7b1778cf-0e5c-4f08-bcf1-23a361f2b292 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:25:16.580295 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-7b1778cf-0e5c-4f08-bcf1-23a361f2b292 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:25:16.586556 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-7b1778cf-0e5c-4f08-bcf1-23a361f2b292 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:16.587035 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-7b1778cf-0e5c-4f08-bcf1-23a361f2b292 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:16.587797 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-7b1778cf-0e5c-4f08-bcf1-23a361f2b292 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:16.588232 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-7b1778cf-0e5c-4f08-bcf1-23a361f2b292 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:16.616446 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-7b1778cf-0e5c-4f08-bcf1-23a361f2b292 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041589 Nov 01 01:25:16.616921 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 476/1010] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:25:16 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:25:16.682229 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-9a5166a2-481c-49b9-8d43-470451691be6 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:25:16.682849 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-9a5166a2-481c-49b9-8d43-470451691be6 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:25:16.689483 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9a5166a2-481c-49b9-8d43-470451691be6 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:16.689919 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9a5166a2-481c-49b9-8d43-470451691be6 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:16.690701 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9a5166a2-481c-49b9-8d43-470451691be6 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:16.691125 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9a5166a2-481c-49b9-8d43-470451691be6 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:16.809130 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-9a5166a2-481c-49b9-8d43-470451691be6 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:25:16.817917 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-9a5166a2-481c-49b9-8d43-470451691be6 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.138833 Nov 01 01:25:16.820541 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 535/1011] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:25:16 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:25:17.627853 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-dffdecbd-66fd-4bfd-96cf-9d97fdfdbaef tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:25:17.628688 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-dffdecbd-66fd-4bfd-96cf-9d97fdfdbaef tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:25:17.634568 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-dffdecbd-66fd-4bfd-96cf-9d97fdfdbaef tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:17.635008 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-dffdecbd-66fd-4bfd-96cf-9d97fdfdbaef tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:17.635752 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-dffdecbd-66fd-4bfd-96cf-9d97fdfdbaef tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:17.636178 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-dffdecbd-66fd-4bfd-96cf-9d97fdfdbaef tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:17.665292 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-dffdecbd-66fd-4bfd-96cf-9d97fdfdbaef tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041275 Nov 01 01:25:17.665826 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 477/1012] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:25:17 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:25:17.836127 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-c17d5215-0e9e-4d3a-9bcc-fa59a122b9bb tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:25:17.836841 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-c17d5215-0e9e-4d3a-9bcc-fa59a122b9bb tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:25:17.853098 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c17d5215-0e9e-4d3a-9bcc-fa59a122b9bb tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:17.853547 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c17d5215-0e9e-4d3a-9bcc-fa59a122b9bb tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:17.854324 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c17d5215-0e9e-4d3a-9bcc-fa59a122b9bb tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:17.854788 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c17d5215-0e9e-4d3a-9bcc-fa59a122b9bb tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:17.986656 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-c17d5215-0e9e-4d3a-9bcc-fa59a122b9bb tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:25:17.994259 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-c17d5215-0e9e-4d3a-9bcc-fa59a122b9bb tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.162203 Nov 01 01:25:17.995103 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 536/1013] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:25:17 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:25:18.677030 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-e0bd25c1-901a-4cb9-9f0b-67e6f10ec33f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:25:18.677978 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-e0bd25c1-901a-4cb9-9f0b-67e6f10ec33f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:25:18.684145 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e0bd25c1-901a-4cb9-9f0b-67e6f10ec33f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:18.684584 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e0bd25c1-901a-4cb9-9f0b-67e6f10ec33f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:18.685374 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e0bd25c1-901a-4cb9-9f0b-67e6f10ec33f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:18.685806 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e0bd25c1-901a-4cb9-9f0b-67e6f10ec33f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:18.713368 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-e0bd25c1-901a-4cb9-9f0b-67e6f10ec33f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040100 Nov 01 01:25:18.713903 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 478/1014] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:25:18 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:25:19.011890 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-95b21b80-ff67-4721-a4cf-4b3eac7abfd5 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:25:19.011890 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-95b21b80-ff67-4721-a4cf-4b3eac7abfd5 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:25:19.017854 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-95b21b80-ff67-4721-a4cf-4b3eac7abfd5 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:19.018296 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-95b21b80-ff67-4721-a4cf-4b3eac7abfd5 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:19.019115 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-95b21b80-ff67-4721-a4cf-4b3eac7abfd5 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:19.019503 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-95b21b80-ff67-4721-a4cf-4b3eac7abfd5 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:19.142108 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-95b21b80-ff67-4721-a4cf-4b3eac7abfd5 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:25:19.149336 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-95b21b80-ff67-4721-a4cf-4b3eac7abfd5 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.142250 Nov 01 01:25:19.149890 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 537/1015] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:25:19 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:25:19.724936 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-e75d0c30-e021-4316-a2e1-f1660965b28e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:25:19.725839 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-e75d0c30-e021-4316-a2e1-f1660965b28e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:25:19.731951 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e75d0c30-e021-4316-a2e1-f1660965b28e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:19.732389 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e75d0c30-e021-4316-a2e1-f1660965b28e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:19.734028 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e75d0c30-e021-4316-a2e1-f1660965b28e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:19.734478 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e75d0c30-e021-4316-a2e1-f1660965b28e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:19.761726 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-e75d0c30-e021-4316-a2e1-f1660965b28e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040531 Nov 01 01:25:19.762251 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 479/1016] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:25:19 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:25:20.165982 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-3f9e29d4-c4ed-4de7-8aef-1ef316983d4e tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:25:20.168576 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-3f9e29d4-c4ed-4de7-8aef-1ef316983d4e tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:25:20.172977 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3f9e29d4-c4ed-4de7-8aef-1ef316983d4e tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:20.173418 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3f9e29d4-c4ed-4de7-8aef-1ef316983d4e tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:20.174202 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3f9e29d4-c4ed-4de7-8aef-1ef316983d4e tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:20.174666 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3f9e29d4-c4ed-4de7-8aef-1ef316983d4e tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:20.301734 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-3f9e29d4-c4ed-4de7-8aef-1ef316983d4e tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:25:20.309056 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-3f9e29d4-c4ed-4de7-8aef-1ef316983d4e tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.146763 Nov 01 01:25:20.309625 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 538/1017] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:25:20 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:25:20.773007 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-330a1310-f472-4279-9fba-809c27e5c659 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:25:20.773918 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-330a1310-f472-4279-9fba-809c27e5c659 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:25:20.780162 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-330a1310-f472-4279-9fba-809c27e5c659 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:20.780607 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-330a1310-f472-4279-9fba-809c27e5c659 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:20.781372 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-330a1310-f472-4279-9fba-809c27e5c659 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:20.781819 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-330a1310-f472-4279-9fba-809c27e5c659 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:20.813247 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-330a1310-f472-4279-9fba-809c27e5c659 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041413 Nov 01 01:25:20.813902 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 480/1018] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:25:20 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:25:21.326738 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-53150a7f-9c3a-44ec-bb29-99054589089e tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:25:21.327333 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-53150a7f-9c3a-44ec-bb29-99054589089e tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:25:21.333402 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-53150a7f-9c3a-44ec-bb29-99054589089e tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:21.333836 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-53150a7f-9c3a-44ec-bb29-99054589089e tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:21.334620 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-53150a7f-9c3a-44ec-bb29-99054589089e tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:21.335043 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-53150a7f-9c3a-44ec-bb29-99054589089e tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:21.452873 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-53150a7f-9c3a-44ec-bb29-99054589089e tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:25:21.460126 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-53150a7f-9c3a-44ec-bb29-99054589089e tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.137688 Nov 01 01:25:21.460684 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 539/1019] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:25:21 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:25:21.829635 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-3c4ceb4a-78b4-413f-b66e-f902c8523a8a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:25:21.830566 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-3c4ceb4a-78b4-413f-b66e-f902c8523a8a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:25:21.836765 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3c4ceb4a-78b4-413f-b66e-f902c8523a8a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:21.837210 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3c4ceb4a-78b4-413f-b66e-f902c8523a8a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:21.837963 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3c4ceb4a-78b4-413f-b66e-f902c8523a8a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:21.838393 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3c4ceb4a-78b4-413f-b66e-f902c8523a8a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:21.866804 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-3c4ceb4a-78b4-413f-b66e-f902c8523a8a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041461 Nov 01 01:25:21.867349 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 481/1020] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:25:21 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:25:22.477909 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-3702fd20-5dd5-4b82-a040-76636fd76dc8 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:25:22.478540 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-3702fd20-5dd5-4b82-a040-76636fd76dc8 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:25:22.485593 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3702fd20-5dd5-4b82-a040-76636fd76dc8 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:22.486035 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3702fd20-5dd5-4b82-a040-76636fd76dc8 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:22.486815 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3702fd20-5dd5-4b82-a040-76636fd76dc8 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:22.487244 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3702fd20-5dd5-4b82-a040-76636fd76dc8 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:22.605852 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-3702fd20-5dd5-4b82-a040-76636fd76dc8 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:25:22.613761 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-3702fd20-5dd5-4b82-a040-76636fd76dc8 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.139462 Nov 01 01:25:22.614323 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 540/1021] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:25:22 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:25:22.877724 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-177cbe35-b340-4c53-8908-f5a5dfa9d785 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:25:22.878648 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-177cbe35-b340-4c53-8908-f5a5dfa9d785 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:25:22.884741 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-177cbe35-b340-4c53-8908-f5a5dfa9d785 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:22.885179 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-177cbe35-b340-4c53-8908-f5a5dfa9d785 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:22.885923 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-177cbe35-b340-4c53-8908-f5a5dfa9d785 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:22.886345 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-177cbe35-b340-4c53-8908-f5a5dfa9d785 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:22.914963 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-177cbe35-b340-4c53-8908-f5a5dfa9d785 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041002 Nov 01 01:25:22.915495 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 482/1022] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:25:22 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:25:23.630742 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-94e22067-22a2-413c-be5b-05543d16487c tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:25:23.631347 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-94e22067-22a2-413c-be5b-05543d16487c tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:25:23.637472 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-94e22067-22a2-413c-be5b-05543d16487c tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:23.637914 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-94e22067-22a2-413c-be5b-05543d16487c tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:23.638723 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-94e22067-22a2-413c-be5b-05543d16487c tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:23.639148 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-94e22067-22a2-413c-be5b-05543d16487c tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:23.755469 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-94e22067-22a2-413c-be5b-05543d16487c tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:25:23.762484 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-94e22067-22a2-413c-be5b-05543d16487c tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.135329 Nov 01 01:25:23.763040 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 541/1023] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:25:23 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:25:23.926889 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-d9328344-4ebf-45fd-bbae-7e3e3f435162 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:25:23.927797 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-d9328344-4ebf-45fd-bbae-7e3e3f435162 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:25:23.934025 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d9328344-4ebf-45fd-bbae-7e3e3f435162 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:23.934490 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d9328344-4ebf-45fd-bbae-7e3e3f435162 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:23.935248 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d9328344-4ebf-45fd-bbae-7e3e3f435162 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:23.935675 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d9328344-4ebf-45fd-bbae-7e3e3f435162 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:23.963847 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-d9328344-4ebf-45fd-bbae-7e3e3f435162 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040717 Nov 01 01:25:23.964408 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 483/1024] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:25:23 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:25:24.778773 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-901c1b16-8277-47ef-90fe-a738dc0d6ed4 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:25:24.779377 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-901c1b16-8277-47ef-90fe-a738dc0d6ed4 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:25:24.785524 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-901c1b16-8277-47ef-90fe-a738dc0d6ed4 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:24.785965 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-901c1b16-8277-47ef-90fe-a738dc0d6ed4 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:24.786751 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-901c1b16-8277-47ef-90fe-a738dc0d6ed4 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:24.787181 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-901c1b16-8277-47ef-90fe-a738dc0d6ed4 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:24.916452 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-901c1b16-8277-47ef-90fe-a738dc0d6ed4 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:25:24.923646 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-901c1b16-8277-47ef-90fe-a738dc0d6ed4 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.148495 Nov 01 01:25:24.924208 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 542/1025] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:25:24 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:25:24.975135 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-ad23ce24-581f-447e-bbe0-3d2343059270 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:25:24.976042 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-ad23ce24-581f-447e-bbe0-3d2343059270 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:25:24.982516 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ad23ce24-581f-447e-bbe0-3d2343059270 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:24.982964 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ad23ce24-581f-447e-bbe0-3d2343059270 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:24.984014 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ad23ce24-581f-447e-bbe0-3d2343059270 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:24.984444 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ad23ce24-581f-447e-bbe0-3d2343059270 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:25.013891 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-ad23ce24-581f-447e-bbe0-3d2343059270 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042446 Nov 01 01:25:25.014448 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 484/1026] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:25:24 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:25:25.939145 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-95e8ed00-2950-4ced-bc49-724e2db50c6b tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:25:25.939748 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-95e8ed00-2950-4ced-bc49-724e2db50c6b tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:25:25.945894 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-95e8ed00-2950-4ced-bc49-724e2db50c6b tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:25.946348 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-95e8ed00-2950-4ced-bc49-724e2db50c6b tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:25.947139 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-95e8ed00-2950-4ced-bc49-724e2db50c6b tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:25.947580 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-95e8ed00-2950-4ced-bc49-724e2db50c6b tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:26.025149 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-cecf42fa-11aa-4ea3-a529-724eab385f8d tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:25:26.026555 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-cecf42fa-11aa-4ea3-a529-724eab385f8d tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:25:26.032974 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-cecf42fa-11aa-4ea3-a529-724eab385f8d tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:26.033412 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-cecf42fa-11aa-4ea3-a529-724eab385f8d tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:26.034169 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-cecf42fa-11aa-4ea3-a529-724eab385f8d tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:26.034627 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-cecf42fa-11aa-4ea3-a529-724eab385f8d tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:26.063845 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-cecf42fa-11aa-4ea3-a529-724eab385f8d tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041942 Nov 01 01:25:26.064407 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 485/1027] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:25:26 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 01 01:25:26.072360 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-95e8ed00-2950-4ced-bc49-724e2db50c6b tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:25:26.080369 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-95e8ed00-2950-4ced-bc49-724e2db50c6b tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.144949 Nov 01 01:25:26.080923 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 543/1028] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:25:25 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:25:27.075237 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-f231bae4-50cf-40b8-9669-127d8238860b tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:25:27.076140 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-f231bae4-50cf-40b8-9669-127d8238860b tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:25:27.082288 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f231bae4-50cf-40b8-9669-127d8238860b tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:27.082795 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f231bae4-50cf-40b8-9669-127d8238860b tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:27.083550 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f231bae4-50cf-40b8-9669-127d8238860b tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:27.083978 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f231bae4-50cf-40b8-9669-127d8238860b tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:27.097347 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-0b2ebcc8-1b4d-4aa9-a6d0-abb9503662e2 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:25:27.097951 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-0b2ebcc8-1b4d-4aa9-a6d0-abb9503662e2 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:25:27.104025 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0b2ebcc8-1b4d-4aa9-a6d0-abb9503662e2 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:27.104473 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0b2ebcc8-1b4d-4aa9-a6d0-abb9503662e2 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:27.105244 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0b2ebcc8-1b4d-4aa9-a6d0-abb9503662e2 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:27.105672 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0b2ebcc8-1b4d-4aa9-a6d0-abb9503662e2 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:27.114351 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-f231bae4-50cf-40b8-9669-127d8238860b tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042900 Nov 01 01:25:27.114934 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 486/1029] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:25:27 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:25:27.223302 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-0b2ebcc8-1b4d-4aa9-a6d0-abb9503662e2 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:25:27.230310 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-0b2ebcc8-1b4d-4aa9-a6d0-abb9503662e2 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.137277 Nov 01 01:25:27.230900 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 544/1030] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:25:27 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:25:28.125004 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-a8852f5b-274b-41b8-94c5-e499f315a6cd tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:25:28.126537 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-a8852f5b-274b-41b8-94c5-e499f315a6cd tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:25:28.132617 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a8852f5b-274b-41b8-94c5-e499f315a6cd tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:28.133055 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a8852f5b-274b-41b8-94c5-e499f315a6cd tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:28.133803 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a8852f5b-274b-41b8-94c5-e499f315a6cd tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:28.134226 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a8852f5b-274b-41b8-94c5-e499f315a6cd tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:28.161690 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-a8852f5b-274b-41b8-94c5-e499f315a6cd tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040504 Nov 01 01:25:28.162219 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 487/1031] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:25:28 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:25:28.247183 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-a5af1840-ce4f-4f94-9637-e93c62c2bac2 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:25:28.247897 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-a5af1840-ce4f-4f94-9637-e93c62c2bac2 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:25:28.254938 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a5af1840-ce4f-4f94-9637-e93c62c2bac2 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:28.255386 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a5af1840-ce4f-4f94-9637-e93c62c2bac2 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:28.256153 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a5af1840-ce4f-4f94-9637-e93c62c2bac2 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:28.256607 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a5af1840-ce4f-4f94-9637-e93c62c2bac2 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:28.376060 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-a5af1840-ce4f-4f94-9637-e93c62c2bac2 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:25:28.383274 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-a5af1840-ce4f-4f94-9637-e93c62c2bac2 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.139773 Nov 01 01:25:28.383840 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 545/1032] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:25:28 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:25:29.173054 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-b59812fa-083f-4771-abe6-dd8261cd03f0 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:25:29.173988 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-b59812fa-083f-4771-abe6-dd8261cd03f0 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:25:29.180303 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b59812fa-083f-4771-abe6-dd8261cd03f0 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:29.180749 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b59812fa-083f-4771-abe6-dd8261cd03f0 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:29.181501 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b59812fa-083f-4771-abe6-dd8261cd03f0 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:29.181932 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b59812fa-083f-4771-abe6-dd8261cd03f0 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:29.210725 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-b59812fa-083f-4771-abe6-dd8261cd03f0 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041426 Nov 01 01:25:29.211267 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 488/1033] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:25:29 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:25:29.399584 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-0c6e62c4-ad34-45e8-b74e-639d5061ed1f tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:25:29.400183 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-0c6e62c4-ad34-45e8-b74e-639d5061ed1f tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:25:29.406311 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0c6e62c4-ad34-45e8-b74e-639d5061ed1f tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:29.406864 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0c6e62c4-ad34-45e8-b74e-639d5061ed1f tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:29.407616 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0c6e62c4-ad34-45e8-b74e-639d5061ed1f tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:29.408036 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0c6e62c4-ad34-45e8-b74e-639d5061ed1f tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:29.536074 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-0c6e62c4-ad34-45e8-b74e-639d5061ed1f tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:25:29.543188 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-0c6e62c4-ad34-45e8-b74e-639d5061ed1f tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.147247 Nov 01 01:25:29.543735 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 546/1034] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:25:29 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:25:30.222048 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-b3c529b3-6857-4e26-99a0-243f02fcbe5a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:25:30.222959 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-b3c529b3-6857-4e26-99a0-243f02fcbe5a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:25:30.229126 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b3c529b3-6857-4e26-99a0-243f02fcbe5a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:30.229564 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b3c529b3-6857-4e26-99a0-243f02fcbe5a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:30.230310 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b3c529b3-6857-4e26-99a0-243f02fcbe5a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:30.230879 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b3c529b3-6857-4e26-99a0-243f02fcbe5a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:30.265080 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-b3c529b3-6857-4e26-99a0-243f02fcbe5a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047369 Nov 01 01:25:30.265554 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 489/1035] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:25:30 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:25:30.559721 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-0642721d-fbfa-4cf3-8dc0-3afd4ba98660 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:25:30.560332 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-0642721d-fbfa-4cf3-8dc0-3afd4ba98660 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:25:30.570788 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0642721d-fbfa-4cf3-8dc0-3afd4ba98660 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:30.570788 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0642721d-fbfa-4cf3-8dc0-3afd4ba98660 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:30.570788 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0642721d-fbfa-4cf3-8dc0-3afd4ba98660 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:30.570788 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0642721d-fbfa-4cf3-8dc0-3afd4ba98660 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:30.698952 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-0642721d-fbfa-4cf3-8dc0-3afd4ba98660 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:25:30.707069 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-0642721d-fbfa-4cf3-8dc0-3afd4ba98660 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.150941 Nov 01 01:25:30.709870 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 547/1036] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:25:30 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:25:31.276920 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-28a10a11-43bb-45c9-959d-a0db1660b07c tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:25:31.277817 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-28a10a11-43bb-45c9-959d-a0db1660b07c tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:25:31.284538 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-28a10a11-43bb-45c9-959d-a0db1660b07c tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:31.284980 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-28a10a11-43bb-45c9-959d-a0db1660b07c tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:31.285727 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-28a10a11-43bb-45c9-959d-a0db1660b07c tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:31.286159 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-28a10a11-43bb-45c9-959d-a0db1660b07c tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:31.314582 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-28a10a11-43bb-45c9-959d-a0db1660b07c tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040902 Nov 01 01:25:31.317487 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 490/1037] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:25:31 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:25:31.723362 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-407e86d7-d812-44a2-ac1d-ed88ddeda529 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:25:31.723961 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-407e86d7-d812-44a2-ac1d-ed88ddeda529 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:25:31.730456 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-407e86d7-d812-44a2-ac1d-ed88ddeda529 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:31.730905 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-407e86d7-d812-44a2-ac1d-ed88ddeda529 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:31.731659 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-407e86d7-d812-44a2-ac1d-ed88ddeda529 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:31.732084 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-407e86d7-d812-44a2-ac1d-ed88ddeda529 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:31.848223 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-407e86d7-d812-44a2-ac1d-ed88ddeda529 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:25:31.855334 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-407e86d7-d812-44a2-ac1d-ed88ddeda529 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.135568 Nov 01 01:25:31.855897 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 548/1038] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:25:31 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:25:32.325917 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-5879ff76-aef2-48fb-987f-67180bef81cc tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:25:32.326839 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-5879ff76-aef2-48fb-987f-67180bef81cc tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:25:32.333649 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-5879ff76-aef2-48fb-987f-67180bef81cc tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:32.334090 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-5879ff76-aef2-48fb-987f-67180bef81cc tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:32.334893 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-5879ff76-aef2-48fb-987f-67180bef81cc tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:32.335317 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-5879ff76-aef2-48fb-987f-67180bef81cc tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:32.363870 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-5879ff76-aef2-48fb-987f-67180bef81cc tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041646 Nov 01 01:25:32.364997 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 491/1039] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:25:32 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:25:32.554907 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 01 01:25:32.555083 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: Mon Nov 1 01:25:32 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 01 01:25:32.872624 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-5da29bad-2baa-4b20-8527-0348087e9dd4 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:25:32.873139 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-5da29bad-2baa-4b20-8527-0348087e9dd4 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:25:32.879603 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5da29bad-2baa-4b20-8527-0348087e9dd4 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:32.880053 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5da29bad-2baa-4b20-8527-0348087e9dd4 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:32.880818 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5da29bad-2baa-4b20-8527-0348087e9dd4 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:32.881250 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5da29bad-2baa-4b20-8527-0348087e9dd4 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:33.003482 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-5da29bad-2baa-4b20-8527-0348087e9dd4 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:25:33.010759 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-5da29bad-2baa-4b20-8527-0348087e9dd4 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.141822 Nov 01 01:25:33.011416 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 549/1040] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:25:32 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:25:33.375575 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-0116d8f2-ff6c-4d08-b50c-eaecabc22018 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:25:33.376483 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-0116d8f2-ff6c-4d08-b50c-eaecabc22018 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:25:33.383381 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0116d8f2-ff6c-4d08-b50c-eaecabc22018 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:33.383821 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0116d8f2-ff6c-4d08-b50c-eaecabc22018 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:33.384571 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0116d8f2-ff6c-4d08-b50c-eaecabc22018 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:33.384997 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0116d8f2-ff6c-4d08-b50c-eaecabc22018 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:33.413800 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-0116d8f2-ff6c-4d08-b50c-eaecabc22018 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041980 Nov 01 01:25:33.414336 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 492/1041] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:25:33 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:25:34.027720 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-6a9eaba6-4f85-421f-a862-4071c87d503f tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:25:34.028320 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-6a9eaba6-4f85-421f-a862-4071c87d503f tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:25:34.034412 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6a9eaba6-4f85-421f-a862-4071c87d503f tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:34.034852 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6a9eaba6-4f85-421f-a862-4071c87d503f tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:34.035601 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6a9eaba6-4f85-421f-a862-4071c87d503f tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:34.036025 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6a9eaba6-4f85-421f-a862-4071c87d503f tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:34.153899 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-6a9eaba6-4f85-421f-a862-4071c87d503f tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:25:34.161003 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-6a9eaba6-4f85-421f-a862-4071c87d503f tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.136866 Nov 01 01:25:34.161558 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 550/1042] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:25:34 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:25:34.425001 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-7513cd06-3d6b-4900-84ea-e5624685aec4 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:25:34.425908 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-7513cd06-3d6b-4900-84ea-e5624685aec4 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:25:34.432174 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-7513cd06-3d6b-4900-84ea-e5624685aec4 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:34.432608 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-7513cd06-3d6b-4900-84ea-e5624685aec4 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:34.433362 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-7513cd06-3d6b-4900-84ea-e5624685aec4 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:34.433792 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-7513cd06-3d6b-4900-84ea-e5624685aec4 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:34.462543 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-7513cd06-3d6b-4900-84ea-e5624685aec4 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041308 Nov 01 01:25:34.463075 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 493/1043] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:25:34 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:25:35.178658 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-07c84132-0045-4ad8-99d0-1d6d39bcc5ad tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:25:35.179293 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-07c84132-0045-4ad8-99d0-1d6d39bcc5ad tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:25:35.185379 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-07c84132-0045-4ad8-99d0-1d6d39bcc5ad tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:35.185840 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-07c84132-0045-4ad8-99d0-1d6d39bcc5ad tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:35.186620 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-07c84132-0045-4ad8-99d0-1d6d39bcc5ad tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:35.187067 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-07c84132-0045-4ad8-99d0-1d6d39bcc5ad tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:35.307765 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-07c84132-0045-4ad8-99d0-1d6d39bcc5ad tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:25:35.313334 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-07c84132-0045-4ad8-99d0-1d6d39bcc5ad tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.138987 Nov 01 01:25:35.313885 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 551/1044] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:25:35 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:25:35.472922 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-2ecc85d2-9efc-4eda-bc3b-e5b02cc01746 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:25:35.473828 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-2ecc85d2-9efc-4eda-bc3b-e5b02cc01746 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:25:35.480648 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-2ecc85d2-9efc-4eda-bc3b-e5b02cc01746 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:35.481089 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-2ecc85d2-9efc-4eda-bc3b-e5b02cc01746 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:35.481840 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-2ecc85d2-9efc-4eda-bc3b-e5b02cc01746 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:35.482267 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-2ecc85d2-9efc-4eda-bc3b-e5b02cc01746 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:35.510291 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-2ecc85d2-9efc-4eda-bc3b-e5b02cc01746 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041083 Nov 01 01:25:35.510921 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 494/1045] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:25:35 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:25:36.330176 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-92ea7677-dd50-4d73-8430-cf87794ab613 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:25:36.330750 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-92ea7677-dd50-4d73-8430-cf87794ab613 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:25:36.336858 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-92ea7677-dd50-4d73-8430-cf87794ab613 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:36.337301 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-92ea7677-dd50-4d73-8430-cf87794ab613 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:36.338057 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-92ea7677-dd50-4d73-8430-cf87794ab613 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:36.338518 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-92ea7677-dd50-4d73-8430-cf87794ab613 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:36.459381 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-92ea7677-dd50-4d73-8430-cf87794ab613 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:25:36.466531 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-92ea7677-dd50-4d73-8430-cf87794ab613 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.140207 Nov 01 01:25:36.467091 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 552/1046] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:25:36 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:25:36.520798 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-f74b6e23-e6c0-41c1-92f5-9c7ee9373c85 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:25:36.521696 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-f74b6e23-e6c0-41c1-92f5-9c7ee9373c85 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:25:36.527790 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f74b6e23-e6c0-41c1-92f5-9c7ee9373c85 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:36.528228 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f74b6e23-e6c0-41c1-92f5-9c7ee9373c85 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:36.528977 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f74b6e23-e6c0-41c1-92f5-9c7ee9373c85 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:36.529403 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f74b6e23-e6c0-41c1-92f5-9c7ee9373c85 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:36.557847 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-f74b6e23-e6c0-41c1-92f5-9c7ee9373c85 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040720 Nov 01 01:25:36.558376 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 495/1047] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:25:36 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:25:37.484091 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-7b781554-002d-42d4-b2c3-3e13d1583485 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:25:37.484694 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-7b781554-002d-42d4-b2c3-3e13d1583485 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:25:37.490902 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7b781554-002d-42d4-b2c3-3e13d1583485 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:37.491383 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7b781554-002d-42d4-b2c3-3e13d1583485 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:37.492137 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7b781554-002d-42d4-b2c3-3e13d1583485 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:37.492566 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7b781554-002d-42d4-b2c3-3e13d1583485 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:37.569752 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-cd930997-9c4f-4525-a865-dd1826658d2e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:25:37.570639 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-cd930997-9c4f-4525-a865-dd1826658d2e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:25:37.576765 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-cd930997-9c4f-4525-a865-dd1826658d2e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:37.577206 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-cd930997-9c4f-4525-a865-dd1826658d2e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:37.577959 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-cd930997-9c4f-4525-a865-dd1826658d2e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:37.578381 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-cd930997-9c4f-4525-a865-dd1826658d2e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:37.610190 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-7b781554-002d-42d4-b2c3-3e13d1583485 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:25:37.611149 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-cd930997-9c4f-4525-a865-dd1826658d2e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045815 Nov 01 01:25:37.611699 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 496/1048] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:25:37 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 01 01:25:37.618158 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-7b781554-002d-42d4-b2c3-3e13d1583485 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.137910 Nov 01 01:25:37.618692 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 553/1049] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:25:37 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:25:38.622650 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-3a76cc75-0758-49cf-a6d7-d8868323cf59 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:25:38.623480 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-3a76cc75-0758-49cf-a6d7-d8868323cf59 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:25:38.629625 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3a76cc75-0758-49cf-a6d7-d8868323cf59 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:38.630067 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3a76cc75-0758-49cf-a6d7-d8868323cf59 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:38.630937 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3a76cc75-0758-49cf-a6d7-d8868323cf59 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:38.631444 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3a76cc75-0758-49cf-a6d7-d8868323cf59 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:38.635141 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-2b048150-6926-4581-be8d-a09c89efed21 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:25:38.635822 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-2b048150-6926-4581-be8d-a09c89efed21 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:25:38.641955 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2b048150-6926-4581-be8d-a09c89efed21 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:38.642403 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2b048150-6926-4581-be8d-a09c89efed21 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:38.643189 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2b048150-6926-4581-be8d-a09c89efed21 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:38.643617 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2b048150-6926-4581-be8d-a09c89efed21 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:38.660574 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-3a76cc75-0758-49cf-a6d7-d8868323cf59 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041682 Nov 01 01:25:38.661112 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 497/1050] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:25:38 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:25:38.760463 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-2b048150-6926-4581-be8d-a09c89efed21 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:25:38.767541 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-2b048150-6926-4581-be8d-a09c89efed21 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.136940 Nov 01 01:25:38.768109 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 554/1051] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:25:38 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:25:39.672569 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-a01ecdcb-febf-4ada-a940-85eb2617222b tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:25:39.673402 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-a01ecdcb-febf-4ada-a940-85eb2617222b tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:25:39.679775 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a01ecdcb-febf-4ada-a940-85eb2617222b tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:39.680256 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a01ecdcb-febf-4ada-a940-85eb2617222b tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:39.681013 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a01ecdcb-febf-4ada-a940-85eb2617222b tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:39.681438 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a01ecdcb-febf-4ada-a940-85eb2617222b tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:39.709712 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-a01ecdcb-febf-4ada-a940-85eb2617222b tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040941 Nov 01 01:25:39.710246 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 498/1052] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:25:39 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:25:39.783889 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-a13ad3fa-484e-4a8b-a8f5-928911130a06 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:25:39.784488 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-a13ad3fa-484e-4a8b-a8f5-928911130a06 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:25:39.790781 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a13ad3fa-484e-4a8b-a8f5-928911130a06 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:39.791221 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a13ad3fa-484e-4a8b-a8f5-928911130a06 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:39.791965 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a13ad3fa-484e-4a8b-a8f5-928911130a06 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:39.792387 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a13ad3fa-484e-4a8b-a8f5-928911130a06 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:39.911477 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-a13ad3fa-484e-4a8b-a8f5-928911130a06 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:25:39.918497 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-a13ad3fa-484e-4a8b-a8f5-928911130a06 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.138150 Nov 01 01:25:39.919060 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 555/1053] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:25:39 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:25:40.721222 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-daddb706-6b54-4d60-a090-c6de4fa7f72c tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:25:40.722159 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-daddb706-6b54-4d60-a090-c6de4fa7f72c tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:25:40.729054 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-daddb706-6b54-4d60-a090-c6de4fa7f72c tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:40.729495 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-daddb706-6b54-4d60-a090-c6de4fa7f72c tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:40.730245 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-daddb706-6b54-4d60-a090-c6de4fa7f72c tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:40.730769 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-daddb706-6b54-4d60-a090-c6de4fa7f72c tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:40.758362 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-daddb706-6b54-4d60-a090-c6de4fa7f72c tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041090 Nov 01 01:25:40.758919 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 499/1054] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:25:40 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:25:40.934925 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-b22fdf2f-1874-4299-ae97-a2d67fa703cf tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:25:40.935571 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-b22fdf2f-1874-4299-ae97-a2d67fa703cf tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:25:40.941795 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b22fdf2f-1874-4299-ae97-a2d67fa703cf tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:40.942237 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b22fdf2f-1874-4299-ae97-a2d67fa703cf tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:40.943027 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b22fdf2f-1874-4299-ae97-a2d67fa703cf tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:40.943454 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b22fdf2f-1874-4299-ae97-a2d67fa703cf tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:41.066536 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-b22fdf2f-1874-4299-ae97-a2d67fa703cf tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:25:41.074217 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-b22fdf2f-1874-4299-ae97-a2d67fa703cf tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.142924 Nov 01 01:25:41.074973 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 556/1055] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:25:40 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:25:41.769404 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-208d7369-9212-46f6-9059-7f21147171a4 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:25:41.770329 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-208d7369-9212-46f6-9059-7f21147171a4 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:25:41.776503 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-208d7369-9212-46f6-9059-7f21147171a4 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:41.776933 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-208d7369-9212-46f6-9059-7f21147171a4 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:41.777674 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-208d7369-9212-46f6-9059-7f21147171a4 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:41.778095 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-208d7369-9212-46f6-9059-7f21147171a4 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:41.806700 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-208d7369-9212-46f6-9059-7f21147171a4 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040967 Nov 01 01:25:41.807235 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 500/1056] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:25:41 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:25:42.091093 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-3ff34c81-859a-46e2-9e9c-e8cf37e7b6a1 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:25:42.091697 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-3ff34c81-859a-46e2-9e9c-e8cf37e7b6a1 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:25:42.097825 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3ff34c81-859a-46e2-9e9c-e8cf37e7b6a1 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:42.098303 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3ff34c81-859a-46e2-9e9c-e8cf37e7b6a1 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:42.099266 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3ff34c81-859a-46e2-9e9c-e8cf37e7b6a1 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:42.099521 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3ff34c81-859a-46e2-9e9c-e8cf37e7b6a1 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:42.217426 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-3ff34c81-859a-46e2-9e9c-e8cf37e7b6a1 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:25:42.224621 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-3ff34c81-859a-46e2-9e9c-e8cf37e7b6a1 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.137141 Nov 01 01:25:42.225200 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 557/1057] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:25:42 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:25:42.817413 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-ef725eec-7df8-48ed-b040-1ebd3a36475e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:25:42.818325 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-ef725eec-7df8-48ed-b040-1ebd3a36475e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:25:42.825160 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ef725eec-7df8-48ed-b040-1ebd3a36475e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:42.825606 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ef725eec-7df8-48ed-b040-1ebd3a36475e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:42.826366 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ef725eec-7df8-48ed-b040-1ebd3a36475e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:42.826821 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ef725eec-7df8-48ed-b040-1ebd3a36475e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:42.855167 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-ef725eec-7df8-48ed-b040-1ebd3a36475e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041498 Nov 01 01:25:42.856069 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 501/1058] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:25:42 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:25:43.241753 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-bf8ce4ba-4728-4169-85a2-bec2a1b5c0fc tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:25:43.242972 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-bf8ce4ba-4728-4169-85a2-bec2a1b5c0fc tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:25:43.249124 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-bf8ce4ba-4728-4169-85a2-bec2a1b5c0fc tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:43.249570 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-bf8ce4ba-4728-4169-85a2-bec2a1b5c0fc tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:43.250341 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-bf8ce4ba-4728-4169-85a2-bec2a1b5c0fc tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:43.250800 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-bf8ce4ba-4728-4169-85a2-bec2a1b5c0fc tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:43.383715 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-bf8ce4ba-4728-4169-85a2-bec2a1b5c0fc tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:25:43.391202 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-bf8ce4ba-4728-4169-85a2-bec2a1b5c0fc tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.153112 Nov 01 01:25:43.391895 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 558/1059] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:25:43 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:25:43.866168 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-5f437057-084b-4397-8ebc-730a455a3ffb tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:25:43.867135 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-5f437057-084b-4397-8ebc-730a455a3ffb tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:25:43.873315 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-5f437057-084b-4397-8ebc-730a455a3ffb tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:43.873749 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-5f437057-084b-4397-8ebc-730a455a3ffb tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:43.874524 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-5f437057-084b-4397-8ebc-730a455a3ffb tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:43.874950 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-5f437057-084b-4397-8ebc-730a455a3ffb tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:43.903502 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-5f437057-084b-4397-8ebc-730a455a3ffb tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041106 Nov 01 01:25:43.904028 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 502/1060] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:25:43 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:25:44.407907 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-9d9048c1-f684-46b8-bc4a-40c126867be3 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:25:44.408464 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-9d9048c1-f684-46b8-bc4a-40c126867be3 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:25:44.414450 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9d9048c1-f684-46b8-bc4a-40c126867be3 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:44.414910 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9d9048c1-f684-46b8-bc4a-40c126867be3 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:44.415671 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9d9048c1-f684-46b8-bc4a-40c126867be3 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:44.416104 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9d9048c1-f684-46b8-bc4a-40c126867be3 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:44.532146 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-9d9048c1-f684-46b8-bc4a-40c126867be3 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:25:44.539404 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-9d9048c1-f684-46b8-bc4a-40c126867be3 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.135278 Nov 01 01:25:44.539969 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 559/1061] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:25:44 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:25:44.915279 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-66317769-fc9b-41eb-aa18-e3fac8b540b2 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:25:44.916182 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-66317769-fc9b-41eb-aa18-e3fac8b540b2 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:25:44.922352 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-66317769-fc9b-41eb-aa18-e3fac8b540b2 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:44.922857 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-66317769-fc9b-41eb-aa18-e3fac8b540b2 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:44.923614 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-66317769-fc9b-41eb-aa18-e3fac8b540b2 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:44.924040 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-66317769-fc9b-41eb-aa18-e3fac8b540b2 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:44.952355 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-66317769-fc9b-41eb-aa18-e3fac8b540b2 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041338 Nov 01 01:25:44.952894 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 503/1062] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:25:44 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:25:45.555963 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-7a88f936-6d7d-4cd6-a6ca-0ef58a990092 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:25:45.556493 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-7a88f936-6d7d-4cd6-a6ca-0ef58a990092 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:25:45.562829 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7a88f936-6d7d-4cd6-a6ca-0ef58a990092 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:45.563273 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7a88f936-6d7d-4cd6-a6ca-0ef58a990092 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:45.564030 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7a88f936-6d7d-4cd6-a6ca-0ef58a990092 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:45.564457 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7a88f936-6d7d-4cd6-a6ca-0ef58a990092 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:45.700658 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-7a88f936-6d7d-4cd6-a6ca-0ef58a990092 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:25:45.707904 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-7a88f936-6d7d-4cd6-a6ca-0ef58a990092 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.155639 Nov 01 01:25:45.708470 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 560/1063] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:25:45 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:25:45.963518 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-1a2de74c-208d-43a0-8a11-6041b1d3751d tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:25:45.964473 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-1a2de74c-208d-43a0-8a11-6041b1d3751d tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:25:45.970702 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-1a2de74c-208d-43a0-8a11-6041b1d3751d tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:45.971146 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-1a2de74c-208d-43a0-8a11-6041b1d3751d tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:45.971910 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-1a2de74c-208d-43a0-8a11-6041b1d3751d tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:45.972344 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-1a2de74c-208d-43a0-8a11-6041b1d3751d tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:46.003492 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-1a2de74c-208d-43a0-8a11-6041b1d3751d tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043703 Nov 01 01:25:46.004054 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 504/1064] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:25:45 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:25:46.724837 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-392290c9-aee0-4a20-8ff2-3aaccf7f401c tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:25:46.725436 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-392290c9-aee0-4a20-8ff2-3aaccf7f401c tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:25:46.732315 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-392290c9-aee0-4a20-8ff2-3aaccf7f401c tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:46.732754 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-392290c9-aee0-4a20-8ff2-3aaccf7f401c tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:46.733769 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-392290c9-aee0-4a20-8ff2-3aaccf7f401c tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:46.734194 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-392290c9-aee0-4a20-8ff2-3aaccf7f401c tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:46.853194 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-392290c9-aee0-4a20-8ff2-3aaccf7f401c tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:25:46.860554 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-392290c9-aee0-4a20-8ff2-3aaccf7f401c tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.139351 Nov 01 01:25:46.861119 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 561/1065] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:25:46 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:25:47.014777 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-12c7efa2-2b44-47fe-8225-7fb81e3ee4b4 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:25:47.015614 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-12c7efa2-2b44-47fe-8225-7fb81e3ee4b4 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:25:47.021957 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-12c7efa2-2b44-47fe-8225-7fb81e3ee4b4 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:47.026160 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-12c7efa2-2b44-47fe-8225-7fb81e3ee4b4 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:47.026160 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-12c7efa2-2b44-47fe-8225-7fb81e3ee4b4 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:47.026160 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-12c7efa2-2b44-47fe-8225-7fb81e3ee4b4 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:47.052206 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-12c7efa2-2b44-47fe-8225-7fb81e3ee4b4 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041220 Nov 01 01:25:47.052743 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 505/1066] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:25:47 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:25:47.876912 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-8f6aae38-3dbe-4162-a275-09c80f67717a tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:25:47.877632 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-8f6aae38-3dbe-4162-a275-09c80f67717a tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:25:47.884411 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8f6aae38-3dbe-4162-a275-09c80f67717a tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:47.884901 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8f6aae38-3dbe-4162-a275-09c80f67717a tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:47.885687 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8f6aae38-3dbe-4162-a275-09c80f67717a tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:47.886119 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8f6aae38-3dbe-4162-a275-09c80f67717a tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:48.003803 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-8f6aae38-3dbe-4162-a275-09c80f67717a tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:25:48.011756 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-8f6aae38-3dbe-4162-a275-09c80f67717a tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.138551 Nov 01 01:25:48.012312 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 562/1067] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:25:47 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:25:48.063390 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-bdefdf44-af3b-4706-a4e2-c90cbb3b3661 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:25:48.064300 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-bdefdf44-af3b-4706-a4e2-c90cbb3b3661 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:25:48.070836 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-bdefdf44-af3b-4706-a4e2-c90cbb3b3661 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:48.077605 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-bdefdf44-af3b-4706-a4e2-c90cbb3b3661 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:48.077605 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-bdefdf44-af3b-4706-a4e2-c90cbb3b3661 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:48.077605 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-bdefdf44-af3b-4706-a4e2-c90cbb3b3661 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:48.100656 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-bdefdf44-af3b-4706-a4e2-c90cbb3b3661 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040978 Nov 01 01:25:48.101190 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 506/1068] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:25:48 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:25:49.028378 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-cd204ef5-b63c-4061-b3ba-9deab8c966cd tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:25:49.028959 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-cd204ef5-b63c-4061-b3ba-9deab8c966cd tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:25:49.035140 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-cd204ef5-b63c-4061-b3ba-9deab8c966cd tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:49.035585 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-cd204ef5-b63c-4061-b3ba-9deab8c966cd tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:49.036334 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-cd204ef5-b63c-4061-b3ba-9deab8c966cd tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:49.036759 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-cd204ef5-b63c-4061-b3ba-9deab8c966cd tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:49.112618 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-1af5317e-76a5-4a6e-b7a6-fc72017cbfaf tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:25:49.113529 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-1af5317e-76a5-4a6e-b7a6-fc72017cbfaf tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:25:49.120108 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-1af5317e-76a5-4a6e-b7a6-fc72017cbfaf tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:49.120551 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-1af5317e-76a5-4a6e-b7a6-fc72017cbfaf tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:49.121312 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-1af5317e-76a5-4a6e-b7a6-fc72017cbfaf tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:49.121741 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-1af5317e-76a5-4a6e-b7a6-fc72017cbfaf tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:49.151844 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-1af5317e-76a5-4a6e-b7a6-fc72017cbfaf tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043169 Nov 01 01:25:49.152406 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 507/1069] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:25:49 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 01 01:25:49.157940 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-cd204ef5-b63c-4061-b3ba-9deab8c966cd tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:25:49.165649 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-cd204ef5-b63c-4061-b3ba-9deab8c966cd tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.140986 Nov 01 01:25:49.166198 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 563/1070] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:25:49 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:25:50.163274 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-a686aca0-b6a3-435b-a116-4c841fad3c57 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:25:50.164272 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-a686aca0-b6a3-435b-a116-4c841fad3c57 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:25:50.170468 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a686aca0-b6a3-435b-a116-4c841fad3c57 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:50.170916 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a686aca0-b6a3-435b-a116-4c841fad3c57 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:50.171669 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a686aca0-b6a3-435b-a116-4c841fad3c57 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:50.172094 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a686aca0-b6a3-435b-a116-4c841fad3c57 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:50.182564 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-af561cc7-fc1a-420b-9cfd-10f1d8d04e05 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:25:50.183172 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-af561cc7-fc1a-420b-9cfd-10f1d8d04e05 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:25:50.189288 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-af561cc7-fc1a-420b-9cfd-10f1d8d04e05 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:50.189730 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-af561cc7-fc1a-420b-9cfd-10f1d8d04e05 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:50.190520 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-af561cc7-fc1a-420b-9cfd-10f1d8d04e05 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:50.190952 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-af561cc7-fc1a-420b-9cfd-10f1d8d04e05 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:50.205829 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-a686aca0-b6a3-435b-a116-4c841fad3c57 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046281 Nov 01 01:25:50.206396 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 508/1071] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:25:50 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:25:50.318982 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-af561cc7-fc1a-420b-9cfd-10f1d8d04e05 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:25:50.326803 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-af561cc7-fc1a-420b-9cfd-10f1d8d04e05 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.147937 Nov 01 01:25:50.327377 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 564/1072] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:25:50 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:25:51.217070 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-81ef5b05-74a1-48c3-bcbb-42095ced2d43 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:25:51.217980 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-81ef5b05-74a1-48c3-bcbb-42095ced2d43 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:25:51.224255 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-81ef5b05-74a1-48c3-bcbb-42095ced2d43 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:51.224697 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-81ef5b05-74a1-48c3-bcbb-42095ced2d43 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:51.225460 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-81ef5b05-74a1-48c3-bcbb-42095ced2d43 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:51.225888 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-81ef5b05-74a1-48c3-bcbb-42095ced2d43 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:51.255157 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-81ef5b05-74a1-48c3-bcbb-42095ced2d43 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041813 Nov 01 01:25:51.255710 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 509/1073] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:25:51 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:25:51.343997 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-d5342f8d-1c71-4f04-9faf-2cb2534ba686 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:25:51.344650 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-d5342f8d-1c71-4f04-9faf-2cb2534ba686 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:25:51.351868 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d5342f8d-1c71-4f04-9faf-2cb2534ba686 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:51.352313 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d5342f8d-1c71-4f04-9faf-2cb2534ba686 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:51.353074 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d5342f8d-1c71-4f04-9faf-2cb2534ba686 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:51.353501 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d5342f8d-1c71-4f04-9faf-2cb2534ba686 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:51.473289 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-d5342f8d-1c71-4f04-9faf-2cb2534ba686 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:25:51.480425 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-d5342f8d-1c71-4f04-9faf-2cb2534ba686 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.140256 Nov 01 01:25:51.480976 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 565/1074] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:25:51 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:25:52.266448 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-6a00a80b-e3dc-42db-a749-9c03f0c94a3d tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:25:52.267349 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-6a00a80b-e3dc-42db-a749-9c03f0c94a3d tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:25:52.276089 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-6a00a80b-e3dc-42db-a749-9c03f0c94a3d tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:52.276868 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-6a00a80b-e3dc-42db-a749-9c03f0c94a3d tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:52.277743 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-6a00a80b-e3dc-42db-a749-9c03f0c94a3d tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:52.278306 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-6a00a80b-e3dc-42db-a749-9c03f0c94a3d tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:52.306610 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-6a00a80b-e3dc-42db-a749-9c03f0c94a3d tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043838 Nov 01 01:25:52.307153 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 510/1075] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:25:52 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:25:52.496632 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-48c82a6d-9016-4d2e-8eb0-75e885756559 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:25:52.497234 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-48c82a6d-9016-4d2e-8eb0-75e885756559 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:25:52.503429 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-48c82a6d-9016-4d2e-8eb0-75e885756559 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:52.503872 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-48c82a6d-9016-4d2e-8eb0-75e885756559 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:52.504627 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-48c82a6d-9016-4d2e-8eb0-75e885756559 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:52.505054 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-48c82a6d-9016-4d2e-8eb0-75e885756559 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:52.627635 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-48c82a6d-9016-4d2e-8eb0-75e885756559 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:25:52.635431 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-48c82a6d-9016-4d2e-8eb0-75e885756559 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.142468 Nov 01 01:25:52.635976 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 566/1076] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:25:52 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:25:53.317416 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-d2412cdd-20f4-4709-abb3-696cc8c40042 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:25:53.318316 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-d2412cdd-20f4-4709-abb3-696cc8c40042 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:25:53.324451 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d2412cdd-20f4-4709-abb3-696cc8c40042 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:53.324885 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d2412cdd-20f4-4709-abb3-696cc8c40042 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:53.325631 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d2412cdd-20f4-4709-abb3-696cc8c40042 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:53.326052 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d2412cdd-20f4-4709-abb3-696cc8c40042 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:53.355421 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-d2412cdd-20f4-4709-abb3-696cc8c40042 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041681 Nov 01 01:25:53.355970 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 511/1077] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:25:53 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:25:53.652317 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-8837c85c-77a0-4fcd-b014-55149f1f03d5 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:25:53.653035 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-8837c85c-77a0-4fcd-b014-55149f1f03d5 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:25:53.666323 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8837c85c-77a0-4fcd-b014-55149f1f03d5 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:53.666323 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8837c85c-77a0-4fcd-b014-55149f1f03d5 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:53.666323 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8837c85c-77a0-4fcd-b014-55149f1f03d5 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:53.666323 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8837c85c-77a0-4fcd-b014-55149f1f03d5 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:53.781308 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-8837c85c-77a0-4fcd-b014-55149f1f03d5 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:25:53.788522 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-8837c85c-77a0-4fcd-b014-55149f1f03d5 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.140478 Nov 01 01:25:53.789082 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 567/1078] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:25:53 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:25:54.367641 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-433a30ad-4b07-4a9f-80a0-14ba8259f6f1 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:25:54.368544 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-433a30ad-4b07-4a9f-80a0-14ba8259f6f1 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:25:54.374699 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-433a30ad-4b07-4a9f-80a0-14ba8259f6f1 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:54.375144 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-433a30ad-4b07-4a9f-80a0-14ba8259f6f1 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:54.375898 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-433a30ad-4b07-4a9f-80a0-14ba8259f6f1 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:54.376323 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-433a30ad-4b07-4a9f-80a0-14ba8259f6f1 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:54.404976 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-433a30ad-4b07-4a9f-80a0-14ba8259f6f1 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041717 Nov 01 01:25:54.405521 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 512/1079] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:25:54 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:25:54.804964 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-3023d5c0-6f82-4861-8c78-82550cfa99b0 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:25:54.805568 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-3023d5c0-6f82-4861-8c78-82550cfa99b0 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:25:54.811694 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3023d5c0-6f82-4861-8c78-82550cfa99b0 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:54.812133 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3023d5c0-6f82-4861-8c78-82550cfa99b0 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:54.812883 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3023d5c0-6f82-4861-8c78-82550cfa99b0 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:54.813305 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3023d5c0-6f82-4861-8c78-82550cfa99b0 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:54.935990 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-3023d5c0-6f82-4861-8c78-82550cfa99b0 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:25:54.943297 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-3023d5c0-6f82-4861-8c78-82550cfa99b0 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.141993 Nov 01 01:25:54.943863 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 568/1080] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:25:54 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:25:55.416333 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-78fb526b-e322-4d3b-a904-967e8a655fb3 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:25:55.417253 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-78fb526b-e322-4d3b-a904-967e8a655fb3 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:25:55.423487 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-78fb526b-e322-4d3b-a904-967e8a655fb3 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:55.423936 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-78fb526b-e322-4d3b-a904-967e8a655fb3 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:55.424730 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-78fb526b-e322-4d3b-a904-967e8a655fb3 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:55.425166 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-78fb526b-e322-4d3b-a904-967e8a655fb3 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:55.453495 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-78fb526b-e322-4d3b-a904-967e8a655fb3 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041378 Nov 01 01:25:55.454051 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 513/1081] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:25:55 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:25:55.959805 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-8b04c580-8ed4-426d-836b-76fb5997e2f0 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:25:55.961058 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-8b04c580-8ed4-426d-836b-76fb5997e2f0 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:25:55.967374 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8b04c580-8ed4-426d-836b-76fb5997e2f0 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:55.967817 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8b04c580-8ed4-426d-836b-76fb5997e2f0 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:55.968571 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8b04c580-8ed4-426d-836b-76fb5997e2f0 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:55.968997 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8b04c580-8ed4-426d-836b-76fb5997e2f0 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:56.091238 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-8b04c580-8ed4-426d-836b-76fb5997e2f0 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:25:56.102581 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-8b04c580-8ed4-426d-836b-76fb5997e2f0 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.146398 Nov 01 01:25:56.103206 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 569/1082] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:25:55 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:25:56.465320 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-c10750d0-e7fa-495c-998e-a41bb8dfb391 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:25:56.466274 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-c10750d0-e7fa-495c-998e-a41bb8dfb391 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:25:56.472539 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c10750d0-e7fa-495c-998e-a41bb8dfb391 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:56.472986 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c10750d0-e7fa-495c-998e-a41bb8dfb391 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:56.473750 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c10750d0-e7fa-495c-998e-a41bb8dfb391 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:56.474188 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c10750d0-e7fa-495c-998e-a41bb8dfb391 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:56.502659 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-c10750d0-e7fa-495c-998e-a41bb8dfb391 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041114 Nov 01 01:25:56.503211 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 514/1083] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:25:56 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:25:57.120779 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-28324926-246c-4420-b99c-129feb7caed0 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:25:57.121328 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-28324926-246c-4420-b99c-129feb7caed0 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:25:57.127446 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-28324926-246c-4420-b99c-129feb7caed0 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:57.127888 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-28324926-246c-4420-b99c-129feb7caed0 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:57.128649 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-28324926-246c-4420-b99c-129feb7caed0 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:57.129076 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-28324926-246c-4420-b99c-129feb7caed0 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:57.247834 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-28324926-246c-4420-b99c-129feb7caed0 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:25:57.254999 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-28324926-246c-4420-b99c-129feb7caed0 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.138389 Nov 01 01:25:57.255557 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 570/1084] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:25:57 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:25:57.513117 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-e0f9e911-521a-4f76-a2cd-ec6d3d4e39f4 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:25:57.514028 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-e0f9e911-521a-4f76-a2cd-ec6d3d4e39f4 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:25:57.520304 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e0f9e911-521a-4f76-a2cd-ec6d3d4e39f4 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:57.520750 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e0f9e911-521a-4f76-a2cd-ec6d3d4e39f4 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:57.521513 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e0f9e911-521a-4f76-a2cd-ec6d3d4e39f4 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:57.521973 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e0f9e911-521a-4f76-a2cd-ec6d3d4e39f4 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:57.550176 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-e0f9e911-521a-4f76-a2cd-ec6d3d4e39f4 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040848 Nov 01 01:25:57.550755 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 515/1085] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:25:57 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:25:58.271125 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-f1381a30-d9fb-4729-b9de-ab8b3b2ec207 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:25:58.271733 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-f1381a30-d9fb-4729-b9de-ab8b3b2ec207 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:25:58.278756 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f1381a30-d9fb-4729-b9de-ab8b3b2ec207 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:58.279201 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f1381a30-d9fb-4729-b9de-ab8b3b2ec207 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:58.279958 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f1381a30-d9fb-4729-b9de-ab8b3b2ec207 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:58.280415 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f1381a30-d9fb-4729-b9de-ab8b3b2ec207 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:58.400842 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-f1381a30-d9fb-4729-b9de-ab8b3b2ec207 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:25:58.409888 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-f1381a30-d9fb-4729-b9de-ab8b3b2ec207 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.142473 Nov 01 01:25:58.410773 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 571/1086] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:25:58 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:25:58.561853 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-97ed3de5-8871-4857-b133-009a670955b9 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:25:58.562716 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-97ed3de5-8871-4857-b133-009a670955b9 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:25:58.568863 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-97ed3de5-8871-4857-b133-009a670955b9 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:58.569304 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-97ed3de5-8871-4857-b133-009a670955b9 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:58.570059 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-97ed3de5-8871-4857-b133-009a670955b9 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:58.571165 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-97ed3de5-8871-4857-b133-009a670955b9 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:58.599269 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-97ed3de5-8871-4857-b133-009a670955b9 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041250 Nov 01 01:25:58.599816 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 516/1087] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:25:58 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:25:59.427038 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-a42841fd-9899-4fc6-a0d0-0b3db108fa0f tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:25:59.427676 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-a42841fd-9899-4fc6-a0d0-0b3db108fa0f tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:25:59.433846 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a42841fd-9899-4fc6-a0d0-0b3db108fa0f tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:59.434287 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a42841fd-9899-4fc6-a0d0-0b3db108fa0f tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:59.435077 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a42841fd-9899-4fc6-a0d0-0b3db108fa0f tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:59.435500 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a42841fd-9899-4fc6-a0d0-0b3db108fa0f tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:59.564804 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-a42841fd-9899-4fc6-a0d0-0b3db108fa0f tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:25:59.572744 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-a42841fd-9899-4fc6-a0d0-0b3db108fa0f tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.149415 Nov 01 01:25:59.573305 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 572/1088] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:25:59 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:25:59.610723 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-9c733544-599f-487c-8abe-e1b020b2b7a8 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:25:59.611667 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-9c733544-599f-487c-8abe-e1b020b2b7a8 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:25:59.618447 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9c733544-599f-487c-8abe-e1b020b2b7a8 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:59.618838 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9c733544-599f-487c-8abe-e1b020b2b7a8 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:59.619628 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9c733544-599f-487c-8abe-e1b020b2b7a8 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:25:59.620057 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9c733544-599f-487c-8abe-e1b020b2b7a8 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:25:59.648513 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-9c733544-599f-487c-8abe-e1b020b2b7a8 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041854 Nov 01 01:25:59.649051 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 517/1089] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:25:59 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:26:00.419283 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-74277437-8fdd-4de8-b9a7-39e90f76652d tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:26:00.419828 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-74277437-8fdd-4de8-b9a7-39e90f76652d tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:26:00.425641 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-74277437-8fdd-4de8-b9a7-39e90f76652d tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:00.426064 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-74277437-8fdd-4de8-b9a7-39e90f76652d tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:00.426849 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-74277437-8fdd-4de8-b9a7-39e90f76652d tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:00.427273 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-74277437-8fdd-4de8-b9a7-39e90f76652d tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:00.448835 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.objects.instance [None req-74277437-8fdd-4de8-b9a7-39e90f76652d tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lazy-loading 'flavor' on Instance uuid 7554da88-1726-438a-bed5-4e30d999ba9d {{(pid=116266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 01 01:26:00.589437 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-0e944713-7463-497e-b857-282843c968a6 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:26:00.590140 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-0e944713-7463-497e-b857-282843c968a6 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:26:00.596030 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0e944713-7463-497e-b857-282843c968a6 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:00.596470 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0e944713-7463-497e-b857-282843c968a6 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:00.597219 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0e944713-7463-497e-b857-282843c968a6 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:00.597642 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0e944713-7463-497e-b857-282843c968a6 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:00.713000 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-74277437-8fdd-4de8-b9a7-39e90f76652d tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "POST /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d/action" status: 202 len: 0 microversion: 2.1 time: 0.297194 Nov 01 01:26:00.718482 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 573/1090] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Nov 1 01:26:00 2021] POST /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d/action => generated 0 bytes in 299 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 01 01:26:00.719154 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-857a5f4f-407d-43d3-9152-6f9c031c13c0 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:26:00.720152 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-857a5f4f-407d-43d3-9152-6f9c031c13c0 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:26:00.722087 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-0e944713-7463-497e-b857-282843c968a6 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:26:00.726331 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-857a5f4f-407d-43d3-9152-6f9c031c13c0 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:00.726848 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-857a5f4f-407d-43d3-9152-6f9c031c13c0 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:00.727620 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-857a5f4f-407d-43d3-9152-6f9c031c13c0 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:00.728055 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-857a5f4f-407d-43d3-9152-6f9c031c13c0 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:00.731668 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-0e944713-7463-497e-b857-282843c968a6 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.146515 Nov 01 01:26:00.733274 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 518/1091] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:26:00 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:26:00.737951 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-cc09e67b-12f8-4101-9072-26b2015beeb7 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:26:00.738693 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-cc09e67b-12f8-4101-9072-26b2015beeb7 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:26:00.746123 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-cc09e67b-12f8-4101-9072-26b2015beeb7 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:00.746589 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-cc09e67b-12f8-4101-9072-26b2015beeb7 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:00.747346 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-cc09e67b-12f8-4101-9072-26b2015beeb7 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:00.747780 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-cc09e67b-12f8-4101-9072-26b2015beeb7 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:00.758717 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-857a5f4f-407d-43d3-9152-6f9c031c13c0 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043255 Nov 01 01:26:00.759280 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 574/1092] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:26:00 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:26:00.869573 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-cc09e67b-12f8-4101-9072-26b2015beeb7 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:26:00.877044 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-cc09e67b-12f8-4101-9072-26b2015beeb7 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.142823 Nov 01 01:26:00.877598 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 519/1093] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:26:00 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:26:01.749081 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-443b0640-744a-4199-8f31-c466898fc5e5 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:26:01.749679 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-443b0640-744a-4199-8f31-c466898fc5e5 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:26:01.755872 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-443b0640-744a-4199-8f31-c466898fc5e5 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:01.756317 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-443b0640-744a-4199-8f31-c466898fc5e5 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:01.757079 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-443b0640-744a-4199-8f31-c466898fc5e5 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:01.757498 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-443b0640-744a-4199-8f31-c466898fc5e5 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:01.768974 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-a6ef2bef-b227-42bb-bf91-7f7679cedcfd tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:26:01.770300 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-a6ef2bef-b227-42bb-bf91-7f7679cedcfd tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:26:01.776947 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a6ef2bef-b227-42bb-bf91-7f7679cedcfd tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:01.777393 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a6ef2bef-b227-42bb-bf91-7f7679cedcfd tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:01.778169 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a6ef2bef-b227-42bb-bf91-7f7679cedcfd tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:01.778627 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a6ef2bef-b227-42bb-bf91-7f7679cedcfd tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:01.811232 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-a6ef2bef-b227-42bb-bf91-7f7679cedcfd tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045932 Nov 01 01:26:01.811832 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 520/1094] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:26:01 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:26:01.894605 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-39b4a48c-fbcf-44e0-8b79-e7a957f7cde7 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:26:01.895210 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-39b4a48c-fbcf-44e0-8b79-e7a957f7cde7 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:26:01.897476 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-443b0640-744a-4199-8f31-c466898fc5e5 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:26:01.901222 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-39b4a48c-fbcf-44e0-8b79-e7a957f7cde7 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:01.901661 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-39b4a48c-fbcf-44e0-8b79-e7a957f7cde7 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:01.902445 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-39b4a48c-fbcf-44e0-8b79-e7a957f7cde7 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:01.902880 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-39b4a48c-fbcf-44e0-8b79-e7a957f7cde7 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:01.905359 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-443b0640-744a-4199-8f31-c466898fc5e5 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.159940 Nov 01 01:26:01.905933 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 575/1095] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:26:01 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:26:02.046588 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-39b4a48c-fbcf-44e0-8b79-e7a957f7cde7 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:26:02.046588 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-39b4a48c-fbcf-44e0-8b79-e7a957f7cde7 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.140191 Nov 01 01:26:02.046588 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 521/1096] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:26:01 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:26:02.823195 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-67cdafc2-3d1d-4114-84fb-656faef348b0 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:26:02.824097 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-67cdafc2-3d1d-4114-84fb-656faef348b0 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:26:02.830199 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-67cdafc2-3d1d-4114-84fb-656faef348b0 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:02.830677 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-67cdafc2-3d1d-4114-84fb-656faef348b0 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:02.831438 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-67cdafc2-3d1d-4114-84fb-656faef348b0 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:02.831860 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-67cdafc2-3d1d-4114-84fb-656faef348b0 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:02.860632 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-67cdafc2-3d1d-4114-84fb-656faef348b0 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041736 Nov 01 01:26:02.861303 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 576/1097] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:26:02 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:26:02.922510 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-3cac4f0d-553e-4c7b-8aca-4cf62a6bdfad tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:26:02.923109 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-3cac4f0d-553e-4c7b-8aca-4cf62a6bdfad tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:26:02.929213 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3cac4f0d-553e-4c7b-8aca-4cf62a6bdfad tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:02.929649 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3cac4f0d-553e-4c7b-8aca-4cf62a6bdfad tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:02.930397 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3cac4f0d-553e-4c7b-8aca-4cf62a6bdfad tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:02.930844 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3cac4f0d-553e-4c7b-8aca-4cf62a6bdfad tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:03.052314 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-3cac4f0d-553e-4c7b-8aca-4cf62a6bdfad tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:26:03.052481 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-d3dc64d4-7c0f-4a5c-b7fe-a43c8efbba7b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:26:03.052997 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-d3dc64d4-7c0f-4a5c-b7fe-a43c8efbba7b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:26:03.059620 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d3dc64d4-7c0f-4a5c-b7fe-a43c8efbba7b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:03.060065 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d3dc64d4-7c0f-4a5c-b7fe-a43c8efbba7b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:03.060825 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-3cac4f0d-553e-4c7b-8aca-4cf62a6bdfad tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.141919 Nov 01 01:26:03.060959 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d3dc64d4-7c0f-4a5c-b7fe-a43c8efbba7b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:03.061293 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d3dc64d4-7c0f-4a5c-b7fe-a43c8efbba7b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:03.069294 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 522/1098] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:26:02 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:26:03.189806 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-d3dc64d4-7c0f-4a5c-b7fe-a43c8efbba7b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:26:03.197692 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-d3dc64d4-7c0f-4a5c-b7fe-a43c8efbba7b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.149193 Nov 01 01:26:03.198258 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 577/1099] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:26:03 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:26:03.872628 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-27890e93-b8ae-445d-8578-85ff9247f821 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:26:03.873732 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-27890e93-b8ae-445d-8578-85ff9247f821 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:26:03.879753 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-27890e93-b8ae-445d-8578-85ff9247f821 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:03.880182 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-27890e93-b8ae-445d-8578-85ff9247f821 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:03.880950 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-27890e93-b8ae-445d-8578-85ff9247f821 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:03.881382 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-27890e93-b8ae-445d-8578-85ff9247f821 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:03.910547 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-27890e93-b8ae-445d-8578-85ff9247f821 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042173 Nov 01 01:26:03.911092 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 523/1100] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:26:03 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 01 01:26:04.076800 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-225f98f1-151e-46d5-a18e-1fca7f188ea2 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:26:04.077460 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-225f98f1-151e-46d5-a18e-1fca7f188ea2 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:26:04.083699 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-225f98f1-151e-46d5-a18e-1fca7f188ea2 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:04.084146 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-225f98f1-151e-46d5-a18e-1fca7f188ea2 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:04.084903 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-225f98f1-151e-46d5-a18e-1fca7f188ea2 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:04.085335 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-225f98f1-151e-46d5-a18e-1fca7f188ea2 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:04.209703 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-225f98f1-151e-46d5-a18e-1fca7f188ea2 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:26:04.213831 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-19d01e33-0d4b-4581-952f-bcff4c4238aa tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:26:04.214449 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-19d01e33-0d4b-4581-952f-bcff4c4238aa tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:26:04.217708 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-225f98f1-151e-46d5-a18e-1fca7f188ea2 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.144511 Nov 01 01:26:04.218278 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 578/1101] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:26:04 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:26:04.220785 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-19d01e33-0d4b-4581-952f-bcff4c4238aa tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:04.221222 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-19d01e33-0d4b-4581-952f-bcff4c4238aa tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:04.221976 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-19d01e33-0d4b-4581-952f-bcff4c4238aa tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:04.222392 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-19d01e33-0d4b-4581-952f-bcff4c4238aa tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:04.338971 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-19d01e33-0d4b-4581-952f-bcff4c4238aa tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:26:04.347582 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-19d01e33-0d4b-4581-952f-bcff4c4238aa tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.137812 Nov 01 01:26:04.348152 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 524/1102] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:26:04 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:26:04.922370 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-d4e92c9b-093f-4a75-9304-86e92013208b tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:26:04.923383 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-d4e92c9b-093f-4a75-9304-86e92013208b tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:26:04.929192 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d4e92c9b-093f-4a75-9304-86e92013208b tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:04.930270 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d4e92c9b-093f-4a75-9304-86e92013208b tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:04.931067 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d4e92c9b-093f-4a75-9304-86e92013208b tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:04.931498 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d4e92c9b-093f-4a75-9304-86e92013208b tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:04.958799 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-d4e92c9b-093f-4a75-9304-86e92013208b tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040202 Nov 01 01:26:04.959358 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 579/1103] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:26:04 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:26:05.233584 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-ace324ff-21ad-4aff-9205-65820a65717e tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:26:05.234200 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-ace324ff-21ad-4aff-9205-65820a65717e tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:26:05.240368 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ace324ff-21ad-4aff-9205-65820a65717e tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:05.240998 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ace324ff-21ad-4aff-9205-65820a65717e tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:05.241771 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ace324ff-21ad-4aff-9205-65820a65717e tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:05.242826 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ace324ff-21ad-4aff-9205-65820a65717e tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:05.364328 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-b8e35306-dfda-45dc-84f3-b1d5b9e27ff8 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:26:05.364931 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-b8e35306-dfda-45dc-84f3-b1d5b9e27ff8 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:26:05.365458 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-ace324ff-21ad-4aff-9205-65820a65717e tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:26:05.370918 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b8e35306-dfda-45dc-84f3-b1d5b9e27ff8 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:05.371354 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b8e35306-dfda-45dc-84f3-b1d5b9e27ff8 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:05.372116 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b8e35306-dfda-45dc-84f3-b1d5b9e27ff8 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:05.372542 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b8e35306-dfda-45dc-84f3-b1d5b9e27ff8 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:05.373096 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-ace324ff-21ad-4aff-9205-65820a65717e tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.143185 Nov 01 01:26:05.373695 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 525/1104] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:26:05 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:26:05.493610 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-b8e35306-dfda-45dc-84f3-b1d5b9e27ff8 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:26:05.500990 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-b8e35306-dfda-45dc-84f3-b1d5b9e27ff8 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.140245 Nov 01 01:26:05.501552 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 580/1105] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:26:05 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:26:05.969536 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-6ef0ea15-80bc-4a64-872a-09b0dcf0b664 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:26:05.970461 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-6ef0ea15-80bc-4a64-872a-09b0dcf0b664 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:26:05.976987 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-6ef0ea15-80bc-4a64-872a-09b0dcf0b664 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:05.977429 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-6ef0ea15-80bc-4a64-872a-09b0dcf0b664 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:05.978176 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-6ef0ea15-80bc-4a64-872a-09b0dcf0b664 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:05.978684 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-6ef0ea15-80bc-4a64-872a-09b0dcf0b664 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:06.165165 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-6ef0ea15-80bc-4a64-872a-09b0dcf0b664 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.199282 Nov 01 01:26:06.165716 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 526/1106] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:26:05 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:26:06.389450 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-7d067301-4a66-4b8f-a66d-08d12a5caac3 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:26:06.390060 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-7d067301-4a66-4b8f-a66d-08d12a5caac3 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:26:06.396423 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7d067301-4a66-4b8f-a66d-08d12a5caac3 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:06.396868 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7d067301-4a66-4b8f-a66d-08d12a5caac3 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:06.397633 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7d067301-4a66-4b8f-a66d-08d12a5caac3 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:06.398065 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7d067301-4a66-4b8f-a66d-08d12a5caac3 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:06.515756 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-7d067301-4a66-4b8f-a66d-08d12a5caac3 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:26:06.517575 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-e15cd499-672c-45f2-90af-58096502a9e7 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:26:06.518181 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-e15cd499-672c-45f2-90af-58096502a9e7 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:26:06.522937 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-7d067301-4a66-4b8f-a66d-08d12a5caac3 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.137076 Nov 01 01:26:06.524054 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 581/1107] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:26:06 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:26:06.524967 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e15cd499-672c-45f2-90af-58096502a9e7 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:06.525465 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e15cd499-672c-45f2-90af-58096502a9e7 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:06.526259 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e15cd499-672c-45f2-90af-58096502a9e7 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:06.526715 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e15cd499-672c-45f2-90af-58096502a9e7 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:06.642746 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-e15cd499-672c-45f2-90af-58096502a9e7 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:26:06.650594 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-e15cd499-672c-45f2-90af-58096502a9e7 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.136654 Nov 01 01:26:06.651149 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 527/1108] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:26:06 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:26:07.176556 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-90f8e5e4-d7e4-4b4d-a842-beb5213afebe tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:26:07.177461 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-90f8e5e4-d7e4-4b4d-a842-beb5213afebe tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:26:07.183297 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-90f8e5e4-d7e4-4b4d-a842-beb5213afebe tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:07.183732 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-90f8e5e4-d7e4-4b4d-a842-beb5213afebe tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:07.184479 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-90f8e5e4-d7e4-4b4d-a842-beb5213afebe tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:07.184902 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-90f8e5e4-d7e4-4b4d-a842-beb5213afebe tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:07.213325 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-90f8e5e4-d7e4-4b4d-a842-beb5213afebe tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040531 Nov 01 01:26:07.213861 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 582/1109] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:26:07 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:26:07.540009 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-198a5526-79f3-43d0-bcdb-81286ea3b908 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:26:07.540529 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-198a5526-79f3-43d0-bcdb-81286ea3b908 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:26:07.546768 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-198a5526-79f3-43d0-bcdb-81286ea3b908 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:07.547211 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-198a5526-79f3-43d0-bcdb-81286ea3b908 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:07.547972 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-198a5526-79f3-43d0-bcdb-81286ea3b908 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:07.548409 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-198a5526-79f3-43d0-bcdb-81286ea3b908 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:07.667768 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-9282846b-757c-4fb1-a431-a0f02d2a69b5 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:26:07.668408 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-9282846b-757c-4fb1-a431-a0f02d2a69b5 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:26:07.668992 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-198a5526-79f3-43d0-bcdb-81286ea3b908 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:26:07.674740 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9282846b-757c-4fb1-a431-a0f02d2a69b5 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:07.675193 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9282846b-757c-4fb1-a431-a0f02d2a69b5 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:07.675957 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9282846b-757c-4fb1-a431-a0f02d2a69b5 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:07.676279 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-198a5526-79f3-43d0-bcdb-81286ea3b908 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.140005 Nov 01 01:26:07.676388 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9282846b-757c-4fb1-a431-a0f02d2a69b5 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:07.676833 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 528/1110] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:26:07 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:26:07.793835 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-9282846b-757c-4fb1-a431-a0f02d2a69b5 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:26:07.801022 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-9282846b-757c-4fb1-a431-a0f02d2a69b5 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.137460 Nov 01 01:26:07.801585 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 583/1111] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:26:07 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:26:08.224772 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-12cbcbb8-f8c3-4afa-9c98-827787f8df10 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:26:08.225692 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-12cbcbb8-f8c3-4afa-9c98-827787f8df10 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:26:08.231536 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-12cbcbb8-f8c3-4afa-9c98-827787f8df10 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:08.231988 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-12cbcbb8-f8c3-4afa-9c98-827787f8df10 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:08.233004 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-12cbcbb8-f8c3-4afa-9c98-827787f8df10 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:08.233437 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-12cbcbb8-f8c3-4afa-9c98-827787f8df10 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:08.262296 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-12cbcbb8-f8c3-4afa-9c98-827787f8df10 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041299 Nov 01 01:26:08.262862 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 529/1112] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:26:08 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 01 01:26:08.693865 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-36871e72-eebe-437a-a910-6cfc3cbb42f3 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:26:08.694499 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-36871e72-eebe-437a-a910-6cfc3cbb42f3 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:26:08.700695 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-36871e72-eebe-437a-a910-6cfc3cbb42f3 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:08.701138 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-36871e72-eebe-437a-a910-6cfc3cbb42f3 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:08.701892 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-36871e72-eebe-437a-a910-6cfc3cbb42f3 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:08.702320 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-36871e72-eebe-437a-a910-6cfc3cbb42f3 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:08.817245 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-a7c4e576-fbae-4fd1-9812-c49fa734abdc tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:26:08.817851 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-a7c4e576-fbae-4fd1-9812-c49fa734abdc tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:26:08.820568 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-36871e72-eebe-437a-a910-6cfc3cbb42f3 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:26:08.824450 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a7c4e576-fbae-4fd1-9812-c49fa734abdc tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:08.824899 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a7c4e576-fbae-4fd1-9812-c49fa734abdc tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:08.825676 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a7c4e576-fbae-4fd1-9812-c49fa734abdc tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:08.826102 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a7c4e576-fbae-4fd1-9812-c49fa734abdc tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:08.827732 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-36871e72-eebe-437a-a910-6cfc3cbb42f3 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.137482 Nov 01 01:26:08.828385 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 584/1113] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:26:08 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:26:08.946356 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-a7c4e576-fbae-4fd1-9812-c49fa734abdc tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:26:08.953499 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-a7c4e576-fbae-4fd1-9812-c49fa734abdc tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.139907 Nov 01 01:26:08.954043 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 530/1114] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:26:08 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:26:09.273101 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-1fa6421f-ba85-4604-9ec5-8313bea13ab7 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:26:09.274437 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-1fa6421f-ba85-4604-9ec5-8313bea13ab7 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:26:09.280321 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1fa6421f-ba85-4604-9ec5-8313bea13ab7 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:09.280765 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1fa6421f-ba85-4604-9ec5-8313bea13ab7 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:09.281517 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1fa6421f-ba85-4604-9ec5-8313bea13ab7 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:09.281945 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1fa6421f-ba85-4604-9ec5-8313bea13ab7 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:09.309848 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-1fa6421f-ba85-4604-9ec5-8313bea13ab7 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040591 Nov 01 01:26:09.310382 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 585/1115] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:26:09 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:26:09.844068 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-e6d6e8dd-643c-4b2b-826b-06e2e01bb246 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:26:09.844670 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-e6d6e8dd-643c-4b2b-826b-06e2e01bb246 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:26:09.850975 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e6d6e8dd-643c-4b2b-826b-06e2e01bb246 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:09.851440 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e6d6e8dd-643c-4b2b-826b-06e2e01bb246 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:09.852182 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e6d6e8dd-643c-4b2b-826b-06e2e01bb246 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:09.852613 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e6d6e8dd-643c-4b2b-826b-06e2e01bb246 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:09.969788 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-e6d6e8dd-643c-4b2b-826b-06e2e01bb246 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:26:09.970342 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-fd6056fd-aed1-4269-8ea1-e7aafbce5e74 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:26:09.970983 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-fd6056fd-aed1-4269-8ea1-e7aafbce5e74 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:26:09.977219 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-e6d6e8dd-643c-4b2b-826b-06e2e01bb246 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.136743 Nov 01 01:26:09.977476 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-fd6056fd-aed1-4269-8ea1-e7aafbce5e74 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:09.977800 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 531/1116] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:26:09 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:26:09.978059 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-fd6056fd-aed1-4269-8ea1-e7aafbce5e74 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:09.978845 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-fd6056fd-aed1-4269-8ea1-e7aafbce5e74 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:09.979269 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-fd6056fd-aed1-4269-8ea1-e7aafbce5e74 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:10.097249 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-fd6056fd-aed1-4269-8ea1-e7aafbce5e74 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:26:10.104959 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-fd6056fd-aed1-4269-8ea1-e7aafbce5e74 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.138185 Nov 01 01:26:10.105516 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 586/1117] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:26:09 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:26:10.321002 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-bf6dcf33-d7f1-41a2-9ca5-558a59c336f5 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:26:10.321930 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-bf6dcf33-d7f1-41a2-9ca5-558a59c336f5 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:26:10.327784 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-bf6dcf33-d7f1-41a2-9ca5-558a59c336f5 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:10.328229 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-bf6dcf33-d7f1-41a2-9ca5-558a59c336f5 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:10.328984 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-bf6dcf33-d7f1-41a2-9ca5-558a59c336f5 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:10.329413 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-bf6dcf33-d7f1-41a2-9ca5-558a59c336f5 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:10.362017 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-bf6dcf33-d7f1-41a2-9ca5-558a59c336f5 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044596 Nov 01 01:26:10.366163 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 532/1118] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:26:10 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:26:10.994143 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-9b646299-16c1-46d4-ae87-2141ba6c5cd7 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:26:10.994780 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-9b646299-16c1-46d4-ae87-2141ba6c5cd7 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:26:11.007017 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9b646299-16c1-46d4-ae87-2141ba6c5cd7 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:11.007457 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9b646299-16c1-46d4-ae87-2141ba6c5cd7 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:11.008718 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9b646299-16c1-46d4-ae87-2141ba6c5cd7 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:11.009142 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9b646299-16c1-46d4-ae87-2141ba6c5cd7 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:11.121992 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-77cd6865-e9e6-4996-9d8d-3ae2a8761bd0 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:26:11.123270 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-77cd6865-e9e6-4996-9d8d-3ae2a8761bd0 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:26:11.130138 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-77cd6865-e9e6-4996-9d8d-3ae2a8761bd0 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:11.130742 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-77cd6865-e9e6-4996-9d8d-3ae2a8761bd0 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:11.131595 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-77cd6865-e9e6-4996-9d8d-3ae2a8761bd0 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:11.132102 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-77cd6865-e9e6-4996-9d8d-3ae2a8761bd0 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:11.134287 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-9b646299-16c1-46d4-ae87-2141ba6c5cd7 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:26:11.144711 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-9b646299-16c1-46d4-ae87-2141ba6c5cd7 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.154649 Nov 01 01:26:11.148288 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 587/1119] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:26:10 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:26:11.256952 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-77cd6865-e9e6-4996-9d8d-3ae2a8761bd0 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:26:11.264101 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-77cd6865-e9e6-4996-9d8d-3ae2a8761bd0 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.146322 Nov 01 01:26:11.264659 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 533/1120] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:26:11 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:26:11.373519 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-f29952ea-ec40-45dc-bfc7-78737f89086a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:26:11.374485 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-f29952ea-ec40-45dc-bfc7-78737f89086a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:26:11.380204 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f29952ea-ec40-45dc-bfc7-78737f89086a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:11.380652 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f29952ea-ec40-45dc-bfc7-78737f89086a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:11.381413 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f29952ea-ec40-45dc-bfc7-78737f89086a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:11.381844 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f29952ea-ec40-45dc-bfc7-78737f89086a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:11.410761 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-f29952ea-ec40-45dc-bfc7-78737f89086a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040976 Nov 01 01:26:11.411412 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 588/1121] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:26:11 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 01 01:26:12.165101 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-b4ad68ed-f9b0-40b1-90e4-44ee4d700242 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:26:12.166274 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-b4ad68ed-f9b0-40b1-90e4-44ee4d700242 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:26:12.172518 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b4ad68ed-f9b0-40b1-90e4-44ee4d700242 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:12.172963 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b4ad68ed-f9b0-40b1-90e4-44ee4d700242 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:12.173723 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b4ad68ed-f9b0-40b1-90e4-44ee4d700242 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:12.174153 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b4ad68ed-f9b0-40b1-90e4-44ee4d700242 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:12.281179 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-d12c1a25-06ad-4529-b2b1-b0049f5c0631 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:26:12.281785 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-d12c1a25-06ad-4529-b2b1-b0049f5c0631 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:26:12.287981 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d12c1a25-06ad-4529-b2b1-b0049f5c0631 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:12.288367 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d12c1a25-06ad-4529-b2b1-b0049f5c0631 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:12.289128 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d12c1a25-06ad-4529-b2b1-b0049f5c0631 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:12.289553 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d12c1a25-06ad-4529-b2b1-b0049f5c0631 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:12.296383 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-b4ad68ed-f9b0-40b1-90e4-44ee4d700242 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:26:12.303589 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-b4ad68ed-f9b0-40b1-90e4-44ee4d700242 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.142120 Nov 01 01:26:12.304142 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 534/1122] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:26:12 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:26:12.417374 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-d12c1a25-06ad-4529-b2b1-b0049f5c0631 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:26:12.421890 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-58780cae-b9b8-45cb-9918-01ee357e93c9 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:26:12.422837 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-58780cae-b9b8-45cb-9918-01ee357e93c9 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:26:12.424743 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-d12c1a25-06ad-4529-b2b1-b0049f5c0631 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.147146 Nov 01 01:26:12.425310 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 589/1123] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:26:12 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:26:12.428528 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-58780cae-b9b8-45cb-9918-01ee357e93c9 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:12.428965 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-58780cae-b9b8-45cb-9918-01ee357e93c9 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:12.429798 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-58780cae-b9b8-45cb-9918-01ee357e93c9 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:12.430224 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-58780cae-b9b8-45cb-9918-01ee357e93c9 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:12.458334 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-58780cae-b9b8-45cb-9918-01ee357e93c9 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040068 Nov 01 01:26:12.458890 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 535/1124] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:26:12 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 01 01:26:13.319803 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-db3c324f-a8e9-42a9-b961-472848453f9f tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:26:13.320403 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-db3c324f-a8e9-42a9-b961-472848453f9f tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:26:13.326539 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-db3c324f-a8e9-42a9-b961-472848453f9f tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:13.326981 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-db3c324f-a8e9-42a9-b961-472848453f9f tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:13.327728 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-db3c324f-a8e9-42a9-b961-472848453f9f tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:13.328151 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-db3c324f-a8e9-42a9-b961-472848453f9f tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:13.440861 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-8c01c228-920d-4e76-bf2e-576551e01c79 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:26:13.441471 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-8c01c228-920d-4e76-bf2e-576551e01c79 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:26:13.445616 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-db3c324f-a8e9-42a9-b961-472848453f9f tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:26:13.447569 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8c01c228-920d-4e76-bf2e-576551e01c79 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:13.448016 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8c01c228-920d-4e76-bf2e-576551e01c79 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:13.448791 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8c01c228-920d-4e76-bf2e-576551e01c79 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:13.449265 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8c01c228-920d-4e76-bf2e-576551e01c79 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:13.453114 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-db3c324f-a8e9-42a9-b961-472848453f9f tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.136855 Nov 01 01:26:13.453781 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 590/1125] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:26:13 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:26:13.469081 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-bad90418-0c1a-4347-a7f4-e8eabd2a298a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:26:13.470131 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-bad90418-0c1a-4347-a7f4-e8eabd2a298a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:26:13.478889 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-bad90418-0c1a-4347-a7f4-e8eabd2a298a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:13.478889 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-bad90418-0c1a-4347-a7f4-e8eabd2a298a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:13.478889 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-bad90418-0c1a-4347-a7f4-e8eabd2a298a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:13.478889 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-bad90418-0c1a-4347-a7f4-e8eabd2a298a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:13.507269 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-bad90418-0c1a-4347-a7f4-e8eabd2a298a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041888 Nov 01 01:26:13.507825 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 591/1126] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:26:13 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 01 01:26:13.573679 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-8c01c228-920d-4e76-bf2e-576551e01c79 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:26:13.580945 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-8c01c228-920d-4e76-bf2e-576551e01c79 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.143844 Nov 01 01:26:13.581490 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 536/1127] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:26:13 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:26:14.471757 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-9690ecf4-af59-4047-9e22-e5e41b8a0e89 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:26:14.472363 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-9690ecf4-af59-4047-9e22-e5e41b8a0e89 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:26:14.478281 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9690ecf4-af59-4047-9e22-e5e41b8a0e89 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:14.478770 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9690ecf4-af59-4047-9e22-e5e41b8a0e89 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:14.479527 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9690ecf4-af59-4047-9e22-e5e41b8a0e89 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:14.479953 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9690ecf4-af59-4047-9e22-e5e41b8a0e89 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:14.518730 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-6d2f49f6-2285-447b-a7b2-1e292aaa20d5 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:26:14.519712 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-6d2f49f6-2285-447b-a7b2-1e292aaa20d5 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:26:14.527047 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-6d2f49f6-2285-447b-a7b2-1e292aaa20d5 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:14.527543 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-6d2f49f6-2285-447b-a7b2-1e292aaa20d5 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:14.528320 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-6d2f49f6-2285-447b-a7b2-1e292aaa20d5 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:14.528748 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-6d2f49f6-2285-447b-a7b2-1e292aaa20d5 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:14.559248 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-6d2f49f6-2285-447b-a7b2-1e292aaa20d5 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044189 Nov 01 01:26:14.559814 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 537/1128] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:26:14 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 01 01:26:14.597710 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-a7c1fb78-985e-4c6f-833b-d3418cea27f1 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:26:14.598406 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-a7c1fb78-985e-4c6f-833b-d3418cea27f1 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:26:14.604689 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a7c1fb78-985e-4c6f-833b-d3418cea27f1 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:14.605106 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a7c1fb78-985e-4c6f-833b-d3418cea27f1 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:14.605873 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a7c1fb78-985e-4c6f-833b-d3418cea27f1 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:14.606301 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a7c1fb78-985e-4c6f-833b-d3418cea27f1 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:14.607124 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-9690ecf4-af59-4047-9e22-e5e41b8a0e89 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:26:14.614717 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-9690ecf4-af59-4047-9e22-e5e41b8a0e89 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.146630 Nov 01 01:26:14.615282 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 592/1129] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:26:14 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:26:14.722677 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-a7c1fb78-985e-4c6f-833b-d3418cea27f1 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:26:14.730503 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-a7c1fb78-985e-4c6f-833b-d3418cea27f1 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.136495 Nov 01 01:26:14.731056 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 538/1130] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:26:14 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:26:15.570662 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-2b41331c-ad09-4816-b7d5-8faa0e3d83e6 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:26:15.571492 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-2b41331c-ad09-4816-b7d5-8faa0e3d83e6 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:26:15.577627 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2b41331c-ad09-4816-b7d5-8faa0e3d83e6 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:15.578061 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2b41331c-ad09-4816-b7d5-8faa0e3d83e6 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:15.578847 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2b41331c-ad09-4816-b7d5-8faa0e3d83e6 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:15.579271 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2b41331c-ad09-4816-b7d5-8faa0e3d83e6 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:15.606943 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-2b41331c-ad09-4816-b7d5-8faa0e3d83e6 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040101 Nov 01 01:26:15.607738 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 593/1131] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:26:15 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:26:15.631617 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-360ba0a3-7e1e-439f-9b62-0c4561b84598 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:26:15.632223 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-360ba0a3-7e1e-439f-9b62-0c4561b84598 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:26:15.638556 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-360ba0a3-7e1e-439f-9b62-0c4561b84598 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:15.638998 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-360ba0a3-7e1e-439f-9b62-0c4561b84598 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:15.639756 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-360ba0a3-7e1e-439f-9b62-0c4561b84598 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:15.640178 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-360ba0a3-7e1e-439f-9b62-0c4561b84598 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:15.747376 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-9115d854-3cbd-4244-9de0-7852461a2ed9 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:26:15.747978 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-9115d854-3cbd-4244-9de0-7852461a2ed9 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:26:15.753639 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9115d854-3cbd-4244-9de0-7852461a2ed9 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:15.754086 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9115d854-3cbd-4244-9de0-7852461a2ed9 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:15.754883 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9115d854-3cbd-4244-9de0-7852461a2ed9 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:15.755312 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9115d854-3cbd-4244-9de0-7852461a2ed9 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:15.757613 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-360ba0a3-7e1e-439f-9b62-0c4561b84598 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:26:15.764653 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-360ba0a3-7e1e-439f-9b62-0c4561b84598 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.136683 Nov 01 01:26:15.765238 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 539/1132] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:26:15 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:26:15.873655 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-9115d854-3cbd-4244-9de0-7852461a2ed9 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:26:15.880834 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-9115d854-3cbd-4244-9de0-7852461a2ed9 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.137059 Nov 01 01:26:15.881399 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 594/1133] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:26:15 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:26:16.618619 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-74ce003f-dff3-4fba-b7bd-e3dff513b35e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:26:16.619437 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-74ce003f-dff3-4fba-b7bd-e3dff513b35e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:26:16.625874 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-74ce003f-dff3-4fba-b7bd-e3dff513b35e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:16.626292 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-74ce003f-dff3-4fba-b7bd-e3dff513b35e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:16.627067 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-74ce003f-dff3-4fba-b7bd-e3dff513b35e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:16.627491 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-74ce003f-dff3-4fba-b7bd-e3dff513b35e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:16.655792 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-74ce003f-dff3-4fba-b7bd-e3dff513b35e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041054 Nov 01 01:26:16.656435 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 540/1134] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:26:16 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:26:16.780724 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-3af19bca-9806-411b-91ca-5fcd6e228b3e tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:26:16.781326 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-3af19bca-9806-411b-91ca-5fcd6e228b3e tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:26:16.787554 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3af19bca-9806-411b-91ca-5fcd6e228b3e tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:16.787987 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3af19bca-9806-411b-91ca-5fcd6e228b3e tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:16.788741 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3af19bca-9806-411b-91ca-5fcd6e228b3e tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:16.789169 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3af19bca-9806-411b-91ca-5fcd6e228b3e tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:16.896970 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-98bb77e2-56c1-466a-9619-0c6b0b6d8933 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:26:16.897551 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-98bb77e2-56c1-466a-9619-0c6b0b6d8933 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:26:16.903424 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-98bb77e2-56c1-466a-9619-0c6b0b6d8933 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:16.903862 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-98bb77e2-56c1-466a-9619-0c6b0b6d8933 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:16.904628 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-98bb77e2-56c1-466a-9619-0c6b0b6d8933 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:16.905049 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-98bb77e2-56c1-466a-9619-0c6b0b6d8933 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:16.908558 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-3af19bca-9806-411b-91ca-5fcd6e228b3e tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:26:16.915782 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-3af19bca-9806-411b-91ca-5fcd6e228b3e tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.138694 Nov 01 01:26:16.916343 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 595/1135] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:26:16 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:26:17.026921 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-98bb77e2-56c1-466a-9619-0c6b0b6d8933 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:26:17.033854 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-98bb77e2-56c1-466a-9619-0c6b0b6d8933 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.140598 Nov 01 01:26:17.034604 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 541/1136] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:26:16 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:26:17.085549 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [req-fb16a488-0a34-4aef-ac0a-62738cef20ec req-f30c8c6d-9fa7-4929-b7b6-9b7bafcec053 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7554da88-1726-438a-bed5-4e30d999ba9d", "name": "network-vif-unplugged", "status": "completed", "tag": "bebb1bd2-6980-4bbb-a08e-ca30b1d8aac9"}]} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:26:17.087096 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 01 01:26:17.087096 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: warnings.warn(msg) Nov 01 01:26:17.093816 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [req-fb16a488-0a34-4aef-ac0a-62738cef20ec req-f30c8c6d-9fa7-4929-b7b6-9b7bafcec053 service nova] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:17.094248 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [req-fb16a488-0a34-4aef-ac0a-62738cef20ec req-f30c8c6d-9fa7-4929-b7b6-9b7bafcec053 service nova] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:17.104731 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.compute.server_external_events [req-fb16a488-0a34-4aef-ac0a-62738cef20ec req-f30c8c6d-9fa7-4929-b7b6-9b7bafcec053 service nova] Creating event network-vif-unplugged:bebb1bd2-6980-4bbb-a08e-ca30b1d8aac9 for instance 7554da88-1726-438a-bed5-4e30d999ba9d on hv-cinder-81561 Nov 01 01:26:17.110416 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [req-fb16a488-0a34-4aef-ac0a-62738cef20ec req-f30c8c6d-9fa7-4929-b7b6-9b7bafcec053 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.028502 Nov 01 01:26:17.111005 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 596/1137] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Nov 1 01:26:17 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:26:17.667374 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-67efcd9a-03de-413d-8e09-f936e6c6af11 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:26:17.668290 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-67efcd9a-03de-413d-8e09-f936e6c6af11 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:26:17.674177 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-67efcd9a-03de-413d-8e09-f936e6c6af11 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:17.674657 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-67efcd9a-03de-413d-8e09-f936e6c6af11 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:17.675408 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-67efcd9a-03de-413d-8e09-f936e6c6af11 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:17.675857 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-67efcd9a-03de-413d-8e09-f936e6c6af11 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:17.705193 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-67efcd9a-03de-413d-8e09-f936e6c6af11 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041745 Nov 01 01:26:17.705722 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 542/1138] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:26:17 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:26:17.933849 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-7fd4f65b-b0ba-4f8f-9791-7405b0b6c48f tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:26:17.938638 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-7fd4f65b-b0ba-4f8f-9791-7405b0b6c48f tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:26:17.941059 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7fd4f65b-b0ba-4f8f-9791-7405b0b6c48f tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:17.941507 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7fd4f65b-b0ba-4f8f-9791-7405b0b6c48f tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:17.942276 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7fd4f65b-b0ba-4f8f-9791-7405b0b6c48f tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:17.942752 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7fd4f65b-b0ba-4f8f-9791-7405b0b6c48f tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:18.051151 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-4a04e647-9f4f-4b89-af01-8999d844c2b3 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:26:18.052117 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-4a04e647-9f4f-4b89-af01-8999d844c2b3 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:26:18.058118 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4a04e647-9f4f-4b89-af01-8999d844c2b3 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:18.058868 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4a04e647-9f4f-4b89-af01-8999d844c2b3 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:18.059703 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4a04e647-9f4f-4b89-af01-8999d844c2b3 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:18.060758 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4a04e647-9f4f-4b89-af01-8999d844c2b3 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:18.071270 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-7fd4f65b-b0ba-4f8f-9791-7405b0b6c48f tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:26:18.079104 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-7fd4f65b-b0ba-4f8f-9791-7405b0b6c48f tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.149744 Nov 01 01:26:18.079673 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 597/1139] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:26:17 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:26:18.181544 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-4a04e647-9f4f-4b89-af01-8999d844c2b3 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:26:18.189537 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-4a04e647-9f4f-4b89-af01-8999d844c2b3 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.141991 Nov 01 01:26:18.190034 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 543/1140] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:26:18 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:26:18.716885 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-c3de1b88-18cc-4c40-9911-ad2899c47bdf tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:26:18.717799 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-c3de1b88-18cc-4c40-9911-ad2899c47bdf tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:26:18.723635 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c3de1b88-18cc-4c40-9911-ad2899c47bdf tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:18.724078 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c3de1b88-18cc-4c40-9911-ad2899c47bdf tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:18.724835 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c3de1b88-18cc-4c40-9911-ad2899c47bdf tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:18.725261 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c3de1b88-18cc-4c40-9911-ad2899c47bdf tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:18.753455 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-c3de1b88-18cc-4c40-9911-ad2899c47bdf tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040739 Nov 01 01:26:18.753992 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 598/1141] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:26:18 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:26:19.096475 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-e44f5334-6872-48c2-a1b0-0e0a5d759c8f tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:26:19.097018 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-e44f5334-6872-48c2-a1b0-0e0a5d759c8f tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:26:19.103124 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e44f5334-6872-48c2-a1b0-0e0a5d759c8f tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:19.103558 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e44f5334-6872-48c2-a1b0-0e0a5d759c8f tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:19.104309 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e44f5334-6872-48c2-a1b0-0e0a5d759c8f tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:19.104728 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e44f5334-6872-48c2-a1b0-0e0a5d759c8f tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:19.206378 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-27baa0be-b49d-4513-a7be-576bf03dd36c tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:26:19.207034 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-27baa0be-b49d-4513-a7be-576bf03dd36c tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:26:19.213173 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-27baa0be-b49d-4513-a7be-576bf03dd36c tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:19.213613 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-27baa0be-b49d-4513-a7be-576bf03dd36c tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:19.214365 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-27baa0be-b49d-4513-a7be-576bf03dd36c tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:19.214817 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-27baa0be-b49d-4513-a7be-576bf03dd36c tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:19.223068 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-e44f5334-6872-48c2-a1b0-0e0a5d759c8f tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:26:19.230333 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-e44f5334-6872-48c2-a1b0-0e0a5d759c8f tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.137573 Nov 01 01:26:19.231006 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 544/1142] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:26:19 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:26:19.334487 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-27baa0be-b49d-4513-a7be-576bf03dd36c tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:26:19.342333 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-27baa0be-b49d-4513-a7be-576bf03dd36c tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.138970 Nov 01 01:26:19.342927 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 599/1143] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:26:19 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:26:19.764917 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-0179bd21-e409-4040-9193-e3b72caa4c07 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:26:19.765863 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-0179bd21-e409-4040-9193-e3b72caa4c07 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:26:19.771906 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0179bd21-e409-4040-9193-e3b72caa4c07 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:19.772351 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0179bd21-e409-4040-9193-e3b72caa4c07 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:19.773109 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0179bd21-e409-4040-9193-e3b72caa4c07 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:19.773996 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0179bd21-e409-4040-9193-e3b72caa4c07 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:19.802271 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-0179bd21-e409-4040-9193-e3b72caa4c07 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041182 Nov 01 01:26:19.802833 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 545/1144] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:26:19 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:26:20.247101 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-d450e483-55af-49d8-91e4-b35e685a455d tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:26:20.248217 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-d450e483-55af-49d8-91e4-b35e685a455d tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:26:20.254345 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d450e483-55af-49d8-91e4-b35e685a455d tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:20.254821 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d450e483-55af-49d8-91e4-b35e685a455d tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:20.255619 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d450e483-55af-49d8-91e4-b35e685a455d tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:20.256046 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d450e483-55af-49d8-91e4-b35e685a455d tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:20.359234 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-b2cfe796-e3c4-4791-a6a8-7fe8ad5022c4 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:26:20.360140 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-b2cfe796-e3c4-4791-a6a8-7fe8ad5022c4 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:26:20.366594 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b2cfe796-e3c4-4791-a6a8-7fe8ad5022c4 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:20.366846 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b2cfe796-e3c4-4791-a6a8-7fe8ad5022c4 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:20.367616 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b2cfe796-e3c4-4791-a6a8-7fe8ad5022c4 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:20.368040 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b2cfe796-e3c4-4791-a6a8-7fe8ad5022c4 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:20.379649 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-d450e483-55af-49d8-91e4-b35e685a455d tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:26:20.387514 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-d450e483-55af-49d8-91e4-b35e685a455d tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.144072 Nov 01 01:26:20.389026 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 600/1145] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:26:20 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:26:20.495234 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-b2cfe796-e3c4-4791-a6a8-7fe8ad5022c4 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:26:20.503184 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-b2cfe796-e3c4-4791-a6a8-7fe8ad5022c4 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.147874 Nov 01 01:26:20.503741 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 546/1146] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:26:20 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:26:20.814148 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-e559d6fe-bc85-4e24-88f2-2b4b91c39671 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:26:20.815125 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-e559d6fe-bc85-4e24-88f2-2b4b91c39671 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:26:20.821123 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e559d6fe-bc85-4e24-88f2-2b4b91c39671 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:20.821572 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e559d6fe-bc85-4e24-88f2-2b4b91c39671 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:20.822344 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e559d6fe-bc85-4e24-88f2-2b4b91c39671 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:20.822950 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e559d6fe-bc85-4e24-88f2-2b4b91c39671 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:20.853297 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-e559d6fe-bc85-4e24-88f2-2b4b91c39671 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043901 Nov 01 01:26:20.853856 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 601/1147] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:26:20 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:26:21.405393 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-24d7188d-2baa-425f-ac2a-e6348df15b76 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:26:21.405996 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-24d7188d-2baa-425f-ac2a-e6348df15b76 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:26:21.412219 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-24d7188d-2baa-425f-ac2a-e6348df15b76 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:21.412655 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-24d7188d-2baa-425f-ac2a-e6348df15b76 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:21.413690 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-24d7188d-2baa-425f-ac2a-e6348df15b76 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:21.414124 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-24d7188d-2baa-425f-ac2a-e6348df15b76 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:21.519966 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-24f940bd-9536-433d-a12b-1e33f655cbba tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:26:21.521079 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-24f940bd-9536-433d-a12b-1e33f655cbba tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:26:21.527165 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-24f940bd-9536-433d-a12b-1e33f655cbba tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:21.527604 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-24f940bd-9536-433d-a12b-1e33f655cbba tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:21.528360 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-24f940bd-9536-433d-a12b-1e33f655cbba tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:21.528780 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-24f940bd-9536-433d-a12b-1e33f655cbba tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:21.534537 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-24d7188d-2baa-425f-ac2a-e6348df15b76 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:26:21.541780 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-24d7188d-2baa-425f-ac2a-e6348df15b76 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.140683 Nov 01 01:26:21.542436 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 547/1148] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:26:21 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:26:21.646474 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-24f940bd-9536-433d-a12b-1e33f655cbba tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:26:21.653561 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-24f940bd-9536-433d-a12b-1e33f655cbba tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.137238 Nov 01 01:26:21.654117 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 602/1149] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:26:21 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:26:21.866099 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-e8633eb0-14e8-4a0e-a8ff-4790c16d7dd0 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:26:21.867043 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-e8633eb0-14e8-4a0e-a8ff-4790c16d7dd0 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:26:21.875013 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e8633eb0-14e8-4a0e-a8ff-4790c16d7dd0 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:21.875456 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e8633eb0-14e8-4a0e-a8ff-4790c16d7dd0 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:21.876213 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e8633eb0-14e8-4a0e-a8ff-4790c16d7dd0 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:21.876638 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e8633eb0-14e8-4a0e-a8ff-4790c16d7dd0 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:21.921383 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-e8633eb0-14e8-4a0e-a8ff-4790c16d7dd0 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044542 Nov 01 01:26:21.921383 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 548/1150] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:26:21 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:26:22.557705 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-81a61ba9-d138-4436-b15f-5b7386c863ce tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:26:22.558286 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-81a61ba9-d138-4436-b15f-5b7386c863ce tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:26:22.564520 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-81a61ba9-d138-4436-b15f-5b7386c863ce tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:22.564960 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-81a61ba9-d138-4436-b15f-5b7386c863ce tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:22.565708 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-81a61ba9-d138-4436-b15f-5b7386c863ce tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:22.566127 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-81a61ba9-d138-4436-b15f-5b7386c863ce tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:22.670645 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-09a64c84-53e6-44a3-bc5f-8fca3befde82 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:26:22.671254 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-09a64c84-53e6-44a3-bc5f-8fca3befde82 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:26:22.677365 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-09a64c84-53e6-44a3-bc5f-8fca3befde82 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:22.677812 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-09a64c84-53e6-44a3-bc5f-8fca3befde82 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:22.678620 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-09a64c84-53e6-44a3-bc5f-8fca3befde82 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:22.679053 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-09a64c84-53e6-44a3-bc5f-8fca3befde82 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:22.683668 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-81a61ba9-d138-4436-b15f-5b7386c863ce tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:26:22.690758 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-81a61ba9-d138-4436-b15f-5b7386c863ce tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.136625 Nov 01 01:26:22.691311 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 603/1151] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:26:22 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:26:22.799585 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-09a64c84-53e6-44a3-bc5f-8fca3befde82 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:26:22.806768 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-09a64c84-53e6-44a3-bc5f-8fca3befde82 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.140331 Nov 01 01:26:22.807323 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 549/1152] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:26:22 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:26:22.931147 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-9d71d0c3-c09b-46f7-b89e-7ae244447285 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:26:22.932040 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-9d71d0c3-c09b-46f7-b89e-7ae244447285 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:26:22.937744 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9d71d0c3-c09b-46f7-b89e-7ae244447285 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:22.938179 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9d71d0c3-c09b-46f7-b89e-7ae244447285 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:22.938953 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9d71d0c3-c09b-46f7-b89e-7ae244447285 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:22.939374 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9d71d0c3-c09b-46f7-b89e-7ae244447285 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:22.967573 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-9d71d0c3-c09b-46f7-b89e-7ae244447285 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040139 Nov 01 01:26:22.968107 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 604/1153] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:26:22 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:26:23.707275 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-ffde9cb4-6828-4339-9c4d-21794a9d3f60 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:26:23.707892 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-ffde9cb4-6828-4339-9c4d-21794a9d3f60 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:26:23.714115 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ffde9cb4-6828-4339-9c4d-21794a9d3f60 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:23.714591 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ffde9cb4-6828-4339-9c4d-21794a9d3f60 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:23.715362 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ffde9cb4-6828-4339-9c4d-21794a9d3f60 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:23.715795 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ffde9cb4-6828-4339-9c4d-21794a9d3f60 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:23.823187 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-a06584b7-3e0d-4918-8357-114da6a5c591 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:26:23.823785 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-a06584b7-3e0d-4918-8357-114da6a5c591 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:26:23.829943 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a06584b7-3e0d-4918-8357-114da6a5c591 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:23.830381 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a06584b7-3e0d-4918-8357-114da6a5c591 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:23.831179 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a06584b7-3e0d-4918-8357-114da6a5c591 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:23.831611 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a06584b7-3e0d-4918-8357-114da6a5c591 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:23.833901 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-ffde9cb4-6828-4339-9c4d-21794a9d3f60 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:26:23.841053 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-ffde9cb4-6828-4339-9c4d-21794a9d3f60 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.137459 Nov 01 01:26:23.842121 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 550/1154] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:26:23 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:26:23.950925 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-a06584b7-3e0d-4918-8357-114da6a5c591 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:26:23.956432 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-a06584b7-3e0d-4918-8357-114da6a5c591 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.136847 Nov 01 01:26:23.957044 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 605/1155] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:26:23 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:26:23.978825 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-bd75b471-3c8d-4e2a-8c9d-88cc4ce51f5d tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:26:23.979677 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-bd75b471-3c8d-4e2a-8c9d-88cc4ce51f5d tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:26:23.986187 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-bd75b471-3c8d-4e2a-8c9d-88cc4ce51f5d tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:23.986697 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-bd75b471-3c8d-4e2a-8c9d-88cc4ce51f5d tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:23.987463 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-bd75b471-3c8d-4e2a-8c9d-88cc4ce51f5d tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:23.987895 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-bd75b471-3c8d-4e2a-8c9d-88cc4ce51f5d tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:24.015815 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-bd75b471-3c8d-4e2a-8c9d-88cc4ce51f5d tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040841 Nov 01 01:26:24.016351 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 551/1156] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:26:23 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:26:24.858119 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-63385e15-15d0-42c8-91f1-9ccdc2f2a1d3 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:26:24.858740 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-63385e15-15d0-42c8-91f1-9ccdc2f2a1d3 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:26:24.864892 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-63385e15-15d0-42c8-91f1-9ccdc2f2a1d3 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:24.865329 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-63385e15-15d0-42c8-91f1-9ccdc2f2a1d3 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:24.866086 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-63385e15-15d0-42c8-91f1-9ccdc2f2a1d3 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:24.866540 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-63385e15-15d0-42c8-91f1-9ccdc2f2a1d3 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:24.972698 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-99ad7b9b-47d5-4cf7-8165-b3894dea3993 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:26:24.973321 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-99ad7b9b-47d5-4cf7-8165-b3894dea3993 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:26:24.979387 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-99ad7b9b-47d5-4cf7-8165-b3894dea3993 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:24.979827 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-99ad7b9b-47d5-4cf7-8165-b3894dea3993 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:24.980580 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-99ad7b9b-47d5-4cf7-8165-b3894dea3993 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:24.980998 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-99ad7b9b-47d5-4cf7-8165-b3894dea3993 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:24.986379 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-63385e15-15d0-42c8-91f1-9ccdc2f2a1d3 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:26:24.993586 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-63385e15-15d0-42c8-91f1-9ccdc2f2a1d3 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.139334 Nov 01 01:26:24.994157 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 606/1157] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:26:24 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:26:25.026864 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-9f28763d-1286-478e-95d0-d3684ce345e9 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:26:25.027769 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-9f28763d-1286-478e-95d0-d3684ce345e9 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:26:25.033590 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9f28763d-1286-478e-95d0-d3684ce345e9 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:25.034024 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9f28763d-1286-478e-95d0-d3684ce345e9 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:25.034806 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9f28763d-1286-478e-95d0-d3684ce345e9 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:25.035227 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9f28763d-1286-478e-95d0-d3684ce345e9 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:25.067997 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-9f28763d-1286-478e-95d0-d3684ce345e9 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041253 Nov 01 01:26:25.067997 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 607/1158] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:26:25 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 01 01:26:25.105239 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-99ad7b9b-47d5-4cf7-8165-b3894dea3993 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:26:25.113400 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-99ad7b9b-47d5-4cf7-8165-b3894dea3993 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.144213 Nov 01 01:26:25.113894 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 552/1159] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:26:24 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:26:26.010729 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-73344d1b-f61c-4e4f-8ce4-2e011d2d25b4 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:26:26.011392 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-73344d1b-f61c-4e4f-8ce4-2e011d2d25b4 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:26:26.018119 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-73344d1b-f61c-4e4f-8ce4-2e011d2d25b4 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:26.018594 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-73344d1b-f61c-4e4f-8ce4-2e011d2d25b4 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:26.019364 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-73344d1b-f61c-4e4f-8ce4-2e011d2d25b4 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:26.019822 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-73344d1b-f61c-4e4f-8ce4-2e011d2d25b4 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:26.075822 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-5cc88d1c-a406-46a5-bf0b-b42941a19555 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:26:26.076836 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-5cc88d1c-a406-46a5-bf0b-b42941a19555 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:26:26.083964 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-5cc88d1c-a406-46a5-bf0b-b42941a19555 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:26.084405 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-5cc88d1c-a406-46a5-bf0b-b42941a19555 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:26.085214 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-5cc88d1c-a406-46a5-bf0b-b42941a19555 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:26.086316 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-5cc88d1c-a406-46a5-bf0b-b42941a19555 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:26.114982 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-5cc88d1c-a406-46a5-bf0b-b42941a19555 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042847 Nov 01 01:26:26.115544 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 553/1160] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:26:26 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 01 01:26:26.129309 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-cbbdbff0-91b7-4222-bc88-aaed7fce412a tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:26:26.129923 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-cbbdbff0-91b7-4222-bc88-aaed7fce412a tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:26:26.135580 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-cbbdbff0-91b7-4222-bc88-aaed7fce412a tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:26.136018 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-cbbdbff0-91b7-4222-bc88-aaed7fce412a tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:26.136772 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-cbbdbff0-91b7-4222-bc88-aaed7fce412a tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:26.137195 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-cbbdbff0-91b7-4222-bc88-aaed7fce412a tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:26.140988 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-73344d1b-f61c-4e4f-8ce4-2e011d2d25b4 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:26:26.148681 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-73344d1b-f61c-4e4f-8ce4-2e011d2d25b4 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.141431 Nov 01 01:26:26.149248 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 608/1161] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:26:26 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:26:26.256651 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-cbbdbff0-91b7-4222-bc88-aaed7fce412a tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:26:26.265258 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-cbbdbff0-91b7-4222-bc88-aaed7fce412a tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.138148 Nov 01 01:26:26.265258 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 554/1162] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:26:26 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:26:27.126278 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-952461e8-84a5-405a-bf2f-f13344d6c715 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:26:27.127373 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-952461e8-84a5-405a-bf2f-f13344d6c715 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:26:27.133584 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-952461e8-84a5-405a-bf2f-f13344d6c715 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:27.134023 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-952461e8-84a5-405a-bf2f-f13344d6c715 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:27.134833 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-952461e8-84a5-405a-bf2f-f13344d6c715 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:27.135259 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-952461e8-84a5-405a-bf2f-f13344d6c715 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:27.165769 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-c7ba263b-ffe8-43b6-b232-757da138c179 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:26:27.166391 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-c7ba263b-ffe8-43b6-b232-757da138c179 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:26:27.173768 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c7ba263b-ffe8-43b6-b232-757da138c179 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:27.174211 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c7ba263b-ffe8-43b6-b232-757da138c179 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:27.175011 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c7ba263b-ffe8-43b6-b232-757da138c179 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:27.175438 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c7ba263b-ffe8-43b6-b232-757da138c179 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:27.303126 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-c7ba263b-ffe8-43b6-b232-757da138c179 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:26:27.310287 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-c7ba263b-ffe8-43b6-b232-757da138c179 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.148315 Nov 01 01:26:27.310947 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 555/1163] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:26:27 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:26:27.315125 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-8e462e81-df1c-4e59-bde2-bfcaa72a0db7 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:26:27.315725 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-8e462e81-df1c-4e59-bde2-bfcaa72a0db7 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:26:27.316102 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-952461e8-84a5-405a-bf2f-f13344d6c715 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.193677 Nov 01 01:26:27.316770 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 609/1164] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:26:27 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:26:27.321276 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8e462e81-df1c-4e59-bde2-bfcaa72a0db7 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:27.321716 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8e462e81-df1c-4e59-bde2-bfcaa72a0db7 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:27.322494 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8e462e81-df1c-4e59-bde2-bfcaa72a0db7 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:27.322922 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8e462e81-df1c-4e59-bde2-bfcaa72a0db7 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:27.439254 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-8e462e81-df1c-4e59-bde2-bfcaa72a0db7 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:26:27.446362 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-8e462e81-df1c-4e59-bde2-bfcaa72a0db7 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.134442 Nov 01 01:26:27.446936 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 556/1165] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:26:27 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:26:28.327358 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-45f13e38-db6a-4935-96f1-1b6979745a03 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:26:28.328172 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-45f13e38-db6a-4935-96f1-1b6979745a03 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:26:28.329073 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-3c179017-485e-4bed-be80-f5aa506f0601 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:26:28.329684 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-3c179017-485e-4bed-be80-f5aa506f0601 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:26:28.334085 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-45f13e38-db6a-4935-96f1-1b6979745a03 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:28.334548 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-45f13e38-db6a-4935-96f1-1b6979745a03 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:28.335297 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-45f13e38-db6a-4935-96f1-1b6979745a03 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:28.335724 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-45f13e38-db6a-4935-96f1-1b6979745a03 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:28.335872 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3c179017-485e-4bed-be80-f5aa506f0601 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:28.336261 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3c179017-485e-4bed-be80-f5aa506f0601 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:28.337022 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3c179017-485e-4bed-be80-f5aa506f0601 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:28.337455 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3c179017-485e-4bed-be80-f5aa506f0601 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:28.365439 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-45f13e38-db6a-4935-96f1-1b6979745a03 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041972 Nov 01 01:26:28.369411 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 610/1166] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:26:28 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:26:28.463473 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-00ea5da3-6abc-471d-b578-52c67c1f8fa0 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:26:28.464079 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-00ea5da3-6abc-471d-b578-52c67c1f8fa0 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:26:28.465350 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-3c179017-485e-4bed-be80-f5aa506f0601 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:26:28.470592 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-00ea5da3-6abc-471d-b578-52c67c1f8fa0 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:28.471089 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-00ea5da3-6abc-471d-b578-52c67c1f8fa0 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:28.471864 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-00ea5da3-6abc-471d-b578-52c67c1f8fa0 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:28.472296 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-00ea5da3-6abc-471d-b578-52c67c1f8fa0 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:28.473116 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-3c179017-485e-4bed-be80-f5aa506f0601 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.147660 Nov 01 01:26:28.473681 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 557/1167] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:26:28 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:26:28.589549 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-00ea5da3-6abc-471d-b578-52c67c1f8fa0 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:26:28.597266 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-00ea5da3-6abc-471d-b578-52c67c1f8fa0 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.137403 Nov 01 01:26:28.597808 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 611/1168] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:26:28 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:26:29.377558 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-c72104e2-be31-49a0-bb94-97bf01b32430 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:26:29.378488 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-c72104e2-be31-49a0-bb94-97bf01b32430 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:26:29.384680 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c72104e2-be31-49a0-bb94-97bf01b32430 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:29.385116 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c72104e2-be31-49a0-bb94-97bf01b32430 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:29.385866 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c72104e2-be31-49a0-bb94-97bf01b32430 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:29.386288 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c72104e2-be31-49a0-bb94-97bf01b32430 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:29.414052 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-c72104e2-be31-49a0-bb94-97bf01b32430 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041017 Nov 01 01:26:29.414604 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 558/1169] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:26:29 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:26:29.489812 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-81ee9a5c-8522-49ff-a5a2-d323b4f4fce8 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:26:29.490373 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-81ee9a5c-8522-49ff-a5a2-d323b4f4fce8 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:26:29.496462 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-81ee9a5c-8522-49ff-a5a2-d323b4f4fce8 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:29.496896 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-81ee9a5c-8522-49ff-a5a2-d323b4f4fce8 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:29.497646 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-81ee9a5c-8522-49ff-a5a2-d323b4f4fce8 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:29.498069 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-81ee9a5c-8522-49ff-a5a2-d323b4f4fce8 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:29.613921 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-499a2a40-d567-4a90-b712-3a983018d87f tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:26:29.614560 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-499a2a40-d567-4a90-b712-3a983018d87f tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:26:29.615823 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-81ee9a5c-8522-49ff-a5a2-d323b4f4fce8 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:26:29.620429 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-499a2a40-d567-4a90-b712-3a983018d87f tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:29.620879 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-499a2a40-d567-4a90-b712-3a983018d87f tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:29.621654 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-499a2a40-d567-4a90-b712-3a983018d87f tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:29.622084 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-499a2a40-d567-4a90-b712-3a983018d87f tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:29.623434 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-81ee9a5c-8522-49ff-a5a2-d323b4f4fce8 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.137291 Nov 01 01:26:29.624739 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 612/1170] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:26:29 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:26:29.741013 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-499a2a40-d567-4a90-b712-3a983018d87f tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:26:29.748232 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-499a2a40-d567-4a90-b712-3a983018d87f tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.137934 Nov 01 01:26:29.749411 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 559/1171] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:26:29 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:26:30.425181 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-6b6fbbf7-00cc-43e3-953d-ecae18ae407f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:26:30.426086 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-6b6fbbf7-00cc-43e3-953d-ecae18ae407f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:26:30.431854 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6b6fbbf7-00cc-43e3-953d-ecae18ae407f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:30.432292 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6b6fbbf7-00cc-43e3-953d-ecae18ae407f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:30.433037 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6b6fbbf7-00cc-43e3-953d-ecae18ae407f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:30.433457 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6b6fbbf7-00cc-43e3-953d-ecae18ae407f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:30.468771 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-6b6fbbf7-00cc-43e3-953d-ecae18ae407f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047247 Nov 01 01:26:30.469314 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 613/1172] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:26:30 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:26:30.641477 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-033082e4-6360-4ed3-ae8e-339454d2731f tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:26:30.642032 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-033082e4-6360-4ed3-ae8e-339454d2731f tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:26:30.648133 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-033082e4-6360-4ed3-ae8e-339454d2731f tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:30.648677 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-033082e4-6360-4ed3-ae8e-339454d2731f tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:30.649427 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-033082e4-6360-4ed3-ae8e-339454d2731f tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:30.649853 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-033082e4-6360-4ed3-ae8e-339454d2731f tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:30.765314 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-741079fc-b5ee-4890-8f42-b0c5556d74b5 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:26:30.765918 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-741079fc-b5ee-4890-8f42-b0c5556d74b5 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:26:30.769571 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-033082e4-6360-4ed3-ae8e-339454d2731f tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:26:30.772263 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-741079fc-b5ee-4890-8f42-b0c5556d74b5 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:30.772711 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-741079fc-b5ee-4890-8f42-b0c5556d74b5 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:30.773509 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-741079fc-b5ee-4890-8f42-b0c5556d74b5 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:30.773936 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-741079fc-b5ee-4890-8f42-b0c5556d74b5 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:30.776991 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-033082e4-6360-4ed3-ae8e-339454d2731f tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.139855 Nov 01 01:26:30.778640 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 560/1173] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:26:30 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:26:30.891225 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-741079fc-b5ee-4890-8f42-b0c5556d74b5 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:26:30.898416 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-741079fc-b5ee-4890-8f42-b0c5556d74b5 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.137403 Nov 01 01:26:30.898933 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 614/1174] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:26:30 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:26:31.480100 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-9e4e66fc-0f18-4365-9dbe-9e832dda34f1 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:26:31.481014 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-9e4e66fc-0f18-4365-9dbe-9e832dda34f1 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:26:31.487200 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9e4e66fc-0f18-4365-9dbe-9e832dda34f1 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:31.487644 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9e4e66fc-0f18-4365-9dbe-9e832dda34f1 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:31.488416 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9e4e66fc-0f18-4365-9dbe-9e832dda34f1 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:31.488823 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9e4e66fc-0f18-4365-9dbe-9e832dda34f1 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:31.517664 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-9e4e66fc-0f18-4365-9dbe-9e832dda34f1 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041382 Nov 01 01:26:31.518199 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 561/1175] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:26:31 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:26:31.793799 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-9386765a-c410-40f1-a670-6ca2db8c831b tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:26:31.794411 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-9386765a-c410-40f1-a670-6ca2db8c831b tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:26:31.801112 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9386765a-c410-40f1-a670-6ca2db8c831b tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:31.801557 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9386765a-c410-40f1-a670-6ca2db8c831b tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:31.802324 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9386765a-c410-40f1-a670-6ca2db8c831b tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:31.802776 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9386765a-c410-40f1-a670-6ca2db8c831b tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:31.914521 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-e4ff25c9-bdba-403e-97c9-c4d947e59c23 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:26:31.915201 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-e4ff25c9-bdba-403e-97c9-c4d947e59c23 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:26:31.921753 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e4ff25c9-bdba-403e-97c9-c4d947e59c23 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:31.922193 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e4ff25c9-bdba-403e-97c9-c4d947e59c23 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:31.922985 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e4ff25c9-bdba-403e-97c9-c4d947e59c23 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:31.923414 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e4ff25c9-bdba-403e-97c9-c4d947e59c23 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:31.925369 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-9386765a-c410-40f1-a670-6ca2db8c831b tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:26:31.932412 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-9386765a-c410-40f1-a670-6ca2db8c831b tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.142248 Nov 01 01:26:31.932968 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 615/1176] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:26:31 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:26:32.041349 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-e4ff25c9-bdba-403e-97c9-c4d947e59c23 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:26:32.053368 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-e4ff25c9-bdba-403e-97c9-c4d947e59c23 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.138244 Nov 01 01:26:32.053368 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 562/1177] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:26:31 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:26:32.528978 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-0f4ebe0d-2e5f-4c36-bf87-c8769b30db9f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:26:32.529918 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-0f4ebe0d-2e5f-4c36-bf87-c8769b30db9f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:26:32.536474 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0f4ebe0d-2e5f-4c36-bf87-c8769b30db9f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:32.536930 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0f4ebe0d-2e5f-4c36-bf87-c8769b30db9f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:32.537695 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0f4ebe0d-2e5f-4c36-bf87-c8769b30db9f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:32.538126 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0f4ebe0d-2e5f-4c36-bf87-c8769b30db9f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:32.565872 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-0f4ebe0d-2e5f-4c36-bf87-c8769b30db9f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040692 Nov 01 01:26:32.566417 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 616/1178] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:26:32 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:26:32.949385 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-fa6f89ca-69b3-4cc3-b60b-6d3e221b259c tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:26:32.949987 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-fa6f89ca-69b3-4cc3-b60b-6d3e221b259c tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:26:32.956876 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-fa6f89ca-69b3-4cc3-b60b-6d3e221b259c tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:32.957320 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-fa6f89ca-69b3-4cc3-b60b-6d3e221b259c tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:32.958076 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-fa6f89ca-69b3-4cc3-b60b-6d3e221b259c tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:32.958538 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-fa6f89ca-69b3-4cc3-b60b-6d3e221b259c tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:33.079776 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-fa6f89ca-69b3-4cc3-b60b-6d3e221b259c tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:26:33.087979 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-fa6f89ca-69b3-4cc3-b60b-6d3e221b259c tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.142210 Nov 01 01:26:33.088668 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 563/1179] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:26:32 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:26:33.163759 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-a349971a-6662-4f7e-9e6b-175180ce5c48 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:26:33.164366 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-a349971a-6662-4f7e-9e6b-175180ce5c48 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:26:33.170086 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a349971a-6662-4f7e-9e6b-175180ce5c48 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:33.171067 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a349971a-6662-4f7e-9e6b-175180ce5c48 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:33.171825 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a349971a-6662-4f7e-9e6b-175180ce5c48 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:33.172251 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a349971a-6662-4f7e-9e6b-175180ce5c48 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:33.291364 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-a349971a-6662-4f7e-9e6b-175180ce5c48 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:26:33.299404 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-a349971a-6662-4f7e-9e6b-175180ce5c48 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.238158 Nov 01 01:26:33.299951 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 617/1180] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:26:33 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:26:33.577191 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-b7ef3475-55c2-4daf-a6a5-099cec2c2fb8 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:26:33.578031 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-b7ef3475-55c2-4daf-a6a5-099cec2c2fb8 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:26:33.583958 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b7ef3475-55c2-4daf-a6a5-099cec2c2fb8 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:33.584398 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b7ef3475-55c2-4daf-a6a5-099cec2c2fb8 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:33.585146 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b7ef3475-55c2-4daf-a6a5-099cec2c2fb8 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:33.585580 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b7ef3475-55c2-4daf-a6a5-099cec2c2fb8 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:33.614575 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-b7ef3475-55c2-4daf-a6a5-099cec2c2fb8 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041134 Nov 01 01:26:33.615105 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 564/1181] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:26:33 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:26:34.105989 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-2f334a19-2c61-4afd-8bfa-80076f01e6a6 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:26:34.106870 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-2f334a19-2c61-4afd-8bfa-80076f01e6a6 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:26:34.113130 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2f334a19-2c61-4afd-8bfa-80076f01e6a6 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:34.113570 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2f334a19-2c61-4afd-8bfa-80076f01e6a6 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:34.114320 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2f334a19-2c61-4afd-8bfa-80076f01e6a6 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:34.114767 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2f334a19-2c61-4afd-8bfa-80076f01e6a6 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:34.234246 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-2f334a19-2c61-4afd-8bfa-80076f01e6a6 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:26:34.241495 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-2f334a19-2c61-4afd-8bfa-80076f01e6a6 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.139145 Nov 01 01:26:34.242039 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 618/1182] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:26:34 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:26:34.316444 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-8393f581-c343-467c-8587-726b9772aca0 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:26:34.317047 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-8393f581-c343-467c-8587-726b9772aca0 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:26:34.323253 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8393f581-c343-467c-8587-726b9772aca0 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:34.323699 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8393f581-c343-467c-8587-726b9772aca0 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:34.324458 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8393f581-c343-467c-8587-726b9772aca0 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:34.324888 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8393f581-c343-467c-8587-726b9772aca0 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:34.442529 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-8393f581-c343-467c-8587-726b9772aca0 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:26:34.449662 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-8393f581-c343-467c-8587-726b9772aca0 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.136917 Nov 01 01:26:34.450219 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 565/1183] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:26:34 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:26:34.625537 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-7dcbb307-e2db-4a92-93b1-ba00fd175102 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:26:34.626531 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-7dcbb307-e2db-4a92-93b1-ba00fd175102 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:26:34.632341 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7dcbb307-e2db-4a92-93b1-ba00fd175102 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:34.632780 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7dcbb307-e2db-4a92-93b1-ba00fd175102 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:34.633521 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7dcbb307-e2db-4a92-93b1-ba00fd175102 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:34.633943 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7dcbb307-e2db-4a92-93b1-ba00fd175102 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:34.661763 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-7dcbb307-e2db-4a92-93b1-ba00fd175102 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040563 Nov 01 01:26:34.662294 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 619/1184] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:26:34 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:26:35.257967 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-0a466dee-bc77-47bb-a333-9c354a09aa1b tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:26:35.258618 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-0a466dee-bc77-47bb-a333-9c354a09aa1b tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:26:35.264376 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0a466dee-bc77-47bb-a333-9c354a09aa1b tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:35.264820 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0a466dee-bc77-47bb-a333-9c354a09aa1b tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:35.265582 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0a466dee-bc77-47bb-a333-9c354a09aa1b tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:35.266017 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0a466dee-bc77-47bb-a333-9c354a09aa1b tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:35.387534 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-0a466dee-bc77-47bb-a333-9c354a09aa1b tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:26:35.394855 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-0a466dee-bc77-47bb-a333-9c354a09aa1b tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.140438 Nov 01 01:26:35.395404 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 566/1185] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:26:35 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:26:35.466897 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-00a43173-0d4e-498c-a60f-fee6cdabfa53 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:26:35.468009 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-00a43173-0d4e-498c-a60f-fee6cdabfa53 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:26:35.474136 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-00a43173-0d4e-498c-a60f-fee6cdabfa53 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:35.474614 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-00a43173-0d4e-498c-a60f-fee6cdabfa53 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:35.475372 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-00a43173-0d4e-498c-a60f-fee6cdabfa53 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:35.475799 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-00a43173-0d4e-498c-a60f-fee6cdabfa53 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:35.591708 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-00a43173-0d4e-498c-a60f-fee6cdabfa53 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:26:35.599542 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-00a43173-0d4e-498c-a60f-fee6cdabfa53 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.136343 Nov 01 01:26:35.600094 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 620/1186] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:26:35 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:26:35.672989 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-8f928213-b6ae-4b95-a479-89a70392d6ac tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:26:35.673908 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-8f928213-b6ae-4b95-a479-89a70392d6ac tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:26:35.679758 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8f928213-b6ae-4b95-a479-89a70392d6ac tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:35.680213 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8f928213-b6ae-4b95-a479-89a70392d6ac tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:35.680974 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8f928213-b6ae-4b95-a479-89a70392d6ac tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:35.681406 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8f928213-b6ae-4b95-a479-89a70392d6ac tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:35.710186 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-8f928213-b6ae-4b95-a479-89a70392d6ac tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040962 Nov 01 01:26:35.710762 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 567/1187] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:26:35 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:26:36.411950 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-75baee48-b561-4d5e-92d0-238b2324c8b9 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:26:36.413198 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-75baee48-b561-4d5e-92d0-238b2324c8b9 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:26:36.420077 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-75baee48-b561-4d5e-92d0-238b2324c8b9 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:36.421071 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-75baee48-b561-4d5e-92d0-238b2324c8b9 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:36.421834 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-75baee48-b561-4d5e-92d0-238b2324c8b9 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:36.422259 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-75baee48-b561-4d5e-92d0-238b2324c8b9 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:36.540823 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-75baee48-b561-4d5e-92d0-238b2324c8b9 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:26:36.548674 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-75baee48-b561-4d5e-92d0-238b2324c8b9 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.140505 Nov 01 01:26:36.549227 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 621/1188] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:26:36 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:26:36.616258 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-31a36502-75bd-41e8-9d33-391ffd87396b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:26:36.616800 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-31a36502-75bd-41e8-9d33-391ffd87396b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:26:36.622993 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-31a36502-75bd-41e8-9d33-391ffd87396b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:36.623438 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-31a36502-75bd-41e8-9d33-391ffd87396b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:36.624192 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-31a36502-75bd-41e8-9d33-391ffd87396b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:36.624622 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-31a36502-75bd-41e8-9d33-391ffd87396b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:36.721695 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-17ba72ec-07c4-4cfc-b46d-7ee3b6c9f0c0 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:26:36.722783 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-17ba72ec-07c4-4cfc-b46d-7ee3b6c9f0c0 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:26:36.728514 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-17ba72ec-07c4-4cfc-b46d-7ee3b6c9f0c0 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:36.728952 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-17ba72ec-07c4-4cfc-b46d-7ee3b6c9f0c0 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:36.729709 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-17ba72ec-07c4-4cfc-b46d-7ee3b6c9f0c0 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:36.730137 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-17ba72ec-07c4-4cfc-b46d-7ee3b6c9f0c0 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:36.747595 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-31a36502-75bd-41e8-9d33-391ffd87396b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:26:36.754818 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-31a36502-75bd-41e8-9d33-391ffd87396b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.142199 Nov 01 01:26:36.755380 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 568/1189] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:26:36 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:26:36.759521 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-17ba72ec-07c4-4cfc-b46d-7ee3b6c9f0c0 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042195 Nov 01 01:26:36.760057 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 622/1190] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:26:36 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 01 01:26:37.565362 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-685b2a33-9745-41a4-870f-48b72e7bf390 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:26:37.565961 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-685b2a33-9745-41a4-870f-48b72e7bf390 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:26:37.571859 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-685b2a33-9745-41a4-870f-48b72e7bf390 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:37.572294 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-685b2a33-9745-41a4-870f-48b72e7bf390 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:37.573036 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-685b2a33-9745-41a4-870f-48b72e7bf390 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:37.573453 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-685b2a33-9745-41a4-870f-48b72e7bf390 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:37.690298 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-685b2a33-9745-41a4-870f-48b72e7bf390 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:26:37.697650 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-685b2a33-9745-41a4-870f-48b72e7bf390 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.136448 Nov 01 01:26:37.698211 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 569/1191] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:26:37 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:26:37.770454 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-6d9d02d6-e255-4d62-99a1-a48913a5cd82 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:26:37.770872 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-1cc042ee-9e6d-42a2-a690-d4ce6e146e84 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:26:37.771337 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-6d9d02d6-e255-4d62-99a1-a48913a5cd82 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:26:37.771824 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-1cc042ee-9e6d-42a2-a690-d4ce6e146e84 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:26:37.776845 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-6d9d02d6-e255-4d62-99a1-a48913a5cd82 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:37.777289 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-6d9d02d6-e255-4d62-99a1-a48913a5cd82 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:37.777935 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1cc042ee-9e6d-42a2-a690-d4ce6e146e84 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:37.778071 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-6d9d02d6-e255-4d62-99a1-a48913a5cd82 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:37.778390 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1cc042ee-9e6d-42a2-a690-d4ce6e146e84 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:37.778530 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-6d9d02d6-e255-4d62-99a1-a48913a5cd82 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:37.779196 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1cc042ee-9e6d-42a2-a690-d4ce6e146e84 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:37.779633 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1cc042ee-9e6d-42a2-a690-d4ce6e146e84 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:37.808434 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-1cc042ee-9e6d-42a2-a690-d4ce6e146e84 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041294 Nov 01 01:26:37.809170 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 623/1192] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:26:37 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:26:37.894718 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-6d9d02d6-e255-4d62-99a1-a48913a5cd82 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:26:37.906489 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-6d9d02d6-e255-4d62-99a1-a48913a5cd82 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.139343 Nov 01 01:26:37.907183 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 570/1193] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:26:37 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:26:38.713963 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-3e84d640-6d03-4e29-a652-b53a0c465146 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:26:38.714599 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-3e84d640-6d03-4e29-a652-b53a0c465146 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:26:38.720957 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3e84d640-6d03-4e29-a652-b53a0c465146 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:38.721405 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3e84d640-6d03-4e29-a652-b53a0c465146 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:38.722168 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3e84d640-6d03-4e29-a652-b53a0c465146 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:38.722629 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3e84d640-6d03-4e29-a652-b53a0c465146 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:38.820442 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-bfc33876-b935-424a-9273-e69cae0c0699 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:26:38.821386 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-bfc33876-b935-424a-9273-e69cae0c0699 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:26:38.828191 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-bfc33876-b935-424a-9273-e69cae0c0699 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:38.828635 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-bfc33876-b935-424a-9273-e69cae0c0699 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:38.829403 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-bfc33876-b935-424a-9273-e69cae0c0699 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:38.829832 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-bfc33876-b935-424a-9273-e69cae0c0699 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:38.842029 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-3e84d640-6d03-4e29-a652-b53a0c465146 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:26:38.849300 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-3e84d640-6d03-4e29-a652-b53a0c465146 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.138937 Nov 01 01:26:38.850142 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 624/1194] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:26:38 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:26:38.858576 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-bfc33876-b935-424a-9273-e69cae0c0699 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041771 Nov 01 01:26:38.859122 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 571/1195] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:26:38 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 01 01:26:38.922940 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-5e92f7aa-0333-4c9a-b414-e44318e8936a tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:26:38.923546 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-5e92f7aa-0333-4c9a-b414-e44318e8936a tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:26:38.929229 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5e92f7aa-0333-4c9a-b414-e44318e8936a tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:38.929676 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5e92f7aa-0333-4c9a-b414-e44318e8936a tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:38.930446 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5e92f7aa-0333-4c9a-b414-e44318e8936a tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:38.930890 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5e92f7aa-0333-4c9a-b414-e44318e8936a tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:39.047653 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-5e92f7aa-0333-4c9a-b414-e44318e8936a tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:26:39.055205 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-5e92f7aa-0333-4c9a-b414-e44318e8936a tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.135848 Nov 01 01:26:39.055758 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 625/1196] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:26:38 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:26:39.866717 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-269b4fb3-a3b0-407a-98ed-d060c1c405c3 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:26:39.867329 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-269b4fb3-a3b0-407a-98ed-d060c1c405c3 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:26:39.868798 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-10c0be68-30a2-4116-aa88-52994312765d tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:26:39.869706 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-10c0be68-30a2-4116-aa88-52994312765d tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:26:39.874217 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-269b4fb3-a3b0-407a-98ed-d060c1c405c3 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:39.874690 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-269b4fb3-a3b0-407a-98ed-d060c1c405c3 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:39.875453 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-269b4fb3-a3b0-407a-98ed-d060c1c405c3 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:39.875876 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-269b4fb3-a3b0-407a-98ed-d060c1c405c3 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:39.876490 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-10c0be68-30a2-4116-aa88-52994312765d tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:39.876934 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-10c0be68-30a2-4116-aa88-52994312765d tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:39.877687 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-10c0be68-30a2-4116-aa88-52994312765d tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:39.878115 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-10c0be68-30a2-4116-aa88-52994312765d tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:39.905743 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-10c0be68-30a2-4116-aa88-52994312765d tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040702 Nov 01 01:26:39.906291 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 626/1197] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:26:39 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 01 01:26:39.993546 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-269b4fb3-a3b0-407a-98ed-d060c1c405c3 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:26:40.000710 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-269b4fb3-a3b0-407a-98ed-d060c1c405c3 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.137622 Nov 01 01:26:40.001270 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 572/1198] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:26:39 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:26:40.072548 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-7df0d523-919e-42ca-82e7-654c4015e9be tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:26:40.073273 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-7df0d523-919e-42ca-82e7-654c4015e9be tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:26:40.079102 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7df0d523-919e-42ca-82e7-654c4015e9be tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:40.079542 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7df0d523-919e-42ca-82e7-654c4015e9be tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:40.080294 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7df0d523-919e-42ca-82e7-654c4015e9be tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:40.080718 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7df0d523-919e-42ca-82e7-654c4015e9be tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:40.200131 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-7df0d523-919e-42ca-82e7-654c4015e9be tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:26:40.207356 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-7df0d523-919e-42ca-82e7-654c4015e9be tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.138433 Nov 01 01:26:40.207912 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 627/1199] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:26:40 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:26:40.917089 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-1015b1a8-3a24-4648-a930-d31f681021f8 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:26:40.918056 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-1015b1a8-3a24-4648-a930-d31f681021f8 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:26:40.924647 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-1015b1a8-3a24-4648-a930-d31f681021f8 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:40.925086 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-1015b1a8-3a24-4648-a930-d31f681021f8 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:40.925856 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-1015b1a8-3a24-4648-a930-d31f681021f8 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:40.926282 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-1015b1a8-3a24-4648-a930-d31f681021f8 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:40.955434 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-1015b1a8-3a24-4648-a930-d31f681021f8 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042183 Nov 01 01:26:40.955981 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 573/1200] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:26:40 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:26:41.017589 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-938c9731-06d4-4b16-9c98-771e8db051f6 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:26:41.018196 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-938c9731-06d4-4b16-9c98-771e8db051f6 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:26:41.024452 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-938c9731-06d4-4b16-9c98-771e8db051f6 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:41.026609 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-938c9731-06d4-4b16-9c98-771e8db051f6 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:41.026609 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-938c9731-06d4-4b16-9c98-771e8db051f6 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:41.026609 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-938c9731-06d4-4b16-9c98-771e8db051f6 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:41.152407 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-938c9731-06d4-4b16-9c98-771e8db051f6 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:26:41.159562 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-938c9731-06d4-4b16-9c98-771e8db051f6 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.146166 Nov 01 01:26:41.160118 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 628/1201] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:26:41 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:26:41.223762 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-e8177083-26c5-4f2f-aeea-54ec88dbbfc0 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:26:41.224374 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-e8177083-26c5-4f2f-aeea-54ec88dbbfc0 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:26:41.230114 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e8177083-26c5-4f2f-aeea-54ec88dbbfc0 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:41.230588 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e8177083-26c5-4f2f-aeea-54ec88dbbfc0 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:41.231342 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e8177083-26c5-4f2f-aeea-54ec88dbbfc0 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:41.232031 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e8177083-26c5-4f2f-aeea-54ec88dbbfc0 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:41.349617 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-e8177083-26c5-4f2f-aeea-54ec88dbbfc0 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:26:41.357439 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-e8177083-26c5-4f2f-aeea-54ec88dbbfc0 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.137220 Nov 01 01:26:41.358562 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 574/1202] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:26:41 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:26:41.966793 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-2ffa3234-6702-4848-8bc0-2df3fcab7ec0 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:26:41.967761 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-2ffa3234-6702-4848-8bc0-2df3fcab7ec0 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:26:41.973673 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2ffa3234-6702-4848-8bc0-2df3fcab7ec0 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:41.974118 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2ffa3234-6702-4848-8bc0-2df3fcab7ec0 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:41.974908 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2ffa3234-6702-4848-8bc0-2df3fcab7ec0 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:41.975338 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2ffa3234-6702-4848-8bc0-2df3fcab7ec0 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:42.004259 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-2ffa3234-6702-4848-8bc0-2df3fcab7ec0 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041239 Nov 01 01:26:42.004807 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 629/1203] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:26:41 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:26:42.177139 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-f6df451b-322c-4351-ac4e-5a2fbeb213f7 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:26:42.177793 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-f6df451b-322c-4351-ac4e-5a2fbeb213f7 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:26:42.183996 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f6df451b-322c-4351-ac4e-5a2fbeb213f7 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:42.184435 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f6df451b-322c-4351-ac4e-5a2fbeb213f7 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:42.185186 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f6df451b-322c-4351-ac4e-5a2fbeb213f7 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:42.186707 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f6df451b-322c-4351-ac4e-5a2fbeb213f7 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:42.315087 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-f6df451b-322c-4351-ac4e-5a2fbeb213f7 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:26:42.322266 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-f6df451b-322c-4351-ac4e-5a2fbeb213f7 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.149421 Nov 01 01:26:42.322918 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 575/1204] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:26:42 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:26:42.375050 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-c564ce31-9bb6-4eef-abd2-6850cfd73789 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:26:42.375646 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-c564ce31-9bb6-4eef-abd2-6850cfd73789 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:26:42.381778 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c564ce31-9bb6-4eef-abd2-6850cfd73789 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:42.382218 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c564ce31-9bb6-4eef-abd2-6850cfd73789 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:42.383014 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c564ce31-9bb6-4eef-abd2-6850cfd73789 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:42.383441 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c564ce31-9bb6-4eef-abd2-6850cfd73789 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:42.499630 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-c564ce31-9bb6-4eef-abd2-6850cfd73789 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:26:42.506733 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-c564ce31-9bb6-4eef-abd2-6850cfd73789 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.135293 Nov 01 01:26:42.507284 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 630/1205] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:26:42 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:26:43.016150 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-a5313626-8d22-4ce2-9cc3-cb33b9891afb tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:26:43.017088 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-a5313626-8d22-4ce2-9cc3-cb33b9891afb tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:26:43.022912 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a5313626-8d22-4ce2-9cc3-cb33b9891afb tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:43.023350 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a5313626-8d22-4ce2-9cc3-cb33b9891afb tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:43.024100 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a5313626-8d22-4ce2-9cc3-cb33b9891afb tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:43.024525 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a5313626-8d22-4ce2-9cc3-cb33b9891afb tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:43.052104 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-a5313626-8d22-4ce2-9cc3-cb33b9891afb tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040300 Nov 01 01:26:43.052639 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 576/1206] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:26:43 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:26:43.338880 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-229fed15-f1c4-4bef-887c-d38ab8e1a31d tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:26:43.339400 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-229fed15-f1c4-4bef-887c-d38ab8e1a31d tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:26:43.345365 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-229fed15-f1c4-4bef-887c-d38ab8e1a31d tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:43.345811 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-229fed15-f1c4-4bef-887c-d38ab8e1a31d tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:43.346608 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-229fed15-f1c4-4bef-887c-d38ab8e1a31d tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:43.347043 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-229fed15-f1c4-4bef-887c-d38ab8e1a31d tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:43.464449 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-229fed15-f1c4-4bef-887c-d38ab8e1a31d tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:26:43.471788 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-229fed15-f1c4-4bef-887c-d38ab8e1a31d tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.136568 Nov 01 01:26:43.472340 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 631/1207] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:26:43 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:26:43.523219 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-a75715f3-3aa9-4ae5-a1b6-1d778eba0bab tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:26:43.523826 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-a75715f3-3aa9-4ae5-a1b6-1d778eba0bab tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:26:43.529911 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a75715f3-3aa9-4ae5-a1b6-1d778eba0bab tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:43.530355 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a75715f3-3aa9-4ae5-a1b6-1d778eba0bab tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:43.531138 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a75715f3-3aa9-4ae5-a1b6-1d778eba0bab tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:43.531559 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a75715f3-3aa9-4ae5-a1b6-1d778eba0bab tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:43.655060 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-a75715f3-3aa9-4ae5-a1b6-1d778eba0bab tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:26:43.662357 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-a75715f3-3aa9-4ae5-a1b6-1d778eba0bab tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.142680 Nov 01 01:26:43.662940 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 577/1208] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:26:43 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:26:44.063622 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-573d24ee-cc76-492b-9742-1c5af886feb5 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:26:44.064601 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-573d24ee-cc76-492b-9742-1c5af886feb5 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:26:44.070376 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-573d24ee-cc76-492b-9742-1c5af886feb5 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:44.070879 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-573d24ee-cc76-492b-9742-1c5af886feb5 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:44.071675 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-573d24ee-cc76-492b-9742-1c5af886feb5 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:44.072104 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-573d24ee-cc76-492b-9742-1c5af886feb5 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:44.100609 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-573d24ee-cc76-492b-9742-1c5af886feb5 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041320 Nov 01 01:26:44.101144 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 632/1209] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:26:44 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:26:44.538704 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-dc506ec9-9561-4179-b57d-5ca06e18e8bf tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:26:44.539317 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-dc506ec9-9561-4179-b57d-5ca06e18e8bf tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:26:44.545739 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-dc506ec9-9561-4179-b57d-5ca06e18e8bf tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:44.546186 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-dc506ec9-9561-4179-b57d-5ca06e18e8bf tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:44.546977 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-dc506ec9-9561-4179-b57d-5ca06e18e8bf tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:44.547593 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-dc506ec9-9561-4179-b57d-5ca06e18e8bf tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:44.665979 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-dc506ec9-9561-4179-b57d-5ca06e18e8bf tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:26:44.673174 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-dc506ec9-9561-4179-b57d-5ca06e18e8bf tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.188393 Nov 01 01:26:44.673732 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 578/1210] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:26:44 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:26:44.678935 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-654445f2-792c-413f-8a6f-6b4e25e71233 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:26:44.679542 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-654445f2-792c-413f-8a6f-6b4e25e71233 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:26:44.685357 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-654445f2-792c-413f-8a6f-6b4e25e71233 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:44.686345 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-654445f2-792c-413f-8a6f-6b4e25e71233 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:44.687179 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-654445f2-792c-413f-8a6f-6b4e25e71233 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:44.687641 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-654445f2-792c-413f-8a6f-6b4e25e71233 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:44.803038 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-654445f2-792c-413f-8a6f-6b4e25e71233 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:26:44.810194 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-654445f2-792c-413f-8a6f-6b4e25e71233 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.134850 Nov 01 01:26:44.811282 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 633/1211] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:26:44 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:26:45.113054 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-6576a5cc-884f-4252-8a48-69c368ad42ed tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:26:45.114011 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-6576a5cc-884f-4252-8a48-69c368ad42ed tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:26:45.119861 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-6576a5cc-884f-4252-8a48-69c368ad42ed tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:45.120300 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-6576a5cc-884f-4252-8a48-69c368ad42ed tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:45.121048 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-6576a5cc-884f-4252-8a48-69c368ad42ed tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:45.121468 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-6576a5cc-884f-4252-8a48-69c368ad42ed tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:45.150174 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-6576a5cc-884f-4252-8a48-69c368ad42ed tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040904 Nov 01 01:26:45.150746 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 579/1212] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:26:45 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:26:45.689607 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-4be97b29-901c-4149-8923-2321eeae2189 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:26:45.690224 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-4be97b29-901c-4149-8923-2321eeae2189 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:26:45.696451 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4be97b29-901c-4149-8923-2321eeae2189 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:45.696897 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4be97b29-901c-4149-8923-2321eeae2189 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:45.697657 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4be97b29-901c-4149-8923-2321eeae2189 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:45.698088 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4be97b29-901c-4149-8923-2321eeae2189 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:45.817150 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-4be97b29-901c-4149-8923-2321eeae2189 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:26:45.824743 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-4be97b29-901c-4149-8923-2321eeae2189 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.138904 Nov 01 01:26:45.825309 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 634/1213] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:26:45 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:26:45.827621 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-a714d53f-3fdd-4dcc-a388-d2697f7d9e4b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:26:45.828221 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-a714d53f-3fdd-4dcc-a388-d2697f7d9e4b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:26:45.834331 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a714d53f-3fdd-4dcc-a388-d2697f7d9e4b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:45.834804 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a714d53f-3fdd-4dcc-a388-d2697f7d9e4b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:45.835587 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a714d53f-3fdd-4dcc-a388-d2697f7d9e4b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:45.836012 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a714d53f-3fdd-4dcc-a388-d2697f7d9e4b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:45.953619 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-a714d53f-3fdd-4dcc-a388-d2697f7d9e4b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:26:45.960879 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-a714d53f-3fdd-4dcc-a388-d2697f7d9e4b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.137318 Nov 01 01:26:45.961435 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 580/1214] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:26:45 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:26:46.161268 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-a68e3313-6324-4e97-8ccc-daae4c7207af tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:26:46.162177 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-a68e3313-6324-4e97-8ccc-daae4c7207af tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:26:46.167998 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a68e3313-6324-4e97-8ccc-daae4c7207af tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:46.168442 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a68e3313-6324-4e97-8ccc-daae4c7207af tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:46.169204 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a68e3313-6324-4e97-8ccc-daae4c7207af tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:46.169628 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a68e3313-6324-4e97-8ccc-daae4c7207af tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:46.197933 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-a68e3313-6324-4e97-8ccc-daae4c7207af tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040362 Nov 01 01:26:46.198493 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 635/1215] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:26:46 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:26:46.841073 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-f8b5d455-e13a-4aba-befb-0d62fd2aaaf7 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:26:46.841682 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-f8b5d455-e13a-4aba-befb-0d62fd2aaaf7 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:26:46.848557 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f8b5d455-e13a-4aba-befb-0d62fd2aaaf7 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:46.848983 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f8b5d455-e13a-4aba-befb-0d62fd2aaaf7 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:46.849739 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f8b5d455-e13a-4aba-befb-0d62fd2aaaf7 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:46.850165 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f8b5d455-e13a-4aba-befb-0d62fd2aaaf7 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:46.965598 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-f8b5d455-e13a-4aba-befb-0d62fd2aaaf7 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:26:46.973350 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-f8b5d455-e13a-4aba-befb-0d62fd2aaaf7 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.135946 Nov 01 01:26:46.973906 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 581/1216] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:26:46 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:26:46.977825 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-12b1dcaf-12f2-4553-8fa1-ce3d87b81088 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:26:46.978444 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-12b1dcaf-12f2-4553-8fa1-ce3d87b81088 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:26:46.985586 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-12b1dcaf-12f2-4553-8fa1-ce3d87b81088 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:46.986025 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-12b1dcaf-12f2-4553-8fa1-ce3d87b81088 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:46.986806 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-12b1dcaf-12f2-4553-8fa1-ce3d87b81088 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:46.987232 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-12b1dcaf-12f2-4553-8fa1-ce3d87b81088 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:47.111232 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-12b1dcaf-12f2-4553-8fa1-ce3d87b81088 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:26:47.118322 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-12b1dcaf-12f2-4553-8fa1-ce3d87b81088 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.144202 Nov 01 01:26:47.118900 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 636/1217] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:26:46 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:26:47.209775 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-392a2e93-0256-4929-92ec-e526e7747057 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:26:47.210802 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-392a2e93-0256-4929-92ec-e526e7747057 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:26:47.216607 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-392a2e93-0256-4929-92ec-e526e7747057 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:47.217693 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-392a2e93-0256-4929-92ec-e526e7747057 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:47.218476 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-392a2e93-0256-4929-92ec-e526e7747057 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:47.218913 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-392a2e93-0256-4929-92ec-e526e7747057 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:47.247374 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-392a2e93-0256-4929-92ec-e526e7747057 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041404 Nov 01 01:26:47.247924 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 582/1218] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:26:47 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:26:47.989509 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-0ad033af-d84c-4150-aac5-9baed93ce7a7 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:26:47.990108 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-0ad033af-d84c-4150-aac5-9baed93ce7a7 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:26:47.996330 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0ad033af-d84c-4150-aac5-9baed93ce7a7 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:47.996774 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0ad033af-d84c-4150-aac5-9baed93ce7a7 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:47.997533 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0ad033af-d84c-4150-aac5-9baed93ce7a7 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:47.997956 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0ad033af-d84c-4150-aac5-9baed93ce7a7 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:48.116032 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-0ad033af-d84c-4150-aac5-9baed93ce7a7 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:26:48.123852 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-0ad033af-d84c-4150-aac5-9baed93ce7a7 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.137424 Nov 01 01:26:48.124412 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 637/1219] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:26:47 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:26:48.135045 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-65661e10-58b3-481b-a55e-2a9d2fe75322 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:26:48.135665 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-65661e10-58b3-481b-a55e-2a9d2fe75322 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:26:48.141408 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-65661e10-58b3-481b-a55e-2a9d2fe75322 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:48.141856 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-65661e10-58b3-481b-a55e-2a9d2fe75322 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:48.142649 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-65661e10-58b3-481b-a55e-2a9d2fe75322 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:48.143082 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-65661e10-58b3-481b-a55e-2a9d2fe75322 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:48.258652 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-646e68e2-e721-4675-9bfc-3564eb600499 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:26:48.259358 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-65661e10-58b3-481b-a55e-2a9d2fe75322 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:26:48.259588 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-646e68e2-e721-4675-9bfc-3564eb600499 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:26:48.265373 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-646e68e2-e721-4675-9bfc-3564eb600499 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:48.265823 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-646e68e2-e721-4675-9bfc-3564eb600499 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:48.266628 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-646e68e2-e721-4675-9bfc-3564eb600499 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:48.266741 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-65661e10-58b3-481b-a55e-2a9d2fe75322 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.135309 Nov 01 01:26:48.267066 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-646e68e2-e721-4675-9bfc-3564eb600499 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:48.267287 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 583/1220] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:26:48 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:26:48.295983 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-646e68e2-e721-4675-9bfc-3564eb600499 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040421 Nov 01 01:26:48.296521 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 638/1221] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:26:48 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 01 01:26:49.140520 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-f4d107f6-ddc0-48e0-b6f5-0228960ab55e tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:26:49.141137 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-f4d107f6-ddc0-48e0-b6f5-0228960ab55e tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:26:49.146972 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f4d107f6-ddc0-48e0-b6f5-0228960ab55e tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:49.147416 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f4d107f6-ddc0-48e0-b6f5-0228960ab55e tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:49.148175 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f4d107f6-ddc0-48e0-b6f5-0228960ab55e tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:49.148605 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f4d107f6-ddc0-48e0-b6f5-0228960ab55e tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:49.274271 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-f4d107f6-ddc0-48e0-b6f5-0228960ab55e tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:26:49.281702 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-f4d107f6-ddc0-48e0-b6f5-0228960ab55e tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.145606 Nov 01 01:26:49.282245 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 584/1222] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:26:49 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:26:49.283397 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-c7f2a824-c2fe-4ce6-8d3d-f3aed06a2e72 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:26:49.284004 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-c7f2a824-c2fe-4ce6-8d3d-f3aed06a2e72 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:26:49.290163 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c7f2a824-c2fe-4ce6-8d3d-f3aed06a2e72 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:49.290646 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c7f2a824-c2fe-4ce6-8d3d-f3aed06a2e72 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:49.291423 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c7f2a824-c2fe-4ce6-8d3d-f3aed06a2e72 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:49.291830 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c7f2a824-c2fe-4ce6-8d3d-f3aed06a2e72 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:49.307409 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-e5fcf43a-5576-4efb-80e1-b65fbcd1a2b9 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:26:49.308374 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-e5fcf43a-5576-4efb-80e1-b65fbcd1a2b9 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:26:49.314822 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e5fcf43a-5576-4efb-80e1-b65fbcd1a2b9 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:49.315313 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e5fcf43a-5576-4efb-80e1-b65fbcd1a2b9 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:49.316089 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e5fcf43a-5576-4efb-80e1-b65fbcd1a2b9 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:49.316514 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e5fcf43a-5576-4efb-80e1-b65fbcd1a2b9 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:49.345854 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-e5fcf43a-5576-4efb-80e1-b65fbcd1a2b9 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042069 Nov 01 01:26:49.346415 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 585/1223] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:26:49 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:26:49.409853 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-c7f2a824-c2fe-4ce6-8d3d-f3aed06a2e72 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:26:49.417257 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-c7f2a824-c2fe-4ce6-8d3d-f3aed06a2e72 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.137606 Nov 01 01:26:49.417805 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 639/1224] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:26:49 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:26:50.297875 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-39c193b3-f6b5-4ef3-8fff-2365d6bdc934 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:26:50.298534 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-39c193b3-f6b5-4ef3-8fff-2365d6bdc934 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:26:50.304697 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-39c193b3-f6b5-4ef3-8fff-2365d6bdc934 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:50.305132 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-39c193b3-f6b5-4ef3-8fff-2365d6bdc934 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:50.305879 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-39c193b3-f6b5-4ef3-8fff-2365d6bdc934 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:50.306354 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-39c193b3-f6b5-4ef3-8fff-2365d6bdc934 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:50.357236 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-50fdae19-e079-4967-b03c-488e911feaab tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:26:50.358259 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-50fdae19-e079-4967-b03c-488e911feaab tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:26:50.364524 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-50fdae19-e079-4967-b03c-488e911feaab tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:50.365005 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-50fdae19-e079-4967-b03c-488e911feaab tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:50.365923 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-50fdae19-e079-4967-b03c-488e911feaab tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:50.366820 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-50fdae19-e079-4967-b03c-488e911feaab tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:50.395303 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-50fdae19-e079-4967-b03c-488e911feaab tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042001 Nov 01 01:26:50.395855 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 640/1225] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:26:50 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:26:50.424804 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-39c193b3-f6b5-4ef3-8fff-2365d6bdc934 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:26:50.432074 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-39c193b3-f6b5-4ef3-8fff-2365d6bdc934 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.137856 Nov 01 01:26:50.432623 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 586/1226] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:26:50 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:26:50.434270 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-dd2accdc-952e-4bd5-92e5-dc6aea5f8031 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:26:50.434978 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-dd2accdc-952e-4bd5-92e5-dc6aea5f8031 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:26:50.441235 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-dd2accdc-952e-4bd5-92e5-dc6aea5f8031 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:50.441669 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-dd2accdc-952e-4bd5-92e5-dc6aea5f8031 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:50.442416 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-dd2accdc-952e-4bd5-92e5-dc6aea5f8031 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:50.442864 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-dd2accdc-952e-4bd5-92e5-dc6aea5f8031 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:50.567467 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-dd2accdc-952e-4bd5-92e5-dc6aea5f8031 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:26:50.574580 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-dd2accdc-952e-4bd5-92e5-dc6aea5f8031 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.144011 Nov 01 01:26:50.575138 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 641/1227] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:26:50 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:26:51.408035 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-be6ce910-26c7-4a26-a5c3-4fe1bfd86305 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:26:51.408970 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-be6ce910-26c7-4a26-a5c3-4fe1bfd86305 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:26:51.416780 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-be6ce910-26c7-4a26-a5c3-4fe1bfd86305 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:51.417216 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-be6ce910-26c7-4a26-a5c3-4fe1bfd86305 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:51.422374 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-be6ce910-26c7-4a26-a5c3-4fe1bfd86305 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:51.422374 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-be6ce910-26c7-4a26-a5c3-4fe1bfd86305 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:51.449109 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-4437f17b-bc03-40f4-a740-b899da205200 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:26:51.449707 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-4437f17b-bc03-40f4-a740-b899da205200 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:26:51.449888 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-be6ce910-26c7-4a26-a5c3-4fe1bfd86305 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046908 Nov 01 01:26:51.450553 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 587/1228] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:26:51 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:26:51.457199 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4437f17b-bc03-40f4-a740-b899da205200 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:51.457639 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4437f17b-bc03-40f4-a740-b899da205200 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:51.458401 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4437f17b-bc03-40f4-a740-b899da205200 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:51.458850 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4437f17b-bc03-40f4-a740-b899da205200 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:51.580934 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-4437f17b-bc03-40f4-a740-b899da205200 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:26:51.588098 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-4437f17b-bc03-40f4-a740-b899da205200 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.142761 Nov 01 01:26:51.588646 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 642/1229] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:26:51 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:26:51.591943 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-75915637-fe5e-47bc-8cee-3e4ec22a2a53 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:26:51.592559 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-75915637-fe5e-47bc-8cee-3e4ec22a2a53 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:26:51.598441 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-75915637-fe5e-47bc-8cee-3e4ec22a2a53 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:51.598940 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-75915637-fe5e-47bc-8cee-3e4ec22a2a53 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:51.599725 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-75915637-fe5e-47bc-8cee-3e4ec22a2a53 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:51.600160 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-75915637-fe5e-47bc-8cee-3e4ec22a2a53 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:51.717562 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-75915637-fe5e-47bc-8cee-3e4ec22a2a53 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:26:51.725307 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-75915637-fe5e-47bc-8cee-3e4ec22a2a53 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.137377 Nov 01 01:26:51.725868 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 588/1230] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:26:51 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:26:52.462305 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-b981ff3c-bdfe-4edc-a4a5-7e8ac86a6023 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:26:52.463237 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-b981ff3c-bdfe-4edc-a4a5-7e8ac86a6023 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:26:52.470026 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b981ff3c-bdfe-4edc-a4a5-7e8ac86a6023 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:52.470501 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b981ff3c-bdfe-4edc-a4a5-7e8ac86a6023 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:52.471258 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b981ff3c-bdfe-4edc-a4a5-7e8ac86a6023 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:52.471683 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b981ff3c-bdfe-4edc-a4a5-7e8ac86a6023 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:52.499060 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-b981ff3c-bdfe-4edc-a4a5-7e8ac86a6023 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040498 Nov 01 01:26:52.499589 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 643/1231] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:26:52 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:26:52.604474 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-c38fbfe1-4a64-45c5-bc38-7bd7507365ee tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:26:52.605107 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-c38fbfe1-4a64-45c5-bc38-7bd7507365ee tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:26:52.611605 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c38fbfe1-4a64-45c5-bc38-7bd7507365ee tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:52.612044 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c38fbfe1-4a64-45c5-bc38-7bd7507365ee tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:52.612795 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c38fbfe1-4a64-45c5-bc38-7bd7507365ee tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:52.613218 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c38fbfe1-4a64-45c5-bc38-7bd7507365ee tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:52.732265 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-c38fbfe1-4a64-45c5-bc38-7bd7507365ee tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:26:52.739397 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-c38fbfe1-4a64-45c5-bc38-7bd7507365ee tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.138659 Nov 01 01:26:52.739956 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 589/1232] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:26:52 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:26:52.742533 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-e0128616-293f-4663-b9b8-050fb77253e6 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:26:52.743135 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-e0128616-293f-4663-b9b8-050fb77253e6 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:26:52.748761 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e0128616-293f-4663-b9b8-050fb77253e6 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:52.749699 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e0128616-293f-4663-b9b8-050fb77253e6 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:52.750474 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e0128616-293f-4663-b9b8-050fb77253e6 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:52.750898 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e0128616-293f-4663-b9b8-050fb77253e6 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:53.076783 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-e0128616-293f-4663-b9b8-050fb77253e6 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:26:53.084086 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-e0128616-293f-4663-b9b8-050fb77253e6 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.345129 Nov 01 01:26:53.084645 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 644/1233] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:26:52 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:26:53.510257 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-d3027cb1-6a46-4c0e-beb1-15880d40b74e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:26:53.511207 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-d3027cb1-6a46-4c0e-beb1-15880d40b74e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:26:53.517073 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d3027cb1-6a46-4c0e-beb1-15880d40b74e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:53.517517 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d3027cb1-6a46-4c0e-beb1-15880d40b74e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:53.518281 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d3027cb1-6a46-4c0e-beb1-15880d40b74e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:53.518742 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d3027cb1-6a46-4c0e-beb1-15880d40b74e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:53.554164 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-d3027cb1-6a46-4c0e-beb1-15880d40b74e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047606 Nov 01 01:26:53.554752 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 590/1234] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:26:53 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:26:53.755691 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-999d89ed-ef95-432a-aa30-985a554dc37f tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:26:53.756298 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-999d89ed-ef95-432a-aa30-985a554dc37f tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:26:53.762504 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-999d89ed-ef95-432a-aa30-985a554dc37f tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:53.762949 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-999d89ed-ef95-432a-aa30-985a554dc37f tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:53.763710 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-999d89ed-ef95-432a-aa30-985a554dc37f tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:53.764135 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-999d89ed-ef95-432a-aa30-985a554dc37f tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:53.879359 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-999d89ed-ef95-432a-aa30-985a554dc37f tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:26:53.886360 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-999d89ed-ef95-432a-aa30-985a554dc37f tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.134339 Nov 01 01:26:53.886943 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 645/1235] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:26:53 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:26:54.102469 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-9fef6697-0a92-4bdb-92e0-b24d1eace530 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:26:54.103084 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-9fef6697-0a92-4bdb-92e0-b24d1eace530 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:26:54.109592 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9fef6697-0a92-4bdb-92e0-b24d1eace530 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:54.110038 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9fef6697-0a92-4bdb-92e0-b24d1eace530 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:54.110867 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9fef6697-0a92-4bdb-92e0-b24d1eace530 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:54.111301 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9fef6697-0a92-4bdb-92e0-b24d1eace530 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:54.230585 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-9fef6697-0a92-4bdb-92e0-b24d1eace530 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:26:54.238086 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-9fef6697-0a92-4bdb-92e0-b24d1eace530 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.139299 Nov 01 01:26:54.238684 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 591/1236] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:26:54 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:26:54.566062 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-e9127987-b06b-464f-b1ba-20c8534f0b73 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:26:54.566989 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-e9127987-b06b-464f-b1ba-20c8534f0b73 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:26:54.572811 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e9127987-b06b-464f-b1ba-20c8534f0b73 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:54.573253 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e9127987-b06b-464f-b1ba-20c8534f0b73 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:54.573997 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e9127987-b06b-464f-b1ba-20c8534f0b73 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:54.574435 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e9127987-b06b-464f-b1ba-20c8534f0b73 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:54.601621 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-e9127987-b06b-464f-b1ba-20c8534f0b73 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039883 Nov 01 01:26:54.602146 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 646/1237] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:26:54 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:26:54.903174 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-830b2395-3863-4306-8827-6d385cd2c1f0 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:26:54.903810 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-830b2395-3863-4306-8827-6d385cd2c1f0 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:26:54.910215 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-830b2395-3863-4306-8827-6d385cd2c1f0 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:54.910691 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-830b2395-3863-4306-8827-6d385cd2c1f0 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:54.911470 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-830b2395-3863-4306-8827-6d385cd2c1f0 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:54.911893 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-830b2395-3863-4306-8827-6d385cd2c1f0 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:55.027256 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-830b2395-3863-4306-8827-6d385cd2c1f0 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:26:55.034251 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-830b2395-3863-4306-8827-6d385cd2c1f0 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.134748 Nov 01 01:26:55.038038 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 592/1238] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:26:54 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:26:55.254803 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-a288dab0-2e1d-4cd3-9065-55456d6838a2 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:26:55.255413 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-a288dab0-2e1d-4cd3-9065-55456d6838a2 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:26:55.261627 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a288dab0-2e1d-4cd3-9065-55456d6838a2 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:55.262071 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a288dab0-2e1d-4cd3-9065-55456d6838a2 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:55.262860 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a288dab0-2e1d-4cd3-9065-55456d6838a2 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:55.263289 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a288dab0-2e1d-4cd3-9065-55456d6838a2 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:55.380521 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-a288dab0-2e1d-4cd3-9065-55456d6838a2 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:26:55.387693 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-a288dab0-2e1d-4cd3-9065-55456d6838a2 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.136612 Nov 01 01:26:55.388243 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 647/1239] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:26:55 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:26:55.612857 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-c365ef18-5dce-4f60-9d08-253de042cd40 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:26:55.613695 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-c365ef18-5dce-4f60-9d08-253de042cd40 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:26:55.619943 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c365ef18-5dce-4f60-9d08-253de042cd40 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:55.620386 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c365ef18-5dce-4f60-9d08-253de042cd40 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:55.621141 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c365ef18-5dce-4f60-9d08-253de042cd40 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:55.621570 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c365ef18-5dce-4f60-9d08-253de042cd40 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:55.649760 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-c365ef18-5dce-4f60-9d08-253de042cd40 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040794 Nov 01 01:26:55.650302 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 593/1240] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:26:55 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:26:56.053081 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-85ebaee4-0b97-42b5-ac11-77d7e8ed1412 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:26:56.053691 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-85ebaee4-0b97-42b5-ac11-77d7e8ed1412 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:26:56.059586 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-85ebaee4-0b97-42b5-ac11-77d7e8ed1412 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:56.060038 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-85ebaee4-0b97-42b5-ac11-77d7e8ed1412 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:56.060801 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-85ebaee4-0b97-42b5-ac11-77d7e8ed1412 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:56.061236 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-85ebaee4-0b97-42b5-ac11-77d7e8ed1412 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:56.179180 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-85ebaee4-0b97-42b5-ac11-77d7e8ed1412 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:26:56.186196 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-85ebaee4-0b97-42b5-ac11-77d7e8ed1412 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.136798 Nov 01 01:26:56.187381 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 648/1241] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:26:56 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:26:56.404892 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-3d36dc4a-fb83-432d-b42a-da50acae228f tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:26:56.406010 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-3d36dc4a-fb83-432d-b42a-da50acae228f tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:26:56.412063 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3d36dc4a-fb83-432d-b42a-da50acae228f tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:56.412549 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3d36dc4a-fb83-432d-b42a-da50acae228f tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:56.413321 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3d36dc4a-fb83-432d-b42a-da50acae228f tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:56.413756 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3d36dc4a-fb83-432d-b42a-da50acae228f tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:56.529521 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-3d36dc4a-fb83-432d-b42a-da50acae228f tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:26:56.537384 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-3d36dc4a-fb83-432d-b42a-da50acae228f tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.136243 Nov 01 01:26:56.537942 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 594/1242] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:26:56 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:26:56.661099 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-ca965cfb-9f88-4102-a8cd-c4181be177f9 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:26:56.661923 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-ca965cfb-9f88-4102-a8cd-c4181be177f9 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:26:56.668196 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ca965cfb-9f88-4102-a8cd-c4181be177f9 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:56.668637 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ca965cfb-9f88-4102-a8cd-c4181be177f9 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:56.669383 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ca965cfb-9f88-4102-a8cd-c4181be177f9 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:56.669806 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ca965cfb-9f88-4102-a8cd-c4181be177f9 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:56.697681 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-ca965cfb-9f88-4102-a8cd-c4181be177f9 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040350 Nov 01 01:26:56.698215 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 649/1243] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:26:56 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:26:57.203460 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-e3600929-bac9-4caa-9d1b-c9950c0bb27b tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:26:57.204067 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-e3600929-bac9-4caa-9d1b-c9950c0bb27b tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:26:57.210620 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e3600929-bac9-4caa-9d1b-c9950c0bb27b tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:57.211095 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e3600929-bac9-4caa-9d1b-c9950c0bb27b tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:57.211854 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e3600929-bac9-4caa-9d1b-c9950c0bb27b tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:57.212282 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e3600929-bac9-4caa-9d1b-c9950c0bb27b tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:57.329705 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-e3600929-bac9-4caa-9d1b-c9950c0bb27b tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:26:57.337080 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-e3600929-bac9-4caa-9d1b-c9950c0bb27b tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.137271 Nov 01 01:26:57.337631 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 595/1244] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:26:57 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:26:57.554796 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-2ace15d2-435c-4435-8833-32fa1bd5885e tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:26:57.555330 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-2ace15d2-435c-4435-8833-32fa1bd5885e tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:26:57.561182 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2ace15d2-435c-4435-8833-32fa1bd5885e tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:57.561623 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2ace15d2-435c-4435-8833-32fa1bd5885e tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:57.562380 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2ace15d2-435c-4435-8833-32fa1bd5885e tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:57.562837 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2ace15d2-435c-4435-8833-32fa1bd5885e tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:57.682905 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-2ace15d2-435c-4435-8833-32fa1bd5885e tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:26:57.690193 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-2ace15d2-435c-4435-8833-32fa1bd5885e tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.139154 Nov 01 01:26:57.690784 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 650/1245] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:26:57 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:26:57.709077 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-23287fca-b177-468c-9c49-8ba23e771100 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:26:57.709979 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-23287fca-b177-468c-9c49-8ba23e771100 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:26:57.715672 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-23287fca-b177-468c-9c49-8ba23e771100 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:57.716108 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-23287fca-b177-468c-9c49-8ba23e771100 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:57.716857 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-23287fca-b177-468c-9c49-8ba23e771100 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:57.717281 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-23287fca-b177-468c-9c49-8ba23e771100 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:57.746270 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-23287fca-b177-468c-9c49-8ba23e771100 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040911 Nov 01 01:26:57.746831 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 596/1246] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:26:57 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:26:58.354362 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-bbecd85d-2097-4802-8a92-40a8d11bebcf tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:26:58.354919 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-bbecd85d-2097-4802-8a92-40a8d11bebcf tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:26:58.361347 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-bbecd85d-2097-4802-8a92-40a8d11bebcf tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:58.361792 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-bbecd85d-2097-4802-8a92-40a8d11bebcf tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:58.362589 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-bbecd85d-2097-4802-8a92-40a8d11bebcf tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:58.363045 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-bbecd85d-2097-4802-8a92-40a8d11bebcf tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:58.482977 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-bbecd85d-2097-4802-8a92-40a8d11bebcf tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:26:58.488463 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-bbecd85d-2097-4802-8a92-40a8d11bebcf tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.138023 Nov 01 01:26:58.489020 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 651/1247] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:26:58 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:26:58.706981 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-05800660-d251-412e-9d78-6c6c7802a8a3 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:26:58.707590 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-05800660-d251-412e-9d78-6c6c7802a8a3 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:26:58.713743 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-05800660-d251-412e-9d78-6c6c7802a8a3 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:58.714188 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-05800660-d251-412e-9d78-6c6c7802a8a3 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:58.714981 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-05800660-d251-412e-9d78-6c6c7802a8a3 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:58.715410 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-05800660-d251-412e-9d78-6c6c7802a8a3 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:58.756835 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-9ad6b432-b575-4b70-9549-f4d3aee6bc35 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:26:58.757743 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-9ad6b432-b575-4b70-9549-f4d3aee6bc35 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:26:58.763929 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9ad6b432-b575-4b70-9549-f4d3aee6bc35 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:58.764361 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9ad6b432-b575-4b70-9549-f4d3aee6bc35 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:58.765152 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9ad6b432-b575-4b70-9549-f4d3aee6bc35 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:58.765573 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9ad6b432-b575-4b70-9549-f4d3aee6bc35 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:58.794124 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-9ad6b432-b575-4b70-9549-f4d3aee6bc35 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040909 Nov 01 01:26:58.794715 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 652/1248] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:26:58 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 01 01:26:58.833722 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-05800660-d251-412e-9d78-6c6c7802a8a3 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:26:58.840991 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-05800660-d251-412e-9d78-6c6c7802a8a3 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.137763 Nov 01 01:26:58.841541 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 597/1249] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:26:58 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:26:59.504668 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-6891b333-95bf-4989-83b8-b4cca6962453 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:26:59.505263 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-6891b333-95bf-4989-83b8-b4cca6962453 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:26:59.511074 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6891b333-95bf-4989-83b8-b4cca6962453 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:59.511514 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6891b333-95bf-4989-83b8-b4cca6962453 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:59.512261 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6891b333-95bf-4989-83b8-b4cca6962453 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:59.512683 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6891b333-95bf-4989-83b8-b4cca6962453 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:59.631697 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-6891b333-95bf-4989-83b8-b4cca6962453 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:26:59.639290 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-6891b333-95bf-4989-83b8-b4cca6962453 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.138263 Nov 01 01:26:59.639848 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 653/1250] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:26:59 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:26:59.806086 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-94918a77-e881-4201-bf0b-3a3a55108f82 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:26:59.807028 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-94918a77-e881-4201-bf0b-3a3a55108f82 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:26:59.813813 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-94918a77-e881-4201-bf0b-3a3a55108f82 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:59.814246 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-94918a77-e881-4201-bf0b-3a3a55108f82 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:59.815036 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-94918a77-e881-4201-bf0b-3a3a55108f82 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:59.815460 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-94918a77-e881-4201-bf0b-3a3a55108f82 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:59.843154 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-94918a77-e881-4201-bf0b-3a3a55108f82 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041115 Nov 01 01:26:59.843949 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 598/1251] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:26:59 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:26:59.858727 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-fd4e1016-202a-4eaa-923c-36f899917aad tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:26:59.859848 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-fd4e1016-202a-4eaa-923c-36f899917aad tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:26:59.866025 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-fd4e1016-202a-4eaa-923c-36f899917aad tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:59.866511 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-fd4e1016-202a-4eaa-923c-36f899917aad tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:59.867282 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-fd4e1016-202a-4eaa-923c-36f899917aad tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:26:59.867715 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-fd4e1016-202a-4eaa-923c-36f899917aad tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:26:59.983552 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-fd4e1016-202a-4eaa-923c-36f899917aad tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:26:59.991386 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-fd4e1016-202a-4eaa-923c-36f899917aad tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.136579 Nov 01 01:26:59.991953 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 654/1252] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:26:59 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:27:00.656630 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-39856dea-910a-4a35-8050-20f7eadf2ea9 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:27:00.657171 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-39856dea-910a-4a35-8050-20f7eadf2ea9 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:27:00.663093 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-39856dea-910a-4a35-8050-20f7eadf2ea9 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:00.663535 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-39856dea-910a-4a35-8050-20f7eadf2ea9 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:00.664296 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-39856dea-910a-4a35-8050-20f7eadf2ea9 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:00.664724 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-39856dea-910a-4a35-8050-20f7eadf2ea9 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:00.784026 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-39856dea-910a-4a35-8050-20f7eadf2ea9 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:27:00.791327 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-39856dea-910a-4a35-8050-20f7eadf2ea9 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.139108 Nov 01 01:27:00.791879 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 599/1253] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:27:00 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:27:00.854376 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-082f1aa8-4fc5-42c7-8dcc-b552c5371229 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:27:00.855303 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-082f1aa8-4fc5-42c7-8dcc-b552c5371229 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:27:00.861272 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-082f1aa8-4fc5-42c7-8dcc-b552c5371229 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:00.861836 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-082f1aa8-4fc5-42c7-8dcc-b552c5371229 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:00.862458 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-082f1aa8-4fc5-42c7-8dcc-b552c5371229 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:00.862884 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-082f1aa8-4fc5-42c7-8dcc-b552c5371229 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:00.891481 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-082f1aa8-4fc5-42c7-8dcc-b552c5371229 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040783 Nov 01 01:27:00.892003 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 655/1254] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:27:00 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:27:01.009433 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-fa78fe6f-afb3-45d2-9cec-21fc76df34b5 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:27:01.010055 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-fa78fe6f-afb3-45d2-9cec-21fc76df34b5 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:27:01.017168 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-fa78fe6f-afb3-45d2-9cec-21fc76df34b5 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:01.017605 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-fa78fe6f-afb3-45d2-9cec-21fc76df34b5 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:01.018362 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-fa78fe6f-afb3-45d2-9cec-21fc76df34b5 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:01.018896 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-fa78fe6f-afb3-45d2-9cec-21fc76df34b5 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:01.148959 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-fa78fe6f-afb3-45d2-9cec-21fc76df34b5 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:27:01.156279 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-fa78fe6f-afb3-45d2-9cec-21fc76df34b5 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.151250 Nov 01 01:27:01.156839 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 600/1255] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:27:01 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:27:01.807709 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-c292f2a5-3918-4dde-90af-7cfff6bceb7e tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:27:01.808318 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-c292f2a5-3918-4dde-90af-7cfff6bceb7e tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:27:01.814164 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c292f2a5-3918-4dde-90af-7cfff6bceb7e tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:01.814650 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c292f2a5-3918-4dde-90af-7cfff6bceb7e tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:01.815413 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c292f2a5-3918-4dde-90af-7cfff6bceb7e tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:01.815845 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c292f2a5-3918-4dde-90af-7cfff6bceb7e tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:01.902307 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-90985245-6382-481e-9125-ec6fdd2c2fd4 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:27:01.903357 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-90985245-6382-481e-9125-ec6fdd2c2fd4 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:27:01.909744 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-90985245-6382-481e-9125-ec6fdd2c2fd4 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:01.910264 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-90985245-6382-481e-9125-ec6fdd2c2fd4 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:01.911178 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-90985245-6382-481e-9125-ec6fdd2c2fd4 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:01.911678 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-90985245-6382-481e-9125-ec6fdd2c2fd4 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:01.932917 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-c292f2a5-3918-4dde-90af-7cfff6bceb7e tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:27:01.940147 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-c292f2a5-3918-4dde-90af-7cfff6bceb7e tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.136056 Nov 01 01:27:01.940704 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 656/1256] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:27:01 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:27:01.940955 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-90985245-6382-481e-9125-ec6fdd2c2fd4 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042308 Nov 01 01:27:01.941509 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 601/1257] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:27:01 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 01 01:27:02.172711 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-e063d4cc-d48f-4883-bfd7-88afde5c30b7 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:27:02.173369 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-e063d4cc-d48f-4883-bfd7-88afde5c30b7 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:27:02.179215 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e063d4cc-d48f-4883-bfd7-88afde5c30b7 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:02.179660 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e063d4cc-d48f-4883-bfd7-88afde5c30b7 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:02.180466 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e063d4cc-d48f-4883-bfd7-88afde5c30b7 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:02.180846 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e063d4cc-d48f-4883-bfd7-88afde5c30b7 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:02.297881 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-e063d4cc-d48f-4883-bfd7-88afde5c30b7 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:27:02.305116 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-e063d4cc-d48f-4883-bfd7-88afde5c30b7 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.136036 Nov 01 01:27:02.305659 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 657/1258] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:27:02 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:27:02.951946 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-82fae1f0-1d38-4025-bcd0-8dfe0066931c tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:27:02.952862 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-82fae1f0-1d38-4025-bcd0-8dfe0066931c tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:27:02.956231 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-e4d56021-dbbf-46ec-8418-2aad37305d39 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:27:02.956841 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-e4d56021-dbbf-46ec-8418-2aad37305d39 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:27:02.959291 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-82fae1f0-1d38-4025-bcd0-8dfe0066931c tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:02.959743 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-82fae1f0-1d38-4025-bcd0-8dfe0066931c tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:02.960531 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-82fae1f0-1d38-4025-bcd0-8dfe0066931c tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:02.960948 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-82fae1f0-1d38-4025-bcd0-8dfe0066931c tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:02.963337 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e4d56021-dbbf-46ec-8418-2aad37305d39 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:02.963779 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e4d56021-dbbf-46ec-8418-2aad37305d39 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:02.964541 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e4d56021-dbbf-46ec-8418-2aad37305d39 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:02.964971 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e4d56021-dbbf-46ec-8418-2aad37305d39 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:02.990357 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-82fae1f0-1d38-4025-bcd0-8dfe0066931c tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042017 Nov 01 01:27:02.990865 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 602/1259] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:27:02 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:27:03.087463 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-e4d56021-dbbf-46ec-8418-2aad37305d39 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:27:03.095034 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-e4d56021-dbbf-46ec-8418-2aad37305d39 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.142372 Nov 01 01:27:03.095599 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 658/1260] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:27:02 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:27:03.321304 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-14d285ef-66be-4a93-a619-36c26cd92e0b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:27:03.321847 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-14d285ef-66be-4a93-a619-36c26cd92e0b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:27:03.327738 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-14d285ef-66be-4a93-a619-36c26cd92e0b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:03.328178 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-14d285ef-66be-4a93-a619-36c26cd92e0b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:03.328956 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-14d285ef-66be-4a93-a619-36c26cd92e0b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:03.329381 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-14d285ef-66be-4a93-a619-36c26cd92e0b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:03.448114 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-14d285ef-66be-4a93-a619-36c26cd92e0b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:27:03.455490 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-14d285ef-66be-4a93-a619-36c26cd92e0b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.137904 Nov 01 01:27:03.456045 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 603/1261] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:27:03 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:27:04.000996 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-dd39120b-df8d-4fa7-851e-17ef53b258ad tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:27:04.001957 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-dd39120b-df8d-4fa7-851e-17ef53b258ad tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:27:04.008155 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-dd39120b-df8d-4fa7-851e-17ef53b258ad tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:04.008598 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-dd39120b-df8d-4fa7-851e-17ef53b258ad tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:04.009353 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-dd39120b-df8d-4fa7-851e-17ef53b258ad tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:04.009782 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-dd39120b-df8d-4fa7-851e-17ef53b258ad tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:04.038122 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-dd39120b-df8d-4fa7-851e-17ef53b258ad tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040782 Nov 01 01:27:04.038708 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 659/1262] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:27:03 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 01 01:27:04.112452 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-d0ad15c8-06ec-4344-a874-766c0ee14183 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:27:04.113106 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-d0ad15c8-06ec-4344-a874-766c0ee14183 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:27:04.119392 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d0ad15c8-06ec-4344-a874-766c0ee14183 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:04.119839 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d0ad15c8-06ec-4344-a874-766c0ee14183 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:04.120603 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d0ad15c8-06ec-4344-a874-766c0ee14183 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:04.121041 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d0ad15c8-06ec-4344-a874-766c0ee14183 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:04.237666 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-d0ad15c8-06ec-4344-a874-766c0ee14183 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:27:04.244867 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-d0ad15c8-06ec-4344-a874-766c0ee14183 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.136778 Nov 01 01:27:04.245425 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 604/1263] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:27:04 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:27:04.472535 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-b6474a0a-bd3e-4986-8ff7-38f1bd2581e0 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:27:04.476888 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-b6474a0a-bd3e-4986-8ff7-38f1bd2581e0 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:27:04.479025 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b6474a0a-bd3e-4986-8ff7-38f1bd2581e0 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:04.479470 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b6474a0a-bd3e-4986-8ff7-38f1bd2581e0 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:04.480230 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b6474a0a-bd3e-4986-8ff7-38f1bd2581e0 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:04.480657 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b6474a0a-bd3e-4986-8ff7-38f1bd2581e0 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:04.603414 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-b6474a0a-bd3e-4986-8ff7-38f1bd2581e0 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:27:04.610927 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-b6474a0a-bd3e-4986-8ff7-38f1bd2581e0 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.142575 Nov 01 01:27:04.611493 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 660/1264] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:27:04 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:27:05.050009 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-99f4aafb-9813-45d8-961e-098ad9db1827 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:27:05.050970 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-99f4aafb-9813-45d8-961e-098ad9db1827 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:27:05.056806 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-99f4aafb-9813-45d8-961e-098ad9db1827 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:05.057249 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-99f4aafb-9813-45d8-961e-098ad9db1827 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:05.058073 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-99f4aafb-9813-45d8-961e-098ad9db1827 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:05.058531 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-99f4aafb-9813-45d8-961e-098ad9db1827 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:05.088034 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-99f4aafb-9813-45d8-961e-098ad9db1827 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042278 Nov 01 01:27:05.088576 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 605/1265] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:27:05 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:27:05.260923 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-04b9ff62-994a-4732-b0d3-d822d254a19a tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:27:05.261522 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-04b9ff62-994a-4732-b0d3-d822d254a19a tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:27:05.267774 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-04b9ff62-994a-4732-b0d3-d822d254a19a tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:05.268212 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-04b9ff62-994a-4732-b0d3-d822d254a19a tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:05.268965 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-04b9ff62-994a-4732-b0d3-d822d254a19a tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:05.269384 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-04b9ff62-994a-4732-b0d3-d822d254a19a tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:05.388302 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-04b9ff62-994a-4732-b0d3-d822d254a19a tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:27:05.395566 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-04b9ff62-994a-4732-b0d3-d822d254a19a tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.138365 Nov 01 01:27:05.396111 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 661/1266] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:27:05 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:27:05.627671 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-356bcc21-0362-41c5-9d01-e67e09c3193f tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:27:05.628209 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-356bcc21-0362-41c5-9d01-e67e09c3193f tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:27:05.634400 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-356bcc21-0362-41c5-9d01-e67e09c3193f tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:05.634871 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-356bcc21-0362-41c5-9d01-e67e09c3193f tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:05.635628 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-356bcc21-0362-41c5-9d01-e67e09c3193f tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:05.636051 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-356bcc21-0362-41c5-9d01-e67e09c3193f tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:05.753341 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-356bcc21-0362-41c5-9d01-e67e09c3193f tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:27:05.760611 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-356bcc21-0362-41c5-9d01-e67e09c3193f tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.136655 Nov 01 01:27:05.761173 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 606/1267] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:27:05 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:27:06.099775 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-d62b8419-d8b2-4500-a23f-bef6250c58a0 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:27:06.100678 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-d62b8419-d8b2-4500-a23f-bef6250c58a0 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:27:06.106775 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d62b8419-d8b2-4500-a23f-bef6250c58a0 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:06.107213 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d62b8419-d8b2-4500-a23f-bef6250c58a0 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:06.107959 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d62b8419-d8b2-4500-a23f-bef6250c58a0 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:06.108375 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d62b8419-d8b2-4500-a23f-bef6250c58a0 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:06.135896 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-d62b8419-d8b2-4500-a23f-bef6250c58a0 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039903 Nov 01 01:27:06.136422 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 662/1268] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:27:06 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:27:06.411927 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-4c701f92-87ec-465a-bcb1-967f9a4509ac tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:27:06.412538 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-4c701f92-87ec-465a-bcb1-967f9a4509ac tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:27:06.418332 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4c701f92-87ec-465a-bcb1-967f9a4509ac tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:06.418805 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4c701f92-87ec-465a-bcb1-967f9a4509ac tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:06.419563 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4c701f92-87ec-465a-bcb1-967f9a4509ac tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:06.419995 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4c701f92-87ec-465a-bcb1-967f9a4509ac tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:06.539522 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-4c701f92-87ec-465a-bcb1-967f9a4509ac tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:27:06.546725 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-4c701f92-87ec-465a-bcb1-967f9a4509ac tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.138579 Nov 01 01:27:06.547798 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 607/1269] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:27:06 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:27:06.776928 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-ab6af415-30b3-4b88-8911-58c3dd9f4bcf tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:27:06.777528 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-ab6af415-30b3-4b88-8911-58c3dd9f4bcf tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:27:06.783670 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ab6af415-30b3-4b88-8911-58c3dd9f4bcf tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:06.784107 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ab6af415-30b3-4b88-8911-58c3dd9f4bcf tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:06.784861 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ab6af415-30b3-4b88-8911-58c3dd9f4bcf tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:06.785280 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ab6af415-30b3-4b88-8911-58c3dd9f4bcf tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:06.902614 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-ab6af415-30b3-4b88-8911-58c3dd9f4bcf tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:27:06.910256 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-ab6af415-30b3-4b88-8911-58c3dd9f4bcf tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.137066 Nov 01 01:27:06.910853 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 663/1270] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:27:06 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:27:07.147654 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-0ef0fb0f-baad-4f80-9b73-441d4ce20994 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:27:07.148477 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-0ef0fb0f-baad-4f80-9b73-441d4ce20994 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:27:07.154968 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0ef0fb0f-baad-4f80-9b73-441d4ce20994 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:07.155411 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0ef0fb0f-baad-4f80-9b73-441d4ce20994 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:07.156169 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0ef0fb0f-baad-4f80-9b73-441d4ce20994 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:07.156594 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0ef0fb0f-baad-4f80-9b73-441d4ce20994 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:07.185962 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-0ef0fb0f-baad-4f80-9b73-441d4ce20994 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042135 Nov 01 01:27:07.186514 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 608/1271] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:27:07 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:27:07.563533 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-b7614b69-28a6-4498-b562-7768f5c48203 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:27:07.564139 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-b7614b69-28a6-4498-b562-7768f5c48203 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:27:07.570515 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b7614b69-28a6-4498-b562-7768f5c48203 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:07.570960 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b7614b69-28a6-4498-b562-7768f5c48203 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:07.571715 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b7614b69-28a6-4498-b562-7768f5c48203 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:07.572143 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b7614b69-28a6-4498-b562-7768f5c48203 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:07.688117 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-b7614b69-28a6-4498-b562-7768f5c48203 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:27:07.695929 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-b7614b69-28a6-4498-b562-7768f5c48203 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.135971 Nov 01 01:27:07.696484 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 664/1272] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:27:07 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:27:07.927409 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-5ec5bf98-1797-4578-a39d-2cbe3e6365ec tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:27:07.928135 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-5ec5bf98-1797-4578-a39d-2cbe3e6365ec tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:27:07.933968 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-5ec5bf98-1797-4578-a39d-2cbe3e6365ec tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:07.934550 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-5ec5bf98-1797-4578-a39d-2cbe3e6365ec tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:07.935223 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-5ec5bf98-1797-4578-a39d-2cbe3e6365ec tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:07.935657 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-5ec5bf98-1797-4578-a39d-2cbe3e6365ec tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:08.060899 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-5ec5bf98-1797-4578-a39d-2cbe3e6365ec tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:27:08.069433 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-5ec5bf98-1797-4578-a39d-2cbe3e6365ec tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.146150 Nov 01 01:27:08.070016 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 609/1273] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:27:07 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:27:08.197855 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-744430a1-50a1-408d-962a-e8bdee4bdb78 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:27:08.198717 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-744430a1-50a1-408d-962a-e8bdee4bdb78 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:27:08.204883 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-744430a1-50a1-408d-962a-e8bdee4bdb78 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:08.205327 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-744430a1-50a1-408d-962a-e8bdee4bdb78 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:08.206084 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-744430a1-50a1-408d-962a-e8bdee4bdb78 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:08.206579 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-744430a1-50a1-408d-962a-e8bdee4bdb78 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:08.234112 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-744430a1-50a1-408d-962a-e8bdee4bdb78 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040085 Nov 01 01:27:08.234672 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 665/1274] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:27:08 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:27:08.712933 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-c0df72b9-e0fe-4b5a-a20c-4ec880b62f49 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:27:08.713538 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-c0df72b9-e0fe-4b5a-a20c-4ec880b62f49 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:27:08.719905 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c0df72b9-e0fe-4b5a-a20c-4ec880b62f49 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:08.720345 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c0df72b9-e0fe-4b5a-a20c-4ec880b62f49 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:08.721095 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c0df72b9-e0fe-4b5a-a20c-4ec880b62f49 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:08.721528 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c0df72b9-e0fe-4b5a-a20c-4ec880b62f49 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:08.838794 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-c0df72b9-e0fe-4b5a-a20c-4ec880b62f49 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:27:08.845856 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-c0df72b9-e0fe-4b5a-a20c-4ec880b62f49 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.136619 Nov 01 01:27:08.846408 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 610/1275] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:27:08 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:27:09.086670 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-ec8171af-8be0-4c7f-ae9c-2ba8e0d73e37 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:27:09.087199 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-ec8171af-8be0-4c7f-ae9c-2ba8e0d73e37 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:27:09.092928 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ec8171af-8be0-4c7f-ae9c-2ba8e0d73e37 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:09.093376 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ec8171af-8be0-4c7f-ae9c-2ba8e0d73e37 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:09.094131 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ec8171af-8be0-4c7f-ae9c-2ba8e0d73e37 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:09.094588 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ec8171af-8be0-4c7f-ae9c-2ba8e0d73e37 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:09.211711 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-ec8171af-8be0-4c7f-ae9c-2ba8e0d73e37 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:27:09.218886 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-ec8171af-8be0-4c7f-ae9c-2ba8e0d73e37 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.135863 Nov 01 01:27:09.219442 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 666/1276] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:27:09 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:27:09.245707 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-b44b8578-d4b9-472d-9bee-b3bd27aee02e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:27:09.246683 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-b44b8578-d4b9-472d-9bee-b3bd27aee02e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:27:09.252402 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b44b8578-d4b9-472d-9bee-b3bd27aee02e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:09.252847 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b44b8578-d4b9-472d-9bee-b3bd27aee02e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:09.254105 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b44b8578-d4b9-472d-9bee-b3bd27aee02e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:09.254574 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b44b8578-d4b9-472d-9bee-b3bd27aee02e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:09.283073 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-b44b8578-d4b9-472d-9bee-b3bd27aee02e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041122 Nov 01 01:27:09.283606 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 611/1277] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:27:09 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:27:09.862269 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-2c104bea-908f-469d-bf2e-bd750bd1492e tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:27:09.862930 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-2c104bea-908f-469d-bf2e-bd750bd1492e tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:27:09.869423 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2c104bea-908f-469d-bf2e-bd750bd1492e tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:09.869873 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2c104bea-908f-469d-bf2e-bd750bd1492e tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:09.870675 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2c104bea-908f-469d-bf2e-bd750bd1492e tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:09.871115 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2c104bea-908f-469d-bf2e-bd750bd1492e tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:10.037892 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-2c104bea-908f-469d-bf2e-bd750bd1492e tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:27:10.042268 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-2c104bea-908f-469d-bf2e-bd750bd1492e tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.183656 Nov 01 01:27:10.042858 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 667/1278] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:27:09 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:27:10.235486 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-f4a7ab19-21dc-4ba1-aa70-a96e559439da tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:27:10.236088 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-f4a7ab19-21dc-4ba1-aa70-a96e559439da tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:27:10.242257 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f4a7ab19-21dc-4ba1-aa70-a96e559439da tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:10.242726 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f4a7ab19-21dc-4ba1-aa70-a96e559439da tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:10.243479 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f4a7ab19-21dc-4ba1-aa70-a96e559439da tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:10.243901 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f4a7ab19-21dc-4ba1-aa70-a96e559439da tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:10.293605 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-fa8f9ef7-9d3e-429a-85ec-1e7d3b013036 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:27:10.294560 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-fa8f9ef7-9d3e-429a-85ec-1e7d3b013036 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:27:10.300718 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-fa8f9ef7-9d3e-429a-85ec-1e7d3b013036 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:10.301160 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-fa8f9ef7-9d3e-429a-85ec-1e7d3b013036 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:10.301947 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-fa8f9ef7-9d3e-429a-85ec-1e7d3b013036 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:10.302380 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-fa8f9ef7-9d3e-429a-85ec-1e7d3b013036 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:10.330834 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-fa8f9ef7-9d3e-429a-85ec-1e7d3b013036 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040936 Nov 01 01:27:10.332649 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 668/1279] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:27:10 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 01 01:27:10.364653 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-f4a7ab19-21dc-4ba1-aa70-a96e559439da tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:27:10.371924 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-f4a7ab19-21dc-4ba1-aa70-a96e559439da tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.140025 Nov 01 01:27:10.372484 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 612/1280] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:27:10 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:27:11.058734 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-1111c6f1-b44d-4667-9669-32228cd8ee37 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:27:11.059354 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-1111c6f1-b44d-4667-9669-32228cd8ee37 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:27:11.065159 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1111c6f1-b44d-4667-9669-32228cd8ee37 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:11.067168 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1111c6f1-b44d-4667-9669-32228cd8ee37 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:11.067168 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1111c6f1-b44d-4667-9669-32228cd8ee37 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:11.067168 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1111c6f1-b44d-4667-9669-32228cd8ee37 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:11.187888 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-1111c6f1-b44d-4667-9669-32228cd8ee37 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:27:11.195596 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-1111c6f1-b44d-4667-9669-32228cd8ee37 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.140461 Nov 01 01:27:11.196154 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 669/1281] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:27:11 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:27:11.343476 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-639e8857-eb3f-40a6-ad81-a8f7f944c5f0 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:27:11.344306 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-639e8857-eb3f-40a6-ad81-a8f7f944c5f0 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:27:11.351677 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-639e8857-eb3f-40a6-ad81-a8f7f944c5f0 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:11.352122 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-639e8857-eb3f-40a6-ad81-a8f7f944c5f0 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:11.352890 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-639e8857-eb3f-40a6-ad81-a8f7f944c5f0 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:11.353311 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-639e8857-eb3f-40a6-ad81-a8f7f944c5f0 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:11.384337 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-639e8857-eb3f-40a6-ad81-a8f7f944c5f0 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044620 Nov 01 01:27:11.384876 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 613/1282] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:27:11 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 01 01:27:11.388999 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-66d096d9-173e-42a8-89f8-6b3f3d9fb1dc tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:27:11.389610 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-66d096d9-173e-42a8-89f8-6b3f3d9fb1dc tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:27:11.395865 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-66d096d9-173e-42a8-89f8-6b3f3d9fb1dc tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:11.396306 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-66d096d9-173e-42a8-89f8-6b3f3d9fb1dc tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:11.397065 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-66d096d9-173e-42a8-89f8-6b3f3d9fb1dc tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:11.397492 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-66d096d9-173e-42a8-89f8-6b3f3d9fb1dc tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:11.521430 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-66d096d9-173e-42a8-89f8-6b3f3d9fb1dc tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:27:11.528669 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-66d096d9-173e-42a8-89f8-6b3f3d9fb1dc tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.143504 Nov 01 01:27:11.529223 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 670/1283] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:27:11 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:27:12.212001 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-59eb2898-b823-4e17-8a7d-79b775f23012 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:27:12.212602 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-59eb2898-b823-4e17-8a7d-79b775f23012 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:27:12.218389 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-59eb2898-b823-4e17-8a7d-79b775f23012 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:12.218856 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-59eb2898-b823-4e17-8a7d-79b775f23012 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:12.219607 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-59eb2898-b823-4e17-8a7d-79b775f23012 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:12.220032 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-59eb2898-b823-4e17-8a7d-79b775f23012 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:12.337511 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-59eb2898-b823-4e17-8a7d-79b775f23012 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:27:12.344589 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-59eb2898-b823-4e17-8a7d-79b775f23012 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.136288 Nov 01 01:27:12.345161 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 614/1284] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:27:12 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:27:12.395424 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-f8393e0c-c8c6-4a62-8eff-623cb07f019c tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:27:12.396332 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-f8393e0c-c8c6-4a62-8eff-623cb07f019c tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:27:12.403162 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f8393e0c-c8c6-4a62-8eff-623cb07f019c tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:12.403609 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f8393e0c-c8c6-4a62-8eff-623cb07f019c tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:12.404364 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f8393e0c-c8c6-4a62-8eff-623cb07f019c tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:12.404788 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f8393e0c-c8c6-4a62-8eff-623cb07f019c tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:12.432612 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-f8393e0c-c8c6-4a62-8eff-623cb07f019c tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040938 Nov 01 01:27:12.433145 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 671/1285] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:27:12 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:27:12.544760 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-6b69392d-28e0-4163-9b9a-73f88c6a9b9e tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:27:12.545368 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-6b69392d-28e0-4163-9b9a-73f88c6a9b9e tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:27:12.551622 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-6b69392d-28e0-4163-9b9a-73f88c6a9b9e tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:12.552070 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-6b69392d-28e0-4163-9b9a-73f88c6a9b9e tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:12.552834 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-6b69392d-28e0-4163-9b9a-73f88c6a9b9e tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:12.553265 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-6b69392d-28e0-4163-9b9a-73f88c6a9b9e tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:12.674770 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-6b69392d-28e0-4163-9b9a-73f88c6a9b9e tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:27:12.682634 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-6b69392d-28e0-4163-9b9a-73f88c6a9b9e tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.141276 Nov 01 01:27:12.683198 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 615/1286] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:27:12 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:27:13.363074 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-bc0a0543-f273-439d-b2af-3aa42dcaf149 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:27:13.364041 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-bc0a0543-f273-439d-b2af-3aa42dcaf149 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:27:13.370810 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-bc0a0543-f273-439d-b2af-3aa42dcaf149 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:13.371264 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-bc0a0543-f273-439d-b2af-3aa42dcaf149 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:13.372031 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-bc0a0543-f273-439d-b2af-3aa42dcaf149 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:13.372464 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-bc0a0543-f273-439d-b2af-3aa42dcaf149 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:13.443964 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-8430f440-a959-4789-b3fa-421600f38e13 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:27:13.445512 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-8430f440-a959-4789-b3fa-421600f38e13 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:27:13.451316 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8430f440-a959-4789-b3fa-421600f38e13 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:13.451763 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8430f440-a959-4789-b3fa-421600f38e13 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:13.452515 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8430f440-a959-4789-b3fa-421600f38e13 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:13.452936 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8430f440-a959-4789-b3fa-421600f38e13 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:13.482280 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-8430f440-a959-4789-b3fa-421600f38e13 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041978 Nov 01 01:27:13.482869 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 616/1287] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:27:13 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 01 01:27:13.496343 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-bc0a0543-f273-439d-b2af-3aa42dcaf149 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:27:13.503469 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-bc0a0543-f273-439d-b2af-3aa42dcaf149 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.144034 Nov 01 01:27:13.504019 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 672/1288] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:27:13 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:27:13.699110 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-706efdc0-8ba6-4d8d-88f7-962b097d757c tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:27:13.699715 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-706efdc0-8ba6-4d8d-88f7-962b097d757c tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:27:13.705974 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-706efdc0-8ba6-4d8d-88f7-962b097d757c tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:13.706416 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-706efdc0-8ba6-4d8d-88f7-962b097d757c tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:13.707198 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-706efdc0-8ba6-4d8d-88f7-962b097d757c tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:13.707632 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-706efdc0-8ba6-4d8d-88f7-962b097d757c tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:13.823696 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-706efdc0-8ba6-4d8d-88f7-962b097d757c tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:27:13.830950 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-706efdc0-8ba6-4d8d-88f7-962b097d757c tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.135477 Nov 01 01:27:13.831510 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 617/1289] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:27:13 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:27:14.213752 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 01 01:27:14.213939 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: Mon Nov 1 01:27:14 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 01 01:27:14.493638 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-e18d5bf1-84d1-4f3e-9eb0-e691526ae3f5 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:27:14.494576 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-e18d5bf1-84d1-4f3e-9eb0-e691526ae3f5 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:27:14.500524 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e18d5bf1-84d1-4f3e-9eb0-e691526ae3f5 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:14.501099 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e18d5bf1-84d1-4f3e-9eb0-e691526ae3f5 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:14.501726 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e18d5bf1-84d1-4f3e-9eb0-e691526ae3f5 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:14.502167 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e18d5bf1-84d1-4f3e-9eb0-e691526ae3f5 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:14.519987 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-a19daebc-b907-495d-bc2f-7cb63c200e6a tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:27:14.520623 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-a19daebc-b907-495d-bc2f-7cb63c200e6a tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:27:14.526973 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a19daebc-b907-495d-bc2f-7cb63c200e6a tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:14.527416 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a19daebc-b907-495d-bc2f-7cb63c200e6a tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:14.528163 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a19daebc-b907-495d-bc2f-7cb63c200e6a tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:14.528587 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a19daebc-b907-495d-bc2f-7cb63c200e6a tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:14.531508 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-e18d5bf1-84d1-4f3e-9eb0-e691526ae3f5 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041704 Nov 01 01:27:14.532275 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 673/1290] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:27:14 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:27:14.646741 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-a19daebc-b907-495d-bc2f-7cb63c200e6a tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:27:14.653884 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-a19daebc-b907-495d-bc2f-7cb63c200e6a tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.137491 Nov 01 01:27:14.654463 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 618/1291] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:27:14 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:27:14.847562 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-d4341ef2-7e18-4478-9780-e28c323d7487 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:27:14.848166 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-d4341ef2-7e18-4478-9780-e28c323d7487 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:27:14.853980 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d4341ef2-7e18-4478-9780-e28c323d7487 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:14.854438 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d4341ef2-7e18-4478-9780-e28c323d7487 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:14.855201 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d4341ef2-7e18-4478-9780-e28c323d7487 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:14.855896 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d4341ef2-7e18-4478-9780-e28c323d7487 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:14.976161 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-d4341ef2-7e18-4478-9780-e28c323d7487 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:27:14.983662 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-d4341ef2-7e18-4478-9780-e28c323d7487 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.139777 Nov 01 01:27:14.984222 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 674/1292] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:27:14 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:27:15.543711 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-4f577fdd-c9b5-482c-ac80-1d9cb64f1fe8 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:27:15.544565 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-4f577fdd-c9b5-482c-ac80-1d9cb64f1fe8 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:27:15.550860 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4f577fdd-c9b5-482c-ac80-1d9cb64f1fe8 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:15.551307 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4f577fdd-c9b5-482c-ac80-1d9cb64f1fe8 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:15.552063 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4f577fdd-c9b5-482c-ac80-1d9cb64f1fe8 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:15.552491 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4f577fdd-c9b5-482c-ac80-1d9cb64f1fe8 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:15.579866 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-4f577fdd-c9b5-482c-ac80-1d9cb64f1fe8 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040059 Nov 01 01:27:15.580399 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 619/1293] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:27:15 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:27:15.671136 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-7eb9a672-5826-469c-8a45-da5d12f99be7 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:27:15.671742 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-7eb9a672-5826-469c-8a45-da5d12f99be7 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:27:15.677907 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7eb9a672-5826-469c-8a45-da5d12f99be7 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:15.678351 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7eb9a672-5826-469c-8a45-da5d12f99be7 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:15.679148 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7eb9a672-5826-469c-8a45-da5d12f99be7 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:15.679578 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7eb9a672-5826-469c-8a45-da5d12f99be7 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:15.804485 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-7eb9a672-5826-469c-8a45-da5d12f99be7 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:27:15.811609 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-7eb9a672-5826-469c-8a45-da5d12f99be7 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.144085 Nov 01 01:27:15.812184 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 675/1294] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:27:15 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:27:16.000598 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-dab9d834-0068-46e1-9550-fa0270c0f996 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:27:16.001229 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-dab9d834-0068-46e1-9550-fa0270c0f996 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:27:16.006973 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-dab9d834-0068-46e1-9550-fa0270c0f996 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:16.007409 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-dab9d834-0068-46e1-9550-fa0270c0f996 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:16.008693 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-dab9d834-0068-46e1-9550-fa0270c0f996 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:16.009119 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-dab9d834-0068-46e1-9550-fa0270c0f996 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:16.131902 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-dab9d834-0068-46e1-9550-fa0270c0f996 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:27:16.139740 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-dab9d834-0068-46e1-9550-fa0270c0f996 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.142747 Nov 01 01:27:16.140287 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 620/1295] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:27:15 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:27:16.590288 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-06148c54-623a-4901-a858-8c4a32cd5eb9 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:27:16.591156 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-06148c54-623a-4901-a858-8c4a32cd5eb9 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:27:16.598564 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-06148c54-623a-4901-a858-8c4a32cd5eb9 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:16.599014 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-06148c54-623a-4901-a858-8c4a32cd5eb9 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:16.600150 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-06148c54-623a-4901-a858-8c4a32cd5eb9 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:16.600370 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-06148c54-623a-4901-a858-8c4a32cd5eb9 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:16.629593 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-06148c54-623a-4901-a858-8c4a32cd5eb9 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043118 Nov 01 01:27:16.630073 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 676/1296] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:27:16 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:27:16.828340 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-881ed5e3-7409-4e11-bd9c-29f159c89074 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:27:16.828941 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-881ed5e3-7409-4e11-bd9c-29f159c89074 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:27:16.835397 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-881ed5e3-7409-4e11-bd9c-29f159c89074 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:16.835849 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-881ed5e3-7409-4e11-bd9c-29f159c89074 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:16.837214 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-881ed5e3-7409-4e11-bd9c-29f159c89074 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:16.837644 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-881ed5e3-7409-4e11-bd9c-29f159c89074 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:16.958730 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-881ed5e3-7409-4e11-bd9c-29f159c89074 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:27:16.966376 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-881ed5e3-7409-4e11-bd9c-29f159c89074 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.141705 Nov 01 01:27:16.966963 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 621/1297] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:27:16 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:27:17.156824 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-eb679a2f-bde6-4c65-bdfc-3d376b7b4fb5 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:27:17.157422 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-eb679a2f-bde6-4c65-bdfc-3d376b7b4fb5 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:27:17.163687 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-eb679a2f-bde6-4c65-bdfc-3d376b7b4fb5 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:17.164127 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-eb679a2f-bde6-4c65-bdfc-3d376b7b4fb5 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:17.165464 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-eb679a2f-bde6-4c65-bdfc-3d376b7b4fb5 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:17.165952 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-eb679a2f-bde6-4c65-bdfc-3d376b7b4fb5 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:17.282767 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-eb679a2f-bde6-4c65-bdfc-3d376b7b4fb5 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:27:17.289932 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-eb679a2f-bde6-4c65-bdfc-3d376b7b4fb5 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.136762 Nov 01 01:27:17.290503 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 677/1298] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:27:17 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:27:17.641002 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-64d02c41-99b9-41ac-9063-c64016515709 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:27:17.641907 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-64d02c41-99b9-41ac-9063-c64016515709 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:27:17.647832 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-64d02c41-99b9-41ac-9063-c64016515709 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:17.648270 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-64d02c41-99b9-41ac-9063-c64016515709 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:17.649016 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-64d02c41-99b9-41ac-9063-c64016515709 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:17.649436 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-64d02c41-99b9-41ac-9063-c64016515709 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:17.677008 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-64d02c41-99b9-41ac-9063-c64016515709 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039763 Nov 01 01:27:17.677534 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 622/1299] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:27:17 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:27:17.983041 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-13ea1635-1c56-496a-bf89-f332be3bc60c tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:27:17.983781 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-13ea1635-1c56-496a-bf89-f332be3bc60c tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:27:17.989573 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-13ea1635-1c56-496a-bf89-f332be3bc60c tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:17.993117 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-13ea1635-1c56-496a-bf89-f332be3bc60c tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:17.993117 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-13ea1635-1c56-496a-bf89-f332be3bc60c tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:17.993117 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-13ea1635-1c56-496a-bf89-f332be3bc60c tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:18.115751 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-13ea1635-1c56-496a-bf89-f332be3bc60c tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:27:18.123614 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-13ea1635-1c56-496a-bf89-f332be3bc60c tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.144603 Nov 01 01:27:18.124184 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 678/1300] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:27:17 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:27:18.307050 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-5ee687c9-8708-47e6-8c35-6998fc6eb734 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:27:18.307705 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-5ee687c9-8708-47e6-8c35-6998fc6eb734 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:27:18.313798 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-5ee687c9-8708-47e6-8c35-6998fc6eb734 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:18.314242 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-5ee687c9-8708-47e6-8c35-6998fc6eb734 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:18.315052 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-5ee687c9-8708-47e6-8c35-6998fc6eb734 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:18.315480 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-5ee687c9-8708-47e6-8c35-6998fc6eb734 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:18.457162 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-5ee687c9-8708-47e6-8c35-6998fc6eb734 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:27:18.462006 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-5ee687c9-8708-47e6-8c35-6998fc6eb734 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.159321 Nov 01 01:27:18.462596 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 623/1301] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:27:18 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:27:18.688925 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-c3f92447-b9f9-4ae4-a74f-c97aa6504b16 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:27:18.692273 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-c3f92447-b9f9-4ae4-a74f-c97aa6504b16 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:27:18.696613 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c3f92447-b9f9-4ae4-a74f-c97aa6504b16 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:18.697061 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c3f92447-b9f9-4ae4-a74f-c97aa6504b16 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:18.697822 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c3f92447-b9f9-4ae4-a74f-c97aa6504b16 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:18.698252 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c3f92447-b9f9-4ae4-a74f-c97aa6504b16 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:18.731290 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-c3f92447-b9f9-4ae4-a74f-c97aa6504b16 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046038 Nov 01 01:27:18.731840 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 679/1302] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:27:18 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:27:19.139808 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-0bd7b35b-6344-4b8d-b699-6a7abd408e00 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:27:19.140338 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-0bd7b35b-6344-4b8d-b699-6a7abd408e00 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:27:19.146698 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0bd7b35b-6344-4b8d-b699-6a7abd408e00 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:19.147159 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0bd7b35b-6344-4b8d-b699-6a7abd408e00 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:19.147904 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0bd7b35b-6344-4b8d-b699-6a7abd408e00 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:19.148330 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0bd7b35b-6344-4b8d-b699-6a7abd408e00 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:19.266151 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-0bd7b35b-6344-4b8d-b699-6a7abd408e00 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:27:19.273470 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-0bd7b35b-6344-4b8d-b699-6a7abd408e00 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.137478 Nov 01 01:27:19.274062 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 624/1303] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:27:19 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:27:19.479146 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-76d3526c-19a9-4d85-a1da-acc40546ba30 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:27:19.479749 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-76d3526c-19a9-4d85-a1da-acc40546ba30 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:27:19.485759 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-76d3526c-19a9-4d85-a1da-acc40546ba30 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:19.486196 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-76d3526c-19a9-4d85-a1da-acc40546ba30 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:19.486984 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-76d3526c-19a9-4d85-a1da-acc40546ba30 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:19.487409 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-76d3526c-19a9-4d85-a1da-acc40546ba30 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:19.602377 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-76d3526c-19a9-4d85-a1da-acc40546ba30 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:27:19.609891 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-76d3526c-19a9-4d85-a1da-acc40546ba30 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.134825 Nov 01 01:27:19.610485 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 680/1304] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:27:19 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:27:19.742735 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-ea0c2b24-47da-489a-b2df-a64324269473 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:27:19.743600 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-ea0c2b24-47da-489a-b2df-a64324269473 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:27:19.751068 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ea0c2b24-47da-489a-b2df-a64324269473 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:19.751522 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ea0c2b24-47da-489a-b2df-a64324269473 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:19.752982 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ea0c2b24-47da-489a-b2df-a64324269473 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:19.753419 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ea0c2b24-47da-489a-b2df-a64324269473 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:19.783442 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-ea0c2b24-47da-489a-b2df-a64324269473 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044531 Nov 01 01:27:19.783998 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 625/1305] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:27:19 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:27:19.984580 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 01 01:27:19.985188 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: Mon Nov 1 01:27:19 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 01 01:27:20.290280 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-666ad2db-1765-4b25-88eb-da63316a2c89 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:27:20.290921 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-666ad2db-1765-4b25-88eb-da63316a2c89 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:27:20.297125 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-666ad2db-1765-4b25-88eb-da63316a2c89 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:20.297564 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-666ad2db-1765-4b25-88eb-da63316a2c89 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:20.298372 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-666ad2db-1765-4b25-88eb-da63316a2c89 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:20.298771 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-666ad2db-1765-4b25-88eb-da63316a2c89 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:20.421582 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-666ad2db-1765-4b25-88eb-da63316a2c89 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:27:20.428759 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-666ad2db-1765-4b25-88eb-da63316a2c89 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.142659 Nov 01 01:27:20.429306 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 681/1306] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:27:20 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:27:20.626983 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-4166cd9b-2347-4c66-baeb-aa06877cb8fc tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:27:20.627592 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-4166cd9b-2347-4c66-baeb-aa06877cb8fc tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:27:20.633958 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4166cd9b-2347-4c66-baeb-aa06877cb8fc tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:20.634389 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4166cd9b-2347-4c66-baeb-aa06877cb8fc tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:20.635181 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4166cd9b-2347-4c66-baeb-aa06877cb8fc tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:20.635611 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4166cd9b-2347-4c66-baeb-aa06877cb8fc tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:20.761892 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-4166cd9b-2347-4c66-baeb-aa06877cb8fc tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:27:20.769376 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-4166cd9b-2347-4c66-baeb-aa06877cb8fc tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.146076 Nov 01 01:27:20.769940 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 626/1307] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:27:20 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:27:20.795345 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-385cad85-601c-48ed-9cc7-9c65c2c25732 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:27:20.796262 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-385cad85-601c-48ed-9cc7-9c65c2c25732 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:27:20.801905 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-385cad85-601c-48ed-9cc7-9c65c2c25732 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:20.803978 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-385cad85-601c-48ed-9cc7-9c65c2c25732 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:20.803978 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-385cad85-601c-48ed-9cc7-9c65c2c25732 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:20.803978 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-385cad85-601c-48ed-9cc7-9c65c2c25732 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:20.831051 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-385cad85-601c-48ed-9cc7-9c65c2c25732 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039461 Nov 01 01:27:20.831588 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 682/1308] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:27:20 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:27:21.445967 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-0970659c-fd46-4b9b-bf10-62692dccb2a4 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:27:21.446666 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-0970659c-fd46-4b9b-bf10-62692dccb2a4 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:27:21.453252 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0970659c-fd46-4b9b-bf10-62692dccb2a4 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:21.453694 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0970659c-fd46-4b9b-bf10-62692dccb2a4 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:21.454469 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0970659c-fd46-4b9b-bf10-62692dccb2a4 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:21.454902 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0970659c-fd46-4b9b-bf10-62692dccb2a4 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:21.614716 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-0970659c-fd46-4b9b-bf10-62692dccb2a4 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:27:21.622387 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-0970659c-fd46-4b9b-bf10-62692dccb2a4 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.180088 Nov 01 01:27:21.622915 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 627/1309] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:27:21 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:27:21.786400 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-7d66ffe2-8ea5-49a3-82d4-08e9e8596b49 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:27:21.787059 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-7d66ffe2-8ea5-49a3-82d4-08e9e8596b49 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:27:21.793712 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7d66ffe2-8ea5-49a3-82d4-08e9e8596b49 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:21.794156 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7d66ffe2-8ea5-49a3-82d4-08e9e8596b49 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:21.794964 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7d66ffe2-8ea5-49a3-82d4-08e9e8596b49 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:21.795394 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7d66ffe2-8ea5-49a3-82d4-08e9e8596b49 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:21.842334 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-7fc183ba-9738-4d54-9792-2099705bccda tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:27:21.843268 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-7fc183ba-9738-4d54-9792-2099705bccda tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:27:21.849446 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-7fc183ba-9738-4d54-9792-2099705bccda tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:21.849886 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-7fc183ba-9738-4d54-9792-2099705bccda tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:21.850677 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-7fc183ba-9738-4d54-9792-2099705bccda tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:21.851108 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-7fc183ba-9738-4d54-9792-2099705bccda tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:21.881810 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-7fc183ba-9738-4d54-9792-2099705bccda tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043173 Nov 01 01:27:21.882369 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 628/1310] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:27:21 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 01 01:27:21.918750 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-7d66ffe2-8ea5-49a3-82d4-08e9e8596b49 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:27:21.926047 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-7d66ffe2-8ea5-49a3-82d4-08e9e8596b49 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.143308 Nov 01 01:27:21.926623 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 683/1311] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:27:21 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:27:22.639416 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-e61972f9-febd-41cd-b992-8d19feebf82b tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:27:22.639943 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-e61972f9-febd-41cd-b992-8d19feebf82b tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:27:22.645717 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e61972f9-febd-41cd-b992-8d19feebf82b tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:22.646160 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e61972f9-febd-41cd-b992-8d19feebf82b tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:22.646939 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e61972f9-febd-41cd-b992-8d19feebf82b tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:22.647366 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e61972f9-febd-41cd-b992-8d19feebf82b tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:22.765219 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-e61972f9-febd-41cd-b992-8d19feebf82b tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:27:22.772451 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-e61972f9-febd-41cd-b992-8d19feebf82b tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.137297 Nov 01 01:27:22.773008 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 629/1312] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:27:22 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:27:22.892895 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-1b4db9f3-d68e-436a-93a6-ae34f72a227e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:27:22.893766 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-1b4db9f3-d68e-436a-93a6-ae34f72a227e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:27:22.899937 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1b4db9f3-d68e-436a-93a6-ae34f72a227e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:22.900386 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1b4db9f3-d68e-436a-93a6-ae34f72a227e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:22.901163 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1b4db9f3-d68e-436a-93a6-ae34f72a227e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:22.901620 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1b4db9f3-d68e-436a-93a6-ae34f72a227e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:22.928960 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-1b4db9f3-d68e-436a-93a6-ae34f72a227e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039852 Nov 01 01:27:22.929914 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 684/1313] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:27:22 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:27:22.943102 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-d7849ca1-584a-4e49-85ed-0f9e43c9bc44 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:27:22.943706 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-d7849ca1-584a-4e49-85ed-0f9e43c9bc44 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:27:22.950499 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d7849ca1-584a-4e49-85ed-0f9e43c9bc44 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:22.950953 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d7849ca1-584a-4e49-85ed-0f9e43c9bc44 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:22.951708 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d7849ca1-584a-4e49-85ed-0f9e43c9bc44 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:22.952142 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d7849ca1-584a-4e49-85ed-0f9e43c9bc44 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:23.068921 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-d7849ca1-584a-4e49-85ed-0f9e43c9bc44 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:27:23.077122 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-d7849ca1-584a-4e49-85ed-0f9e43c9bc44 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.137645 Nov 01 01:27:23.077689 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 630/1314] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:27:22 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:27:23.788881 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-13c20b34-4ac7-4436-8e1c-38e07e069528 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:27:23.789578 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-13c20b34-4ac7-4436-8e1c-38e07e069528 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:27:23.795894 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-13c20b34-4ac7-4436-8e1c-38e07e069528 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:23.796339 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-13c20b34-4ac7-4436-8e1c-38e07e069528 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:23.797094 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-13c20b34-4ac7-4436-8e1c-38e07e069528 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:23.797523 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-13c20b34-4ac7-4436-8e1c-38e07e069528 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:23.916326 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-13c20b34-4ac7-4436-8e1c-38e07e069528 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:27:23.923491 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-13c20b34-4ac7-4436-8e1c-38e07e069528 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.138296 Nov 01 01:27:23.924047 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 685/1315] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:27:23 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:27:23.940570 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-1f53765c-9b3b-474f-b41b-8bafb8cc57b3 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:27:23.941479 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-1f53765c-9b3b-474f-b41b-8bafb8cc57b3 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:27:23.947660 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-1f53765c-9b3b-474f-b41b-8bafb8cc57b3 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:23.954317 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-1f53765c-9b3b-474f-b41b-8bafb8cc57b3 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:23.954317 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-1f53765c-9b3b-474f-b41b-8bafb8cc57b3 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:23.954317 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-1f53765c-9b3b-474f-b41b-8bafb8cc57b3 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:23.978747 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-1f53765c-9b3b-474f-b41b-8bafb8cc57b3 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041858 Nov 01 01:27:23.979316 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 631/1316] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:27:23 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 01 01:27:24.093408 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-5da3aa74-fa93-4fdb-8060-cc189ace568a tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:27:24.094047 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-5da3aa74-fa93-4fdb-8060-cc189ace568a tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:27:24.100232 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5da3aa74-fa93-4fdb-8060-cc189ace568a tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:24.100675 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5da3aa74-fa93-4fdb-8060-cc189ace568a tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:24.101431 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5da3aa74-fa93-4fdb-8060-cc189ace568a tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:24.101855 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5da3aa74-fa93-4fdb-8060-cc189ace568a tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:24.219245 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-5da3aa74-fa93-4fdb-8060-cc189ace568a tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:27:24.226401 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-5da3aa74-fa93-4fdb-8060-cc189ace568a tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.136719 Nov 01 01:27:24.226989 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 686/1317] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:27:24 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:27:24.940391 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-509bda94-1d29-41cb-8870-996267894fe9 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:27:24.940993 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-509bda94-1d29-41cb-8870-996267894fe9 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:27:24.946812 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-509bda94-1d29-41cb-8870-996267894fe9 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:24.947251 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-509bda94-1d29-41cb-8870-996267894fe9 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:24.948004 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-509bda94-1d29-41cb-8870-996267894fe9 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:24.948430 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-509bda94-1d29-41cb-8870-996267894fe9 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:24.989344 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-9d893d1b-6c91-4887-b4fd-ce5a3f4bece8 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:27:24.990258 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-9d893d1b-6c91-4887-b4fd-ce5a3f4bece8 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:27:24.996428 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9d893d1b-6c91-4887-b4fd-ce5a3f4bece8 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:24.996874 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9d893d1b-6c91-4887-b4fd-ce5a3f4bece8 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:24.997636 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9d893d1b-6c91-4887-b4fd-ce5a3f4bece8 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:24.998063 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9d893d1b-6c91-4887-b4fd-ce5a3f4bece8 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:25.036534 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-9d893d1b-6c91-4887-b4fd-ce5a3f4bece8 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040988 Nov 01 01:27:25.036534 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 687/1318] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:27:24 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 01 01:27:25.067320 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-509bda94-1d29-41cb-8870-996267894fe9 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:27:25.074472 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-509bda94-1d29-41cb-8870-996267894fe9 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.137677 Nov 01 01:27:25.075021 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 632/1319] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:27:24 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:27:25.242620 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-bf1b7495-720f-4a55-8e50-0941a7b32204 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:27:25.243144 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-bf1b7495-720f-4a55-8e50-0941a7b32204 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:27:25.249376 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-bf1b7495-720f-4a55-8e50-0941a7b32204 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:25.249818 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-bf1b7495-720f-4a55-8e50-0941a7b32204 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:25.250623 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-bf1b7495-720f-4a55-8e50-0941a7b32204 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:25.251043 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-bf1b7495-720f-4a55-8e50-0941a7b32204 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:25.372208 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-bf1b7495-720f-4a55-8e50-0941a7b32204 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:27:25.379489 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-bf1b7495-720f-4a55-8e50-0941a7b32204 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.140693 Nov 01 01:27:25.380040 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 688/1320] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:27:25 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:27:26.044999 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-4df381f0-e0c8-419a-a13b-a1723d46a011 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:27:26.045905 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-4df381f0-e0c8-419a-a13b-a1723d46a011 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:27:26.052745 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4df381f0-e0c8-419a-a13b-a1723d46a011 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:26.053187 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4df381f0-e0c8-419a-a13b-a1723d46a011 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:26.053943 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4df381f0-e0c8-419a-a13b-a1723d46a011 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:26.054368 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4df381f0-e0c8-419a-a13b-a1723d46a011 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:26.082883 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-4df381f0-e0c8-419a-a13b-a1723d46a011 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041654 Nov 01 01:27:26.083439 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 633/1321] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:27:26 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:27:26.091663 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-ab857212-9848-447d-8ef7-a683c95986d2 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:27:26.092277 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-ab857212-9848-447d-8ef7-a683c95986d2 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:27:26.098547 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ab857212-9848-447d-8ef7-a683c95986d2 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:26.098996 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ab857212-9848-447d-8ef7-a683c95986d2 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:26.099793 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ab857212-9848-447d-8ef7-a683c95986d2 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:26.100303 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ab857212-9848-447d-8ef7-a683c95986d2 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:26.216930 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-ab857212-9848-447d-8ef7-a683c95986d2 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:27:26.224011 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-ab857212-9848-447d-8ef7-a683c95986d2 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.136607 Nov 01 01:27:26.224565 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 689/1322] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:27:26 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:27:26.396832 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-dd1f44fb-5884-4a2b-b744-6904204e1ea1 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:27:26.397448 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-dd1f44fb-5884-4a2b-b744-6904204e1ea1 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:27:26.404000 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-dd1f44fb-5884-4a2b-b744-6904204e1ea1 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:26.404442 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-dd1f44fb-5884-4a2b-b744-6904204e1ea1 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:26.405202 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-dd1f44fb-5884-4a2b-b744-6904204e1ea1 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:26.405650 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-dd1f44fb-5884-4a2b-b744-6904204e1ea1 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:26.522133 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-dd1f44fb-5884-4a2b-b744-6904204e1ea1 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:27:26.529545 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-dd1f44fb-5884-4a2b-b744-6904204e1ea1 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.136381 Nov 01 01:27:26.530106 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 634/1323] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:27:26 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:27:27.094383 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-e29a2099-defe-4270-aa64-272641805657 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:27:27.095315 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-e29a2099-defe-4270-aa64-272641805657 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:27:27.101452 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e29a2099-defe-4270-aa64-272641805657 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:27.101887 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e29a2099-defe-4270-aa64-272641805657 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:27.102672 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e29a2099-defe-4270-aa64-272641805657 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:27.103098 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e29a2099-defe-4270-aa64-272641805657 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:27.131772 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-e29a2099-defe-4270-aa64-272641805657 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041148 Nov 01 01:27:27.132305 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 690/1324] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:27:27 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:27:27.240984 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-2c9c94fd-d090-492f-a8ee-ca6e9083994a tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:27:27.241588 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-2c9c94fd-d090-492f-a8ee-ca6e9083994a tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:27:27.248019 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-2c9c94fd-d090-492f-a8ee-ca6e9083994a tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:27.248456 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-2c9c94fd-d090-492f-a8ee-ca6e9083994a tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:27.249200 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-2c9c94fd-d090-492f-a8ee-ca6e9083994a tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:27.249623 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-2c9c94fd-d090-492f-a8ee-ca6e9083994a tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:27.370678 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-2c9c94fd-d090-492f-a8ee-ca6e9083994a tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:27:27.377847 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-2c9c94fd-d090-492f-a8ee-ca6e9083994a tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.140934 Nov 01 01:27:27.378408 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 635/1325] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:27:27 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:27:27.546038 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-f5c8f9d6-e3f9-4d73-8490-00125b035697 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:27:27.546688 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-f5c8f9d6-e3f9-4d73-8490-00125b035697 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:27:27.552387 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f5c8f9d6-e3f9-4d73-8490-00125b035697 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:27.552833 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f5c8f9d6-e3f9-4d73-8490-00125b035697 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:27.553584 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f5c8f9d6-e3f9-4d73-8490-00125b035697 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:27.554014 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f5c8f9d6-e3f9-4d73-8490-00125b035697 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:27.670604 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-f5c8f9d6-e3f9-4d73-8490-00125b035697 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:27:27.677724 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-f5c8f9d6-e3f9-4d73-8490-00125b035697 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.135897 Nov 01 01:27:27.678278 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 691/1326] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:27:27 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:27:28.142822 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-666b34f3-188f-4e6a-804b-e58e3d60d241 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:27:28.143740 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-666b34f3-188f-4e6a-804b-e58e3d60d241 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:27:28.149859 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-666b34f3-188f-4e6a-804b-e58e3d60d241 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:28.150304 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-666b34f3-188f-4e6a-804b-e58e3d60d241 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:28.151106 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-666b34f3-188f-4e6a-804b-e58e3d60d241 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:28.151535 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-666b34f3-188f-4e6a-804b-e58e3d60d241 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:28.179309 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-666b34f3-188f-4e6a-804b-e58e3d60d241 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040248 Nov 01 01:27:28.179845 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 636/1327] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:27:28 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:27:28.394709 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-a868591b-957f-44e4-8aac-be95128bbf8d tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:27:28.395638 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-a868591b-957f-44e4-8aac-be95128bbf8d tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:27:28.406021 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a868591b-957f-44e4-8aac-be95128bbf8d tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:28.406493 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a868591b-957f-44e4-8aac-be95128bbf8d tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:28.410988 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a868591b-957f-44e4-8aac-be95128bbf8d tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:28.410988 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a868591b-957f-44e4-8aac-be95128bbf8d tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:28.527262 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-a868591b-957f-44e4-8aac-be95128bbf8d tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:27:28.534512 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-a868591b-957f-44e4-8aac-be95128bbf8d tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.143780 Nov 01 01:27:28.535077 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 692/1328] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:27:28 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:27:28.693434 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-7fb93768-98f2-4fa7-96e9-13690c5ca668 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:27:28.694036 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-7fb93768-98f2-4fa7-96e9-13690c5ca668 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:27:28.700437 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-7fb93768-98f2-4fa7-96e9-13690c5ca668 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:28.700880 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-7fb93768-98f2-4fa7-96e9-13690c5ca668 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:28.701637 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-7fb93768-98f2-4fa7-96e9-13690c5ca668 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:28.702061 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-7fb93768-98f2-4fa7-96e9-13690c5ca668 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:28.823776 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-7fb93768-98f2-4fa7-96e9-13690c5ca668 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:27:28.831134 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-7fb93768-98f2-4fa7-96e9-13690c5ca668 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.141334 Nov 01 01:27:28.831684 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 637/1329] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:27:28 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:27:29.190870 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-542b9166-19ca-4238-8349-a1eba731fa23 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:27:29.191784 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-542b9166-19ca-4238-8349-a1eba731fa23 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:27:29.197611 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-542b9166-19ca-4238-8349-a1eba731fa23 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:29.198056 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-542b9166-19ca-4238-8349-a1eba731fa23 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:29.198837 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-542b9166-19ca-4238-8349-a1eba731fa23 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:29.199286 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-542b9166-19ca-4238-8349-a1eba731fa23 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:29.228397 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-542b9166-19ca-4238-8349-a1eba731fa23 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041265 Nov 01 01:27:29.228934 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 693/1330] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:27:29 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:27:29.551298 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-02626740-a231-40b5-b3b1-626614705779 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:27:29.551831 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-02626740-a231-40b5-b3b1-626614705779 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:27:29.557719 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-02626740-a231-40b5-b3b1-626614705779 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:29.558189 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-02626740-a231-40b5-b3b1-626614705779 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:29.558968 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-02626740-a231-40b5-b3b1-626614705779 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:29.559421 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-02626740-a231-40b5-b3b1-626614705779 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:29.677100 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-02626740-a231-40b5-b3b1-626614705779 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:27:29.684537 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-02626740-a231-40b5-b3b1-626614705779 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.137076 Nov 01 01:27:29.685597 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 638/1331] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:27:29 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:27:29.847817 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-12410d20-d594-449d-ae6f-372efeb0d356 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:27:29.848331 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-12410d20-d594-449d-ae6f-372efeb0d356 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:27:29.854614 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-12410d20-d594-449d-ae6f-372efeb0d356 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:29.855314 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-12410d20-d594-449d-ae6f-372efeb0d356 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:29.856085 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-12410d20-d594-449d-ae6f-372efeb0d356 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:29.856516 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-12410d20-d594-449d-ae6f-372efeb0d356 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:29.974998 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-12410d20-d594-449d-ae6f-372efeb0d356 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:27:29.983168 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-12410d20-d594-449d-ae6f-372efeb0d356 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.139088 Nov 01 01:27:29.983731 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 694/1332] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:27:29 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:27:30.239824 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-4e110a40-9d47-4305-a11e-056d036f9ae9 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:27:30.240771 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-4e110a40-9d47-4305-a11e-056d036f9ae9 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:27:30.247059 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4e110a40-9d47-4305-a11e-056d036f9ae9 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:30.247504 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4e110a40-9d47-4305-a11e-056d036f9ae9 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:30.248268 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4e110a40-9d47-4305-a11e-056d036f9ae9 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:30.248699 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4e110a40-9d47-4305-a11e-056d036f9ae9 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:30.276696 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-4e110a40-9d47-4305-a11e-056d036f9ae9 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040637 Nov 01 01:27:30.277226 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 639/1333] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:27:30 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:27:30.701912 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-456e66b4-2b00-4a0f-9e03-0508b449ffe3 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:27:30.702540 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-456e66b4-2b00-4a0f-9e03-0508b449ffe3 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:27:30.708437 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-456e66b4-2b00-4a0f-9e03-0508b449ffe3 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:30.708877 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-456e66b4-2b00-4a0f-9e03-0508b449ffe3 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:30.709662 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-456e66b4-2b00-4a0f-9e03-0508b449ffe3 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:30.710085 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-456e66b4-2b00-4a0f-9e03-0508b449ffe3 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:30.830072 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-456e66b4-2b00-4a0f-9e03-0508b449ffe3 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:27:30.837263 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-456e66b4-2b00-4a0f-9e03-0508b449ffe3 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.139615 Nov 01 01:27:30.837810 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 695/1334] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:27:30 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:27:31.000206 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-79e81f4e-10f3-4562-9bb8-86cc56f9543a tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:27:31.000744 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-79e81f4e-10f3-4562-9bb8-86cc56f9543a tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:27:31.006599 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-79e81f4e-10f3-4562-9bb8-86cc56f9543a tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:31.007047 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-79e81f4e-10f3-4562-9bb8-86cc56f9543a tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:31.007803 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-79e81f4e-10f3-4562-9bb8-86cc56f9543a tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:31.008232 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-79e81f4e-10f3-4562-9bb8-86cc56f9543a tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:31.126320 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-79e81f4e-10f3-4562-9bb8-86cc56f9543a tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:27:31.133676 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-79e81f4e-10f3-4562-9bb8-86cc56f9543a tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.137692 Nov 01 01:27:31.134234 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 640/1335] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:27:30 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:27:31.288529 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-c67d35a6-73f6-4a63-932e-9938b99294ae tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:27:31.289387 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-c67d35a6-73f6-4a63-932e-9938b99294ae tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:27:31.296176 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c67d35a6-73f6-4a63-932e-9938b99294ae tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:31.296617 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c67d35a6-73f6-4a63-932e-9938b99294ae tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:31.297376 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c67d35a6-73f6-4a63-932e-9938b99294ae tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:31.297803 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c67d35a6-73f6-4a63-932e-9938b99294ae tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:31.326066 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-c67d35a6-73f6-4a63-932e-9938b99294ae tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041397 Nov 01 01:27:31.326681 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 696/1336] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:27:31 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:27:31.854349 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-f998a05b-150d-4215-a0b3-be4c421384f4 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:27:31.855271 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-f998a05b-150d-4215-a0b3-be4c421384f4 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:27:31.862201 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f998a05b-150d-4215-a0b3-be4c421384f4 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:31.862696 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f998a05b-150d-4215-a0b3-be4c421384f4 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:31.863468 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f998a05b-150d-4215-a0b3-be4c421384f4 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:31.863902 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f998a05b-150d-4215-a0b3-be4c421384f4 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:31.980991 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-f998a05b-150d-4215-a0b3-be4c421384f4 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:27:31.988751 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-f998a05b-150d-4215-a0b3-be4c421384f4 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.138097 Nov 01 01:27:31.989310 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 641/1337] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:27:31 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:27:32.151168 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-f4b45e34-6618-4232-aee8-3aeadad3f0cd tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:27:32.151725 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-f4b45e34-6618-4232-aee8-3aeadad3f0cd tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:27:32.157640 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f4b45e34-6618-4232-aee8-3aeadad3f0cd tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:32.158079 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f4b45e34-6618-4232-aee8-3aeadad3f0cd tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:32.158868 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f4b45e34-6618-4232-aee8-3aeadad3f0cd tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:32.159291 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f4b45e34-6618-4232-aee8-3aeadad3f0cd tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:32.278478 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-f4b45e34-6618-4232-aee8-3aeadad3f0cd tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:27:32.285650 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-f4b45e34-6618-4232-aee8-3aeadad3f0cd tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.138483 Nov 01 01:27:32.286199 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 697/1338] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:27:32 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:27:32.336655 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-db4a3f53-78b5-4a4c-8b4a-835b69cd2512 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:27:32.337572 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-db4a3f53-78b5-4a4c-8b4a-835b69cd2512 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:27:32.343431 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-db4a3f53-78b5-4a4c-8b4a-835b69cd2512 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:32.343824 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-db4a3f53-78b5-4a4c-8b4a-835b69cd2512 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:32.344588 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-db4a3f53-78b5-4a4c-8b4a-835b69cd2512 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:32.345018 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-db4a3f53-78b5-4a4c-8b4a-835b69cd2512 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:32.374685 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-db4a3f53-78b5-4a4c-8b4a-835b69cd2512 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041687 Nov 01 01:27:32.375232 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 642/1339] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:27:32 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:27:33.004879 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-00b44eaf-2936-4762-a58c-ad11132fe869 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:27:33.005428 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-00b44eaf-2936-4762-a58c-ad11132fe869 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:27:33.011703 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-00b44eaf-2936-4762-a58c-ad11132fe869 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:33.012146 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-00b44eaf-2936-4762-a58c-ad11132fe869 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:33.012915 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-00b44eaf-2936-4762-a58c-ad11132fe869 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:33.013345 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-00b44eaf-2936-4762-a58c-ad11132fe869 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:33.131274 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-00b44eaf-2936-4762-a58c-ad11132fe869 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:27:33.138342 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-00b44eaf-2936-4762-a58c-ad11132fe869 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.137245 Nov 01 01:27:33.138922 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 698/1340] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:27:33 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:27:33.302212 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-e468ecc4-f2e0-4179-9572-b3b00ff0c9cc tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:27:33.302764 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-e468ecc4-f2e0-4179-9572-b3b00ff0c9cc tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:27:33.309035 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e468ecc4-f2e0-4179-9572-b3b00ff0c9cc tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:33.309471 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e468ecc4-f2e0-4179-9572-b3b00ff0c9cc tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:33.310222 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e468ecc4-f2e0-4179-9572-b3b00ff0c9cc tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:33.310679 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e468ecc4-f2e0-4179-9572-b3b00ff0c9cc tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:33.385006 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-28841983-c0bb-4fc9-8102-0c23dfffe6d7 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:27:33.385919 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-28841983-c0bb-4fc9-8102-0c23dfffe6d7 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:27:33.392202 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-28841983-c0bb-4fc9-8102-0c23dfffe6d7 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:33.392651 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-28841983-c0bb-4fc9-8102-0c23dfffe6d7 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:33.393415 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-28841983-c0bb-4fc9-8102-0c23dfffe6d7 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:33.393851 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-28841983-c0bb-4fc9-8102-0c23dfffe6d7 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:33.422295 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-28841983-c0bb-4fc9-8102-0c23dfffe6d7 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041011 Nov 01 01:27:33.422885 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 699/1341] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:27:33 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 01 01:27:33.431017 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-e468ecc4-f2e0-4179-9572-b3b00ff0c9cc tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:27:33.438830 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-e468ecc4-f2e0-4179-9572-b3b00ff0c9cc tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.140332 Nov 01 01:27:33.439455 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 643/1342] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:27:33 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:27:34.155932 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-fe9ebba5-2c20-444f-8ceb-5eba426cab6e tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:27:34.156541 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-fe9ebba5-2c20-444f-8ceb-5eba426cab6e tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:27:34.162891 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-fe9ebba5-2c20-444f-8ceb-5eba426cab6e tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:34.163334 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-fe9ebba5-2c20-444f-8ceb-5eba426cab6e tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:34.164090 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-fe9ebba5-2c20-444f-8ceb-5eba426cab6e tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:34.164543 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-fe9ebba5-2c20-444f-8ceb-5eba426cab6e tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:34.285078 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-fe9ebba5-2c20-444f-8ceb-5eba426cab6e tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:27:34.292306 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-fe9ebba5-2c20-444f-8ceb-5eba426cab6e tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.140546 Nov 01 01:27:34.292855 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 700/1343] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:27:34 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:27:34.432901 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-fab839f3-ff8c-4b3e-a867-f68507b21bc3 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:27:34.433816 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-fab839f3-ff8c-4b3e-a867-f68507b21bc3 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:27:34.440118 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-fab839f3-ff8c-4b3e-a867-f68507b21bc3 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:34.440564 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-fab839f3-ff8c-4b3e-a867-f68507b21bc3 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:34.441328 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-fab839f3-ff8c-4b3e-a867-f68507b21bc3 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:34.441756 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-fab839f3-ff8c-4b3e-a867-f68507b21bc3 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:34.457303 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-37f9fed1-1872-44d0-a1d0-aaadadf8ef5d tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:27:34.457905 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-37f9fed1-1872-44d0-a1d0-aaadadf8ef5d tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:27:34.463580 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-37f9fed1-1872-44d0-a1d0-aaadadf8ef5d tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:34.464019 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-37f9fed1-1872-44d0-a1d0-aaadadf8ef5d tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:34.464777 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-37f9fed1-1872-44d0-a1d0-aaadadf8ef5d tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:34.465203 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-37f9fed1-1872-44d0-a1d0-aaadadf8ef5d tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:34.471156 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-fab839f3-ff8c-4b3e-a867-f68507b21bc3 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041938 Nov 01 01:27:34.471706 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 644/1344] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:27:34 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:27:34.586525 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-37f9fed1-1872-44d0-a1d0-aaadadf8ef5d tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:27:34.594257 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-37f9fed1-1872-44d0-a1d0-aaadadf8ef5d tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.140602 Nov 01 01:27:34.594842 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 701/1345] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:27:34 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:27:35.309313 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-3761478f-4aab-4bee-ae51-6b1b742adc15 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:27:35.310811 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-3761478f-4aab-4bee-ae51-6b1b742adc15 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:27:35.315791 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3761478f-4aab-4bee-ae51-6b1b742adc15 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:35.316242 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3761478f-4aab-4bee-ae51-6b1b742adc15 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:35.317005 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3761478f-4aab-4bee-ae51-6b1b742adc15 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:35.317438 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3761478f-4aab-4bee-ae51-6b1b742adc15 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:35.436603 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-3761478f-4aab-4bee-ae51-6b1b742adc15 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:27:35.451227 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-3761478f-4aab-4bee-ae51-6b1b742adc15 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.145499 Nov 01 01:27:35.453646 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 645/1346] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:27:35 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:27:35.481885 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-658fcd9c-f072-47aa-bbd7-530cafe8c65e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:27:35.482825 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-658fcd9c-f072-47aa-bbd7-530cafe8c65e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:27:35.489136 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-658fcd9c-f072-47aa-bbd7-530cafe8c65e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:35.489574 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-658fcd9c-f072-47aa-bbd7-530cafe8c65e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:35.490325 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-658fcd9c-f072-47aa-bbd7-530cafe8c65e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:35.491025 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-658fcd9c-f072-47aa-bbd7-530cafe8c65e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:35.519638 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-658fcd9c-f072-47aa-bbd7-530cafe8c65e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041781 Nov 01 01:27:35.520164 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 702/1347] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:27:35 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:27:35.610943 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-853c5c21-fb82-4cbc-a1b3-df6a336bb50d tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:27:35.611677 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-853c5c21-fb82-4cbc-a1b3-df6a336bb50d tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:27:35.617532 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-853c5c21-fb82-4cbc-a1b3-df6a336bb50d tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:35.617983 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-853c5c21-fb82-4cbc-a1b3-df6a336bb50d tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:35.618781 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-853c5c21-fb82-4cbc-a1b3-df6a336bb50d tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:35.619216 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-853c5c21-fb82-4cbc-a1b3-df6a336bb50d tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:35.747262 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-853c5c21-fb82-4cbc-a1b3-df6a336bb50d tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:27:35.755319 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-853c5c21-fb82-4cbc-a1b3-df6a336bb50d tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.148083 Nov 01 01:27:35.755882 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 646/1348] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:27:35 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:27:36.475205 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-76761d3c-8bd5-4e5a-8eec-9cb4f4a41a16 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:27:36.475836 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-76761d3c-8bd5-4e5a-8eec-9cb4f4a41a16 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:27:36.481927 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-76761d3c-8bd5-4e5a-8eec-9cb4f4a41a16 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:36.482529 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-76761d3c-8bd5-4e5a-8eec-9cb4f4a41a16 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:36.483127 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-76761d3c-8bd5-4e5a-8eec-9cb4f4a41a16 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:36.483550 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-76761d3c-8bd5-4e5a-8eec-9cb4f4a41a16 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:36.531418 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-e1e16aa0-df97-4e64-b7f5-00c17ab98f2f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:27:36.532346 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-e1e16aa0-df97-4e64-b7f5-00c17ab98f2f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:27:36.538515 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e1e16aa0-df97-4e64-b7f5-00c17ab98f2f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:36.538961 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e1e16aa0-df97-4e64-b7f5-00c17ab98f2f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:36.539726 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e1e16aa0-df97-4e64-b7f5-00c17ab98f2f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:36.540155 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e1e16aa0-df97-4e64-b7f5-00c17ab98f2f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:36.568602 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-e1e16aa0-df97-4e64-b7f5-00c17ab98f2f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041490 Nov 01 01:27:36.569193 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 647/1349] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:27:36 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 01 01:27:36.604590 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-76761d3c-8bd5-4e5a-8eec-9cb4f4a41a16 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:27:36.612047 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-76761d3c-8bd5-4e5a-8eec-9cb4f4a41a16 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.140520 Nov 01 01:27:36.612600 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 703/1350] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:27:36 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:27:36.772034 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-4fcafd50-09c7-4cf1-8389-77b58ee643c8 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:27:36.772739 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-4fcafd50-09c7-4cf1-8389-77b58ee643c8 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:27:36.778468 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4fcafd50-09c7-4cf1-8389-77b58ee643c8 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:36.778919 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4fcafd50-09c7-4cf1-8389-77b58ee643c8 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:36.779681 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4fcafd50-09c7-4cf1-8389-77b58ee643c8 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:36.780115 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4fcafd50-09c7-4cf1-8389-77b58ee643c8 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:36.896487 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-4fcafd50-09c7-4cf1-8389-77b58ee643c8 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:27:36.903745 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-4fcafd50-09c7-4cf1-8389-77b58ee643c8 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.135315 Nov 01 01:27:36.904305 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 648/1351] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:27:36 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:27:37.579843 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-ba65728e-0614-44b5-8779-d22d0341b2d8 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:27:37.580758 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-ba65728e-0614-44b5-8779-d22d0341b2d8 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:27:37.586982 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ba65728e-0614-44b5-8779-d22d0341b2d8 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:37.587428 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ba65728e-0614-44b5-8779-d22d0341b2d8 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:37.588191 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ba65728e-0614-44b5-8779-d22d0341b2d8 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:37.588618 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ba65728e-0614-44b5-8779-d22d0341b2d8 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:37.623787 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-ba65728e-0614-44b5-8779-d22d0341b2d8 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047603 Nov 01 01:27:37.624251 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 704/1352] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:27:37 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:27:37.628525 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-8764c7b2-4e95-47b0-8d68-38d1858acfca tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:27:37.629187 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-8764c7b2-4e95-47b0-8d68-38d1858acfca tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:27:37.635421 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8764c7b2-4e95-47b0-8d68-38d1858acfca tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:37.635863 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8764c7b2-4e95-47b0-8d68-38d1858acfca tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:37.636616 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8764c7b2-4e95-47b0-8d68-38d1858acfca tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:37.637042 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8764c7b2-4e95-47b0-8d68-38d1858acfca tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:37.756434 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-8764c7b2-4e95-47b0-8d68-38d1858acfca tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:27:37.763714 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-8764c7b2-4e95-47b0-8d68-38d1858acfca tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.138840 Nov 01 01:27:37.764273 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 649/1353] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:27:37 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:27:37.920168 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-d4adf84c-a872-45cd-936c-1db4046ba645 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:27:37.920699 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-d4adf84c-a872-45cd-936c-1db4046ba645 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:27:37.927032 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d4adf84c-a872-45cd-936c-1db4046ba645 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:37.927471 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d4adf84c-a872-45cd-936c-1db4046ba645 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:37.928223 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d4adf84c-a872-45cd-936c-1db4046ba645 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:37.928647 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d4adf84c-a872-45cd-936c-1db4046ba645 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:38.051698 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-d4adf84c-a872-45cd-936c-1db4046ba645 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:27:38.054554 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-d4adf84c-a872-45cd-936c-1db4046ba645 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.138017 Nov 01 01:27:38.055118 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 705/1354] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:27:37 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:27:38.635257 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-ed057a25-fbb0-430b-94ad-929a1e829aa4 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:27:38.636118 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-ed057a25-fbb0-430b-94ad-929a1e829aa4 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:27:38.643004 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ed057a25-fbb0-430b-94ad-929a1e829aa4 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:38.643451 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ed057a25-fbb0-430b-94ad-929a1e829aa4 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:38.644217 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ed057a25-fbb0-430b-94ad-929a1e829aa4 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:38.644648 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ed057a25-fbb0-430b-94ad-929a1e829aa4 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:38.673358 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-ed057a25-fbb0-430b-94ad-929a1e829aa4 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042104 Nov 01 01:27:38.673897 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 650/1355] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:27:38 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:27:38.780128 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-78e55ca7-7306-4fad-a834-6d2a324a6080 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:27:38.780879 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-78e55ca7-7306-4fad-a834-6d2a324a6080 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:27:38.787085 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-78e55ca7-7306-4fad-a834-6d2a324a6080 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:38.787521 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-78e55ca7-7306-4fad-a834-6d2a324a6080 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:38.788272 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-78e55ca7-7306-4fad-a834-6d2a324a6080 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:38.788697 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-78e55ca7-7306-4fad-a834-6d2a324a6080 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:38.905660 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-78e55ca7-7306-4fad-a834-6d2a324a6080 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:27:38.913060 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-78e55ca7-7306-4fad-a834-6d2a324a6080 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.136384 Nov 01 01:27:38.913618 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 706/1356] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:27:38 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:27:39.071212 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-955cec7c-040c-4058-8252-823261d03b40 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:27:39.071997 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-955cec7c-040c-4058-8252-823261d03b40 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:27:39.077757 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-955cec7c-040c-4058-8252-823261d03b40 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:39.078195 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-955cec7c-040c-4058-8252-823261d03b40 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:39.078971 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-955cec7c-040c-4058-8252-823261d03b40 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:39.079395 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-955cec7c-040c-4058-8252-823261d03b40 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:39.200131 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-955cec7c-040c-4058-8252-823261d03b40 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:27:39.207307 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-955cec7c-040c-4058-8252-823261d03b40 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.139766 Nov 01 01:27:39.207863 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 651/1357] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:27:39 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:27:39.683670 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-338aaf91-f10f-484f-b439-47e9b8f90256 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:27:39.684603 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-338aaf91-f10f-484f-b439-47e9b8f90256 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:27:39.690472 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-338aaf91-f10f-484f-b439-47e9b8f90256 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:39.690915 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-338aaf91-f10f-484f-b439-47e9b8f90256 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:39.691660 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-338aaf91-f10f-484f-b439-47e9b8f90256 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:39.692114 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-338aaf91-f10f-484f-b439-47e9b8f90256 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:39.720556 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-338aaf91-f10f-484f-b439-47e9b8f90256 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040640 Nov 01 01:27:39.721081 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 707/1358] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:27:39 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 01 01:27:39.929455 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-c05fad27-608c-428c-973b-b449043280ae tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:27:39.930064 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-c05fad27-608c-428c-973b-b449043280ae tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:27:39.936463 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c05fad27-608c-428c-973b-b449043280ae tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:39.937345 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c05fad27-608c-428c-973b-b449043280ae tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:39.938110 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c05fad27-608c-428c-973b-b449043280ae tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:39.938574 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c05fad27-608c-428c-973b-b449043280ae tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:40.055039 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-c05fad27-608c-428c-973b-b449043280ae tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:27:40.062801 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-c05fad27-608c-428c-973b-b449043280ae tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.136465 Nov 01 01:27:40.063359 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 652/1359] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:27:39 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:27:40.226335 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-dec0469c-4c07-4b3f-bd0d-b8a61b62aa01 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:27:40.226901 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-dec0469c-4c07-4b3f-bd0d-b8a61b62aa01 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:27:40.233343 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-dec0469c-4c07-4b3f-bd0d-b8a61b62aa01 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:40.234289 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-dec0469c-4c07-4b3f-bd0d-b8a61b62aa01 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:40.235084 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-dec0469c-4c07-4b3f-bd0d-b8a61b62aa01 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:40.235528 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-dec0469c-4c07-4b3f-bd0d-b8a61b62aa01 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:40.351511 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-dec0469c-4c07-4b3f-bd0d-b8a61b62aa01 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:27:40.359652 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-dec0469c-4c07-4b3f-bd0d-b8a61b62aa01 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.136964 Nov 01 01:27:40.360207 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 708/1360] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:27:40 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:27:40.732250 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-ad9d7ad4-1e5d-487d-b959-0ef91571b52d tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:27:40.733171 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-ad9d7ad4-1e5d-487d-b959-0ef91571b52d tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:27:40.739674 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ad9d7ad4-1e5d-487d-b959-0ef91571b52d tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:40.740123 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ad9d7ad4-1e5d-487d-b959-0ef91571b52d tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:40.740880 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ad9d7ad4-1e5d-487d-b959-0ef91571b52d tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:40.741308 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ad9d7ad4-1e5d-487d-b959-0ef91571b52d tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:40.769178 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-ad9d7ad4-1e5d-487d-b959-0ef91571b52d tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041081 Nov 01 01:27:40.769714 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 653/1361] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:27:40 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:27:41.079929 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-cc5ace9b-5ef9-4f42-a8bc-3acb27f55770 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:27:41.080468 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-cc5ace9b-5ef9-4f42-a8bc-3acb27f55770 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:27:41.086501 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-cc5ace9b-5ef9-4f42-a8bc-3acb27f55770 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:41.086953 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-cc5ace9b-5ef9-4f42-a8bc-3acb27f55770 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:41.087715 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-cc5ace9b-5ef9-4f42-a8bc-3acb27f55770 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:41.088149 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-cc5ace9b-5ef9-4f42-a8bc-3acb27f55770 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:41.207689 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-cc5ace9b-5ef9-4f42-a8bc-3acb27f55770 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:27:41.214862 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-cc5ace9b-5ef9-4f42-a8bc-3acb27f55770 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.139160 Nov 01 01:27:41.215411 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 709/1362] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:27:41 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:27:41.377032 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-6c3841fc-5763-44cd-a333-0d5fa21c012f tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:27:41.377643 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-6c3841fc-5763-44cd-a333-0d5fa21c012f tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:27:41.383875 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-6c3841fc-5763-44cd-a333-0d5fa21c012f tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:41.384332 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-6c3841fc-5763-44cd-a333-0d5fa21c012f tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:41.385088 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-6c3841fc-5763-44cd-a333-0d5fa21c012f tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:41.385518 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-6c3841fc-5763-44cd-a333-0d5fa21c012f tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:41.503588 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-6c3841fc-5763-44cd-a333-0d5fa21c012f tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:27:41.510918 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-6c3841fc-5763-44cd-a333-0d5fa21c012f tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.138088 Nov 01 01:27:41.511478 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 654/1363] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:27:41 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:27:41.780243 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-013d5cde-490c-4ef6-a291-b3abf438fd8f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:27:41.781161 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-013d5cde-490c-4ef6-a291-b3abf438fd8f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:27:41.787555 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-013d5cde-490c-4ef6-a291-b3abf438fd8f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:41.788002 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-013d5cde-490c-4ef6-a291-b3abf438fd8f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:41.788770 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-013d5cde-490c-4ef6-a291-b3abf438fd8f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:41.789204 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-013d5cde-490c-4ef6-a291-b3abf438fd8f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:41.818063 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-013d5cde-490c-4ef6-a291-b3abf438fd8f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041568 Nov 01 01:27:41.818628 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 710/1364] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:27:41 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:27:42.231251 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-b17314f2-2e54-4495-b00e-a2b609aa8e98 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:27:42.231860 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-b17314f2-2e54-4495-b00e-a2b609aa8e98 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:27:42.238327 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b17314f2-2e54-4495-b00e-a2b609aa8e98 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:42.238807 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b17314f2-2e54-4495-b00e-a2b609aa8e98 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:42.239570 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b17314f2-2e54-4495-b00e-a2b609aa8e98 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:42.240001 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b17314f2-2e54-4495-b00e-a2b609aa8e98 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:42.355499 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-b17314f2-2e54-4495-b00e-a2b609aa8e98 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:27:42.363554 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-b17314f2-2e54-4495-b00e-a2b609aa8e98 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.136182 Nov 01 01:27:42.364116 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 655/1365] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:27:42 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:27:42.528551 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-4ef5a1c6-6253-45ee-bcd9-d465233d1a16 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:27:42.529153 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-4ef5a1c6-6253-45ee-bcd9-d465233d1a16 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:27:42.535566 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4ef5a1c6-6253-45ee-bcd9-d465233d1a16 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:42.536007 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4ef5a1c6-6253-45ee-bcd9-d465233d1a16 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:42.536756 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4ef5a1c6-6253-45ee-bcd9-d465233d1a16 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:42.537178 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4ef5a1c6-6253-45ee-bcd9-d465233d1a16 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:42.659408 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-4ef5a1c6-6253-45ee-bcd9-d465233d1a16 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:27:42.666570 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-4ef5a1c6-6253-45ee-bcd9-d465233d1a16 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.141690 Nov 01 01:27:42.667122 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 711/1366] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:27:42 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:27:42.829794 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-5ffeaea6-5d7c-4c74-b08e-bcec327c1e68 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:27:42.830732 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-5ffeaea6-5d7c-4c74-b08e-bcec327c1e68 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:27:42.836916 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-5ffeaea6-5d7c-4c74-b08e-bcec327c1e68 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:42.837361 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-5ffeaea6-5d7c-4c74-b08e-bcec327c1e68 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:42.838124 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-5ffeaea6-5d7c-4c74-b08e-bcec327c1e68 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:42.838590 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-5ffeaea6-5d7c-4c74-b08e-bcec327c1e68 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:42.867186 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-5ffeaea6-5d7c-4c74-b08e-bcec327c1e68 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041614 Nov 01 01:27:42.867663 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 656/1367] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:27:42 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:27:43.380633 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-f1d4411e-d510-4a15-8735-b250e56fb6ee tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:27:43.381245 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-f1d4411e-d510-4a15-8735-b250e56fb6ee tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:27:43.387457 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f1d4411e-d510-4a15-8735-b250e56fb6ee tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:43.387899 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f1d4411e-d510-4a15-8735-b250e56fb6ee tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:43.388658 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f1d4411e-d510-4a15-8735-b250e56fb6ee tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:43.389090 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f1d4411e-d510-4a15-8735-b250e56fb6ee tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:43.506441 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-f1d4411e-d510-4a15-8735-b250e56fb6ee tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:27:43.513704 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-f1d4411e-d510-4a15-8735-b250e56fb6ee tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.136795 Nov 01 01:27:43.514267 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 712/1368] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:27:43 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:27:43.683258 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-ab25fdb8-5f17-4a9c-9e9a-746cbed1aa12 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:27:43.683873 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-ab25fdb8-5f17-4a9c-9e9a-746cbed1aa12 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:27:43.689743 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ab25fdb8-5f17-4a9c-9e9a-746cbed1aa12 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:43.690185 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ab25fdb8-5f17-4a9c-9e9a-746cbed1aa12 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:43.690974 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ab25fdb8-5f17-4a9c-9e9a-746cbed1aa12 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:43.691403 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ab25fdb8-5f17-4a9c-9e9a-746cbed1aa12 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:43.808261 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-ab25fdb8-5f17-4a9c-9e9a-746cbed1aa12 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:27:43.815562 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-ab25fdb8-5f17-4a9c-9e9a-746cbed1aa12 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.136006 Nov 01 01:27:43.816120 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 657/1369] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:27:43 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:27:43.878577 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-e0f576fb-cccf-4dfd-a6ee-377c2eb4c8ae tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:27:43.879797 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-e0f576fb-cccf-4dfd-a6ee-377c2eb4c8ae tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:27:43.885605 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e0f576fb-cccf-4dfd-a6ee-377c2eb4c8ae tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:43.886041 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e0f576fb-cccf-4dfd-a6ee-377c2eb4c8ae tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:43.886834 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e0f576fb-cccf-4dfd-a6ee-377c2eb4c8ae tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:43.887255 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e0f576fb-cccf-4dfd-a6ee-377c2eb4c8ae tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:43.914844 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-e0f576fb-cccf-4dfd-a6ee-377c2eb4c8ae tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040155 Nov 01 01:27:43.915370 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 713/1370] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:27:43 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 01 01:27:44.530336 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-607d4fd6-7b10-4ab3-897b-2d20c0838af2 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:27:44.530995 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-607d4fd6-7b10-4ab3-897b-2d20c0838af2 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:27:44.537248 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-607d4fd6-7b10-4ab3-897b-2d20c0838af2 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:44.537694 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-607d4fd6-7b10-4ab3-897b-2d20c0838af2 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:44.538488 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-607d4fd6-7b10-4ab3-897b-2d20c0838af2 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:44.538927 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-607d4fd6-7b10-4ab3-897b-2d20c0838af2 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:44.661641 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-607d4fd6-7b10-4ab3-897b-2d20c0838af2 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:27:44.668953 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-607d4fd6-7b10-4ab3-897b-2d20c0838af2 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.142286 Nov 01 01:27:44.669512 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 658/1371] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:27:44 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:27:44.832047 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-9d58e124-3b2b-4746-9430-08d660c44844 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:27:44.832681 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-9d58e124-3b2b-4746-9430-08d660c44844 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:27:44.838637 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9d58e124-3b2b-4746-9430-08d660c44844 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:44.839085 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9d58e124-3b2b-4746-9430-08d660c44844 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:44.839843 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9d58e124-3b2b-4746-9430-08d660c44844 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:44.840309 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9d58e124-3b2b-4746-9430-08d660c44844 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:44.926617 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-a95a4994-9202-4fe0-92af-d07c2e0daffc tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:27:44.927539 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-a95a4994-9202-4fe0-92af-d07c2e0daffc tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:27:44.933299 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a95a4994-9202-4fe0-92af-d07c2e0daffc tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:44.933757 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a95a4994-9202-4fe0-92af-d07c2e0daffc tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:44.934556 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a95a4994-9202-4fe0-92af-d07c2e0daffc tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:44.934993 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a95a4994-9202-4fe0-92af-d07c2e0daffc tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:44.957244 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-9d58e124-3b2b-4746-9430-08d660c44844 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:27:44.964185 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-a95a4994-9202-4fe0-92af-d07c2e0daffc tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041813 Nov 01 01:27:44.964339 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-9d58e124-3b2b-4746-9430-08d660c44844 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.135982 Nov 01 01:27:44.964754 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 659/1372] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:27:44 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 01 01:27:44.964911 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 714/1373] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:27:44 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:27:45.685368 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-60015514-f5a4-43e4-b93a-97a4e067b250 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:27:45.685952 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-60015514-f5a4-43e4-b93a-97a4e067b250 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:27:45.692169 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-60015514-f5a4-43e4-b93a-97a4e067b250 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:45.692615 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-60015514-f5a4-43e4-b93a-97a4e067b250 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:45.693371 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-60015514-f5a4-43e4-b93a-97a4e067b250 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:45.693807 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-60015514-f5a4-43e4-b93a-97a4e067b250 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:45.810854 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-60015514-f5a4-43e4-b93a-97a4e067b250 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:27:45.818098 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-60015514-f5a4-43e4-b93a-97a4e067b250 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.136372 Nov 01 01:27:45.818691 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 660/1374] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:27:45 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:27:45.975101 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-b3da8a63-6cb9-43d0-b024-b0077cd26b69 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:27:45.976043 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-b3da8a63-6cb9-43d0-b024-b0077cd26b69 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:27:45.981015 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-d0e81fee-1d7c-4a8c-93ea-fedd46f00afe tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:27:45.981654 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-d0e81fee-1d7c-4a8c-93ea-fedd46f00afe tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:27:45.982901 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b3da8a63-6cb9-43d0-b024-b0077cd26b69 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:45.983357 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b3da8a63-6cb9-43d0-b024-b0077cd26b69 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:45.984131 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b3da8a63-6cb9-43d0-b024-b0077cd26b69 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:45.984616 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b3da8a63-6cb9-43d0-b024-b0077cd26b69 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:45.987469 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d0e81fee-1d7c-4a8c-93ea-fedd46f00afe tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:45.987918 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d0e81fee-1d7c-4a8c-93ea-fedd46f00afe tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:45.988676 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d0e81fee-1d7c-4a8c-93ea-fedd46f00afe tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:45.989107 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d0e81fee-1d7c-4a8c-93ea-fedd46f00afe tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:46.013491 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-b3da8a63-6cb9-43d0-b024-b0077cd26b69 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042156 Nov 01 01:27:46.014048 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 715/1375] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:27:45 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:27:46.110377 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-d0e81fee-1d7c-4a8c-93ea-fedd46f00afe tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:27:46.117677 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-d0e81fee-1d7c-4a8c-93ea-fedd46f00afe tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.140573 Nov 01 01:27:46.118231 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 661/1376] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:27:45 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:27:46.834556 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-7583bfcb-56d1-4077-b0a1-20d2c9c342a6 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:27:46.835214 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-7583bfcb-56d1-4077-b0a1-20d2c9c342a6 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:27:46.841053 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7583bfcb-56d1-4077-b0a1-20d2c9c342a6 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:46.841498 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7583bfcb-56d1-4077-b0a1-20d2c9c342a6 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:46.842264 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7583bfcb-56d1-4077-b0a1-20d2c9c342a6 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:46.842720 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7583bfcb-56d1-4077-b0a1-20d2c9c342a6 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:46.973905 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-7583bfcb-56d1-4077-b0a1-20d2c9c342a6 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:27:46.981758 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-7583bfcb-56d1-4077-b0a1-20d2c9c342a6 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.150919 Nov 01 01:27:46.982315 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 716/1377] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:27:46 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:27:47.025151 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-be926618-560f-4269-b7b4-2d9283c39e99 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:27:47.025996 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-be926618-560f-4269-b7b4-2d9283c39e99 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:27:47.032832 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-be926618-560f-4269-b7b4-2d9283c39e99 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:47.033273 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-be926618-560f-4269-b7b4-2d9283c39e99 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:47.034037 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-be926618-560f-4269-b7b4-2d9283c39e99 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:47.034564 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-be926618-560f-4269-b7b4-2d9283c39e99 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:47.062735 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-be926618-560f-4269-b7b4-2d9283c39e99 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041299 Nov 01 01:27:47.063277 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 662/1378] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:27:47 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:27:47.134230 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-bb219c45-9a4a-42a6-8548-abe5206cd06b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:27:47.134854 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-bb219c45-9a4a-42a6-8548-abe5206cd06b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:27:47.141245 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-bb219c45-9a4a-42a6-8548-abe5206cd06b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:47.141696 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-bb219c45-9a4a-42a6-8548-abe5206cd06b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:47.142487 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-bb219c45-9a4a-42a6-8548-abe5206cd06b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:47.142920 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-bb219c45-9a4a-42a6-8548-abe5206cd06b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:47.266794 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-bb219c45-9a4a-42a6-8548-abe5206cd06b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:27:47.274008 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-bb219c45-9a4a-42a6-8548-abe5206cd06b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.143456 Nov 01 01:27:47.274582 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 717/1379] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:27:47 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:27:47.998334 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-54135841-07b9-4fd6-a495-4909cdf9be7f tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:27:47.998964 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-54135841-07b9-4fd6-a495-4909cdf9be7f tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:27:48.005194 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-54135841-07b9-4fd6-a495-4909cdf9be7f tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:48.005630 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-54135841-07b9-4fd6-a495-4909cdf9be7f tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:48.006383 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-54135841-07b9-4fd6-a495-4909cdf9be7f tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:48.006833 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-54135841-07b9-4fd6-a495-4909cdf9be7f tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:48.073052 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-ad4a17e3-835c-41ca-8d4d-3203c455927e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:27:48.073971 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-ad4a17e3-835c-41ca-8d4d-3203c455927e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:27:48.080473 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ad4a17e3-835c-41ca-8d4d-3203c455927e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:48.080923 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ad4a17e3-835c-41ca-8d4d-3203c455927e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:48.081694 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ad4a17e3-835c-41ca-8d4d-3203c455927e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:48.082128 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ad4a17e3-835c-41ca-8d4d-3203c455927e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:48.113189 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-ad4a17e3-835c-41ca-8d4d-3203c455927e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043842 Nov 01 01:27:48.113755 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 718/1380] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:27:48 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 01 01:27:48.129128 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-54135841-07b9-4fd6-a495-4909cdf9be7f tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:27:48.136580 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-54135841-07b9-4fd6-a495-4909cdf9be7f tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.142098 Nov 01 01:27:48.137128 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 663/1381] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:27:47 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:27:48.290865 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-2f6d00d9-512b-4395-bfc3-5da046f01de9 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:27:48.291397 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-2f6d00d9-512b-4395-bfc3-5da046f01de9 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:27:48.297819 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2f6d00d9-512b-4395-bfc3-5da046f01de9 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:48.298260 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2f6d00d9-512b-4395-bfc3-5da046f01de9 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:48.299048 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2f6d00d9-512b-4395-bfc3-5da046f01de9 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:48.299473 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2f6d00d9-512b-4395-bfc3-5da046f01de9 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:48.415688 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-2f6d00d9-512b-4395-bfc3-5da046f01de9 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:27:48.423732 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-2f6d00d9-512b-4395-bfc3-5da046f01de9 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.136659 Nov 01 01:27:48.424287 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 719/1382] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:27:48 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:27:49.124602 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-3cc18543-6e13-46af-848f-8c945166f595 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:27:49.126013 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-3cc18543-6e13-46af-848f-8c945166f595 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:27:49.132326 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3cc18543-6e13-46af-848f-8c945166f595 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:49.134681 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3cc18543-6e13-46af-848f-8c945166f595 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:49.134681 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3cc18543-6e13-46af-848f-8c945166f595 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:49.134681 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3cc18543-6e13-46af-848f-8c945166f595 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:49.152711 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-605f5378-66f0-4c66-b77e-a270b9fd8680 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:27:49.153325 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-605f5378-66f0-4c66-b77e-a270b9fd8680 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:27:49.159545 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-605f5378-66f0-4c66-b77e-a270b9fd8680 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:49.159993 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-605f5378-66f0-4c66-b77e-a270b9fd8680 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:49.160767 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-605f5378-66f0-4c66-b77e-a270b9fd8680 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:49.161204 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-605f5378-66f0-4c66-b77e-a270b9fd8680 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:49.163086 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-3cc18543-6e13-46af-848f-8c945166f595 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042360 Nov 01 01:27:49.163869 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 664/1383] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:27:49 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:27:49.283538 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-605f5378-66f0-4c66-b77e-a270b9fd8680 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:27:49.290934 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-605f5378-66f0-4c66-b77e-a270b9fd8680 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.141837 Nov 01 01:27:49.291702 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 720/1384] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:27:49 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:27:49.446504 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-6f15e02f-54f4-40f1-b5e9-784b0efdc618 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:27:49.447091 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-6f15e02f-54f4-40f1-b5e9-784b0efdc618 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:27:49.452851 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-6f15e02f-54f4-40f1-b5e9-784b0efdc618 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:49.453293 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-6f15e02f-54f4-40f1-b5e9-784b0efdc618 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:49.454040 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-6f15e02f-54f4-40f1-b5e9-784b0efdc618 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:49.454493 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-6f15e02f-54f4-40f1-b5e9-784b0efdc618 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:49.577187 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-6f15e02f-54f4-40f1-b5e9-784b0efdc618 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:27:49.584377 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-6f15e02f-54f4-40f1-b5e9-784b0efdc618 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.141608 Nov 01 01:27:49.584934 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 665/1385] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:27:49 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:27:50.174711 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-39ce9444-87e2-4c39-8ede-e3f61d91a8cd tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:27:50.175615 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-39ce9444-87e2-4c39-8ede-e3f61d91a8cd tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:27:50.181771 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-39ce9444-87e2-4c39-8ede-e3f61d91a8cd tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:50.182211 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-39ce9444-87e2-4c39-8ede-e3f61d91a8cd tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:50.183000 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-39ce9444-87e2-4c39-8ede-e3f61d91a8cd tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:50.183424 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-39ce9444-87e2-4c39-8ede-e3f61d91a8cd tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:50.211159 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-39ce9444-87e2-4c39-8ede-e3f61d91a8cd tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040368 Nov 01 01:27:50.211808 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 721/1386] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:27:50 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:27:50.307985 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-ed34609e-5b5f-4ab6-b200-5704c5d6d25a tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:27:50.308596 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-ed34609e-5b5f-4ab6-b200-5704c5d6d25a tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:27:50.314904 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ed34609e-5b5f-4ab6-b200-5704c5d6d25a tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:50.315344 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ed34609e-5b5f-4ab6-b200-5704c5d6d25a tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:50.316103 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ed34609e-5b5f-4ab6-b200-5704c5d6d25a tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:50.316530 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ed34609e-5b5f-4ab6-b200-5704c5d6d25a tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:50.434713 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-ed34609e-5b5f-4ab6-b200-5704c5d6d25a tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:27:50.442447 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-ed34609e-5b5f-4ab6-b200-5704c5d6d25a tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.138131 Nov 01 01:27:50.443012 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 666/1387] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:27:50 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:27:50.600966 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-5d4d5c10-fa90-40d6-a81f-4da1a101c5e9 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:27:50.601580 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-5d4d5c10-fa90-40d6-a81f-4da1a101c5e9 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:27:50.607583 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5d4d5c10-fa90-40d6-a81f-4da1a101c5e9 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:50.608034 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5d4d5c10-fa90-40d6-a81f-4da1a101c5e9 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:50.608804 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5d4d5c10-fa90-40d6-a81f-4da1a101c5e9 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:50.609241 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5d4d5c10-fa90-40d6-a81f-4da1a101c5e9 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:50.733765 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-5d4d5c10-fa90-40d6-a81f-4da1a101c5e9 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:27:50.741687 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-5d4d5c10-fa90-40d6-a81f-4da1a101c5e9 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.144373 Nov 01 01:27:50.744461 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 722/1388] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:27:50 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:27:51.223785 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-3f012685-b635-4b34-a01c-5c6605d298d7 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:27:51.224708 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-3f012685-b635-4b34-a01c-5c6605d298d7 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:27:51.230830 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3f012685-b635-4b34-a01c-5c6605d298d7 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:51.231282 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3f012685-b635-4b34-a01c-5c6605d298d7 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:51.232046 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3f012685-b635-4b34-a01c-5c6605d298d7 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:51.232476 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3f012685-b635-4b34-a01c-5c6605d298d7 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:51.260262 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-3f012685-b635-4b34-a01c-5c6605d298d7 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040339 Nov 01 01:27:51.260800 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 667/1389] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:27:51 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:27:51.459592 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-06182185-f553-4c6f-9b1c-cc4dd3d74ccd tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:27:51.460245 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-06182185-f553-4c6f-9b1c-cc4dd3d74ccd tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:27:51.466362 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-06182185-f553-4c6f-9b1c-cc4dd3d74ccd tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:51.466828 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-06182185-f553-4c6f-9b1c-cc4dd3d74ccd tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:51.467578 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-06182185-f553-4c6f-9b1c-cc4dd3d74ccd tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:51.468001 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-06182185-f553-4c6f-9b1c-cc4dd3d74ccd tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:51.587873 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-06182185-f553-4c6f-9b1c-cc4dd3d74ccd tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:27:51.595631 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-06182185-f553-4c6f-9b1c-cc4dd3d74ccd tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.139664 Nov 01 01:27:51.596202 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 723/1390] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:27:51 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:27:51.759396 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-dc7cdf33-90be-4645-918b-2b91fca8b5ab tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:27:51.760007 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-dc7cdf33-90be-4645-918b-2b91fca8b5ab tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:27:51.766748 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-dc7cdf33-90be-4645-918b-2b91fca8b5ab tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:51.767195 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-dc7cdf33-90be-4645-918b-2b91fca8b5ab tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:51.767955 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-dc7cdf33-90be-4645-918b-2b91fca8b5ab tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:51.768383 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-dc7cdf33-90be-4645-918b-2b91fca8b5ab tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:51.884010 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-dc7cdf33-90be-4645-918b-2b91fca8b5ab tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:27:51.891847 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-dc7cdf33-90be-4645-918b-2b91fca8b5ab tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.136128 Nov 01 01:27:51.892412 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 668/1391] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:27:51 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:27:52.270775 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-a556cd84-efd8-4d0b-900c-44356839fe95 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:27:52.271707 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-a556cd84-efd8-4d0b-900c-44356839fe95 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:27:52.277489 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a556cd84-efd8-4d0b-900c-44356839fe95 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:52.277931 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a556cd84-efd8-4d0b-900c-44356839fe95 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:52.278717 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a556cd84-efd8-4d0b-900c-44356839fe95 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:52.279148 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a556cd84-efd8-4d0b-900c-44356839fe95 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:52.307009 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-a556cd84-efd8-4d0b-900c-44356839fe95 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039963 Nov 01 01:27:52.307538 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 724/1392] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:27:52 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:27:52.613180 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-4b6cb022-0748-4040-850a-95eec5875158 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:27:52.613701 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-4b6cb022-0748-4040-850a-95eec5875158 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:27:52.619593 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4b6cb022-0748-4040-850a-95eec5875158 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:52.620033 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4b6cb022-0748-4040-850a-95eec5875158 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:52.620783 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4b6cb022-0748-4040-850a-95eec5875158 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:52.621204 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4b6cb022-0748-4040-850a-95eec5875158 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:52.743702 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-4b6cb022-0748-4040-850a-95eec5875158 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:27:52.751246 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-4b6cb022-0748-4040-850a-95eec5875158 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.142356 Nov 01 01:27:52.751802 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 669/1393] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:27:52 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:27:52.908621 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-6524f5e1-9fdf-4cd9-a0dc-50e6e1f227fa tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:27:52.909196 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-6524f5e1-9fdf-4cd9-a0dc-50e6e1f227fa tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:27:52.916017 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6524f5e1-9fdf-4cd9-a0dc-50e6e1f227fa tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:52.916467 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6524f5e1-9fdf-4cd9-a0dc-50e6e1f227fa tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:52.917242 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6524f5e1-9fdf-4cd9-a0dc-50e6e1f227fa tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:52.917711 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6524f5e1-9fdf-4cd9-a0dc-50e6e1f227fa tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:53.056841 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-6524f5e1-9fdf-4cd9-a0dc-50e6e1f227fa tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:27:53.064316 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-6524f5e1-9fdf-4cd9-a0dc-50e6e1f227fa tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.159934 Nov 01 01:27:53.064873 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 725/1394] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:27:52 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:27:53.318385 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-0744a597-3c44-452b-8e83-71b297da7224 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:27:53.319345 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-0744a597-3c44-452b-8e83-71b297da7224 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:27:53.325572 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0744a597-3c44-452b-8e83-71b297da7224 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:53.326011 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0744a597-3c44-452b-8e83-71b297da7224 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:53.326913 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0744a597-3c44-452b-8e83-71b297da7224 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:53.327339 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0744a597-3c44-452b-8e83-71b297da7224 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:53.360912 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-0744a597-3c44-452b-8e83-71b297da7224 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046260 Nov 01 01:27:53.361462 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 670/1395] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:27:53 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:27:53.768212 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-e59044ec-40e5-47cb-9700-cf745557995b tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:27:53.768822 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-e59044ec-40e5-47cb-9700-cf745557995b tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:27:53.774719 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e59044ec-40e5-47cb-9700-cf745557995b tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:53.775166 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e59044ec-40e5-47cb-9700-cf745557995b tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:53.775927 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e59044ec-40e5-47cb-9700-cf745557995b tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:53.776357 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e59044ec-40e5-47cb-9700-cf745557995b tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:53.891739 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-e59044ec-40e5-47cb-9700-cf745557995b tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:27:53.898825 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-e59044ec-40e5-47cb-9700-cf745557995b tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.134334 Nov 01 01:27:53.899380 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 726/1396] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:27:53 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:27:54.080709 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-d8296cb2-c0a7-4e32-b5a2-df79ae8ca920 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:27:54.081239 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-d8296cb2-c0a7-4e32-b5a2-df79ae8ca920 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:27:54.087145 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d8296cb2-c0a7-4e32-b5a2-df79ae8ca920 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:54.087584 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d8296cb2-c0a7-4e32-b5a2-df79ae8ca920 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:54.088338 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d8296cb2-c0a7-4e32-b5a2-df79ae8ca920 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:54.089284 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d8296cb2-c0a7-4e32-b5a2-df79ae8ca920 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:54.208675 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-d8296cb2-c0a7-4e32-b5a2-df79ae8ca920 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:27:54.217381 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-d8296cb2-c0a7-4e32-b5a2-df79ae8ca920 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.140248 Nov 01 01:27:54.220146 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 671/1397] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:27:54 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:27:54.372514 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-20994772-b0c8-44c4-b991-827f3e6ba345 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:27:54.373428 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-20994772-b0c8-44c4-b991-827f3e6ba345 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:27:54.379640 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-20994772-b0c8-44c4-b991-827f3e6ba345 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:54.380086 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-20994772-b0c8-44c4-b991-827f3e6ba345 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:54.380877 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-20994772-b0c8-44c4-b991-827f3e6ba345 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:54.381312 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-20994772-b0c8-44c4-b991-827f3e6ba345 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:54.409445 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-20994772-b0c8-44c4-b991-827f3e6ba345 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040882 Nov 01 01:27:54.409984 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 727/1398] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:27:54 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:27:54.915598 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-7ab6408d-0371-4595-946f-cd303d54c326 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:27:54.916234 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-7ab6408d-0371-4595-946f-cd303d54c326 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:27:54.922519 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-7ab6408d-0371-4595-946f-cd303d54c326 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:54.922957 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-7ab6408d-0371-4595-946f-cd303d54c326 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:54.923710 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-7ab6408d-0371-4595-946f-cd303d54c326 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:54.924131 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-7ab6408d-0371-4595-946f-cd303d54c326 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:55.043266 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-7ab6408d-0371-4595-946f-cd303d54c326 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:27:55.050395 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-7ab6408d-0371-4595-946f-cd303d54c326 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.138471 Nov 01 01:27:55.050985 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 672/1399] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:27:54 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:27:55.236786 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-95d9e172-ad14-4a32-a85a-ee0ec303fd83 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:27:55.237524 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-95d9e172-ad14-4a32-a85a-ee0ec303fd83 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:27:55.243399 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-95d9e172-ad14-4a32-a85a-ee0ec303fd83 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:55.243846 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-95d9e172-ad14-4a32-a85a-ee0ec303fd83 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:55.244606 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-95d9e172-ad14-4a32-a85a-ee0ec303fd83 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:55.245036 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-95d9e172-ad14-4a32-a85a-ee0ec303fd83 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:55.368323 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-95d9e172-ad14-4a32-a85a-ee0ec303fd83 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:27:55.376319 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-95d9e172-ad14-4a32-a85a-ee0ec303fd83 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.143722 Nov 01 01:27:55.377051 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 728/1400] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:27:55 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:27:55.420548 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-6a1b4e1c-aab8-467d-81e4-d6b83d042473 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:27:55.421494 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-6a1b4e1c-aab8-467d-81e4-d6b83d042473 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:27:55.427691 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-6a1b4e1c-aab8-467d-81e4-d6b83d042473 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:55.428135 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-6a1b4e1c-aab8-467d-81e4-d6b83d042473 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:55.428895 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-6a1b4e1c-aab8-467d-81e4-d6b83d042473 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:55.429324 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-6a1b4e1c-aab8-467d-81e4-d6b83d042473 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:55.457876 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-6a1b4e1c-aab8-467d-81e4-d6b83d042473 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041135 Nov 01 01:27:55.458416 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 673/1401] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:27:55 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:27:56.067472 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-7aba2de5-21b2-4633-a5fc-471f4affc943 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:27:56.068075 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-7aba2de5-21b2-4633-a5fc-471f4affc943 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:27:56.074249 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7aba2de5-21b2-4633-a5fc-471f4affc943 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:56.074724 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7aba2de5-21b2-4633-a5fc-471f4affc943 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:56.075477 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7aba2de5-21b2-4633-a5fc-471f4affc943 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:56.075902 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7aba2de5-21b2-4633-a5fc-471f4affc943 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:56.192697 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-7aba2de5-21b2-4633-a5fc-471f4affc943 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:27:56.199806 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-7aba2de5-21b2-4633-a5fc-471f4affc943 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.135992 Nov 01 01:27:56.200366 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 729/1402] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:27:56 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:27:56.392969 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-7ee99eb1-86a6-4685-85e2-089ba715606b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:27:56.393578 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-7ee99eb1-86a6-4685-85e2-089ba715606b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:27:56.399916 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-7ee99eb1-86a6-4685-85e2-089ba715606b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:56.400398 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-7ee99eb1-86a6-4685-85e2-089ba715606b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:56.401160 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-7ee99eb1-86a6-4685-85e2-089ba715606b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:56.401596 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-7ee99eb1-86a6-4685-85e2-089ba715606b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:56.469527 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-04b79efd-5c5c-4888-a116-7c9d74bcf25c tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:27:56.470587 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-04b79efd-5c5c-4888-a116-7c9d74bcf25c tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:27:56.476327 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-04b79efd-5c5c-4888-a116-7c9d74bcf25c tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:56.476846 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-04b79efd-5c5c-4888-a116-7c9d74bcf25c tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:56.477675 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-04b79efd-5c5c-4888-a116-7c9d74bcf25c tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:56.478305 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-04b79efd-5c5c-4888-a116-7c9d74bcf25c tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:56.507839 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-04b79efd-5c5c-4888-a116-7c9d74bcf25c tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042466 Nov 01 01:27:56.508486 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 730/1403] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:27:56 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 01 01:27:56.523872 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-7ee99eb1-86a6-4685-85e2-089ba715606b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:27:56.531934 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-7ee99eb1-86a6-4685-85e2-089ba715606b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.141849 Nov 01 01:27:56.532491 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 674/1404] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:27:56 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:27:57.216221 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-f3a0c4b8-fc33-456f-8b93-e1235b5100cb tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:27:57.216829 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-f3a0c4b8-fc33-456f-8b93-e1235b5100cb tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:27:57.223054 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f3a0c4b8-fc33-456f-8b93-e1235b5100cb tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:57.223506 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f3a0c4b8-fc33-456f-8b93-e1235b5100cb tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:57.224268 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f3a0c4b8-fc33-456f-8b93-e1235b5100cb tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:57.224705 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f3a0c4b8-fc33-456f-8b93-e1235b5100cb tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:57.342584 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-f3a0c4b8-fc33-456f-8b93-e1235b5100cb tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:27:57.349786 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-f3a0c4b8-fc33-456f-8b93-e1235b5100cb tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.137311 Nov 01 01:27:57.350345 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 731/1405] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:27:57 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:27:57.518779 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-b9935ae6-e2ce-4769-8bd5-27f9d1786234 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:27:57.519595 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-b9935ae6-e2ce-4769-8bd5-27f9d1786234 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:27:57.528218 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b9935ae6-e2ce-4769-8bd5-27f9d1786234 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:57.528661 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b9935ae6-e2ce-4769-8bd5-27f9d1786234 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:57.529418 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b9935ae6-e2ce-4769-8bd5-27f9d1786234 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:57.529845 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b9935ae6-e2ce-4769-8bd5-27f9d1786234 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:57.549260 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-9450afb0-af01-4318-9ba5-52c3ea25087c tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:27:57.549860 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-9450afb0-af01-4318-9ba5-52c3ea25087c tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:27:57.555549 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9450afb0-af01-4318-9ba5-52c3ea25087c tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:57.555989 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9450afb0-af01-4318-9ba5-52c3ea25087c tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:57.556745 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9450afb0-af01-4318-9ba5-52c3ea25087c tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:57.557170 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9450afb0-af01-4318-9ba5-52c3ea25087c tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:57.559097 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-b9935ae6-e2ce-4769-8bd5-27f9d1786234 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044167 Nov 01 01:27:57.559656 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 675/1406] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:27:57 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:27:57.674357 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-9450afb0-af01-4318-9ba5-52c3ea25087c tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:27:57.681477 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-9450afb0-af01-4318-9ba5-52c3ea25087c tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.136306 Nov 01 01:27:57.682032 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 732/1407] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:27:57 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:27:58.365790 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-3d4cbbcf-6989-4c9a-89e3-6f59598da9af tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:27:58.366393 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-3d4cbbcf-6989-4c9a-89e3-6f59598da9af tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:27:58.372291 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3d4cbbcf-6989-4c9a-89e3-6f59598da9af tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:58.372772 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3d4cbbcf-6989-4c9a-89e3-6f59598da9af tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:58.373537 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3d4cbbcf-6989-4c9a-89e3-6f59598da9af tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:58.373968 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3d4cbbcf-6989-4c9a-89e3-6f59598da9af tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:58.493726 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-3d4cbbcf-6989-4c9a-89e3-6f59598da9af tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:27:58.501021 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-3d4cbbcf-6989-4c9a-89e3-6f59598da9af tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.138949 Nov 01 01:27:58.501586 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 676/1408] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:27:58 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:27:58.570645 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-9c29306a-5c6c-4fe2-9cea-1456958133c3 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:27:58.571581 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-9c29306a-5c6c-4fe2-9cea-1456958133c3 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:27:58.578300 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9c29306a-5c6c-4fe2-9cea-1456958133c3 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:58.578795 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9c29306a-5c6c-4fe2-9cea-1456958133c3 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:58.579556 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9c29306a-5c6c-4fe2-9cea-1456958133c3 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:58.579986 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9c29306a-5c6c-4fe2-9cea-1456958133c3 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:58.608524 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-9c29306a-5c6c-4fe2-9cea-1456958133c3 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041589 Nov 01 01:27:58.609056 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 733/1409] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:27:58 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:27:58.698870 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-73af6111-0e2e-4fd8-b375-7327234102bd tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:27:58.699477 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-73af6111-0e2e-4fd8-b375-7327234102bd tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:27:58.706568 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-73af6111-0e2e-4fd8-b375-7327234102bd tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:58.707047 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-73af6111-0e2e-4fd8-b375-7327234102bd tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:58.707819 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-73af6111-0e2e-4fd8-b375-7327234102bd tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:58.708253 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-73af6111-0e2e-4fd8-b375-7327234102bd tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:58.825480 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-73af6111-0e2e-4fd8-b375-7327234102bd tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:27:58.833427 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-73af6111-0e2e-4fd8-b375-7327234102bd tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.138294 Nov 01 01:27:58.833998 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 677/1410] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:27:58 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:27:59.517016 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-421f9a48-19f9-4d97-ae9a-cc660bb126d0 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:27:59.517619 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-421f9a48-19f9-4d97-ae9a-cc660bb126d0 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:27:59.523425 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-421f9a48-19f9-4d97-ae9a-cc660bb126d0 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:59.523873 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-421f9a48-19f9-4d97-ae9a-cc660bb126d0 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:59.524633 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-421f9a48-19f9-4d97-ae9a-cc660bb126d0 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:59.525063 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-421f9a48-19f9-4d97-ae9a-cc660bb126d0 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:59.619826 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-83fb3a5e-a930-4355-af11-639aa3584556 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:27:59.620677 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-83fb3a5e-a930-4355-af11-639aa3584556 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:27:59.626767 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-83fb3a5e-a930-4355-af11-639aa3584556 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:59.627213 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-83fb3a5e-a930-4355-af11-639aa3584556 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:59.627980 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-83fb3a5e-a930-4355-af11-639aa3584556 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:59.628414 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-83fb3a5e-a930-4355-af11-639aa3584556 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:59.642483 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-421f9a48-19f9-4d97-ae9a-cc660bb126d0 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:27:59.649676 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-421f9a48-19f9-4d97-ae9a-cc660bb126d0 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.136413 Nov 01 01:27:59.650235 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 734/1411] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:27:59 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:27:59.657327 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-83fb3a5e-a930-4355-af11-639aa3584556 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041313 Nov 01 01:27:59.657870 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 678/1412] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:27:59 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 01 01:27:59.849676 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-ee74b7de-0175-4d98-b9a0-ca9c2395d602 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:27:59.850283 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-ee74b7de-0175-4d98-b9a0-ca9c2395d602 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:27:59.856254 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ee74b7de-0175-4d98-b9a0-ca9c2395d602 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:59.856691 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ee74b7de-0175-4d98-b9a0-ca9c2395d602 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:59.857438 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ee74b7de-0175-4d98-b9a0-ca9c2395d602 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:27:59.857858 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ee74b7de-0175-4d98-b9a0-ca9c2395d602 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:27:59.977426 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-ee74b7de-0175-4d98-b9a0-ca9c2395d602 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:27:59.985024 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-ee74b7de-0175-4d98-b9a0-ca9c2395d602 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.139022 Nov 01 01:27:59.985576 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 735/1413] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:27:59 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:28:00.667116 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-79ebdd8e-c07f-4fe3-8249-6a297ca3d248 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:28:00.667673 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-79ebdd8e-c07f-4fe3-8249-6a297ca3d248 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:28:00.668414 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-db68d858-a4fc-44b7-ac6d-487efc76c9c1 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:28:00.669321 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-db68d858-a4fc-44b7-ac6d-487efc76c9c1 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:28:00.674323 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-79ebdd8e-c07f-4fe3-8249-6a297ca3d248 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:00.674793 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-79ebdd8e-c07f-4fe3-8249-6a297ca3d248 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:00.675550 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-79ebdd8e-c07f-4fe3-8249-6a297ca3d248 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:00.675974 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-79ebdd8e-c07f-4fe3-8249-6a297ca3d248 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:00.676172 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-db68d858-a4fc-44b7-ac6d-487efc76c9c1 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:00.676695 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-db68d858-a4fc-44b7-ac6d-487efc76c9c1 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:00.677578 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-db68d858-a4fc-44b7-ac6d-487efc76c9c1 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:00.678005 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-db68d858-a4fc-44b7-ac6d-487efc76c9c1 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:00.711622 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-db68d858-a4fc-44b7-ac6d-487efc76c9c1 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046993 Nov 01 01:28:00.715375 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 736/1414] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:28:00 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 01 01:28:00.801973 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-79ebdd8e-c07f-4fe3-8249-6a297ca3d248 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:28:00.809164 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-79ebdd8e-c07f-4fe3-8249-6a297ca3d248 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.145832 Nov 01 01:28:00.809716 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 679/1415] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:28:00 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:28:01.001092 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-a467cf65-cf0a-4b4a-8c37-a359201ff2d2 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:28:01.001694 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-a467cf65-cf0a-4b4a-8c37-a359201ff2d2 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:28:01.007531 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a467cf65-cf0a-4b4a-8c37-a359201ff2d2 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:01.007973 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a467cf65-cf0a-4b4a-8c37-a359201ff2d2 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:01.008725 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a467cf65-cf0a-4b4a-8c37-a359201ff2d2 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:01.009149 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a467cf65-cf0a-4b4a-8c37-a359201ff2d2 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:01.127710 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-a467cf65-cf0a-4b4a-8c37-a359201ff2d2 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:28:01.134814 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-a467cf65-cf0a-4b4a-8c37-a359201ff2d2 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.137313 Nov 01 01:28:01.135364 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 737/1416] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:28:00 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:28:01.722947 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-51c3c705-3826-4670-a1e9-ebf53621fef2 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:28:01.723853 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-51c3c705-3826-4670-a1e9-ebf53621fef2 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:28:01.730298 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-51c3c705-3826-4670-a1e9-ebf53621fef2 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:01.730769 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-51c3c705-3826-4670-a1e9-ebf53621fef2 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:01.731526 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-51c3c705-3826-4670-a1e9-ebf53621fef2 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:01.731950 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-51c3c705-3826-4670-a1e9-ebf53621fef2 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:01.760876 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-51c3c705-3826-4670-a1e9-ebf53621fef2 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041706 Nov 01 01:28:01.761410 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 680/1417] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:28:01 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:28:01.825919 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-5e44a24f-44ce-4a28-b3d4-ee7e0a71b487 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:28:01.826583 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-5e44a24f-44ce-4a28-b3d4-ee7e0a71b487 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:28:01.832752 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5e44a24f-44ce-4a28-b3d4-ee7e0a71b487 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:01.833192 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5e44a24f-44ce-4a28-b3d4-ee7e0a71b487 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:01.833942 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5e44a24f-44ce-4a28-b3d4-ee7e0a71b487 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:01.834365 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5e44a24f-44ce-4a28-b3d4-ee7e0a71b487 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:01.953209 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-5e44a24f-44ce-4a28-b3d4-ee7e0a71b487 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:28:01.963440 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-5e44a24f-44ce-4a28-b3d4-ee7e0a71b487 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.141024 Nov 01 01:28:01.964007 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 738/1418] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:28:01 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:28:02.151159 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-567d918e-c9a4-45b8-8900-7a4cc010214d tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:28:02.151770 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-567d918e-c9a4-45b8-8900-7a4cc010214d tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:28:02.158278 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-567d918e-c9a4-45b8-8900-7a4cc010214d tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:02.158752 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-567d918e-c9a4-45b8-8900-7a4cc010214d tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:02.159515 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-567d918e-c9a4-45b8-8900-7a4cc010214d tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:02.159947 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-567d918e-c9a4-45b8-8900-7a4cc010214d tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:02.276049 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-567d918e-c9a4-45b8-8900-7a4cc010214d tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:28:02.285118 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-567d918e-c9a4-45b8-8900-7a4cc010214d tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.137561 Nov 01 01:28:02.285695 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 681/1419] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:28:02 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:28:02.772249 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-a4411a56-8021-4d66-81ea-a679a6bc7481 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:28:02.773178 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-a4411a56-8021-4d66-81ea-a679a6bc7481 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:28:02.778934 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a4411a56-8021-4d66-81ea-a679a6bc7481 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:02.779373 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a4411a56-8021-4d66-81ea-a679a6bc7481 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:02.780121 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a4411a56-8021-4d66-81ea-a679a6bc7481 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:02.780545 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a4411a56-8021-4d66-81ea-a679a6bc7481 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:02.808464 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-a4411a56-8021-4d66-81ea-a679a6bc7481 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040003 Nov 01 01:28:02.808998 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 739/1420] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:28:02 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:28:02.980618 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-25768892-b3c0-4503-9718-edaa967b72ca tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:28:02.981223 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-25768892-b3c0-4503-9718-edaa967b72ca tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:28:02.988068 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-25768892-b3c0-4503-9718-edaa967b72ca tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:02.988448 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-25768892-b3c0-4503-9718-edaa967b72ca tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:02.989199 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-25768892-b3c0-4503-9718-edaa967b72ca tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:02.989622 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-25768892-b3c0-4503-9718-edaa967b72ca tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:03.106916 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-25768892-b3c0-4503-9718-edaa967b72ca tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:28:03.114892 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-25768892-b3c0-4503-9718-edaa967b72ca tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.138102 Nov 01 01:28:03.115489 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 682/1421] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:28:02 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:28:03.302334 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-47815ba9-7144-44f0-b1e4-5e0639d7dba6 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:28:03.303001 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-47815ba9-7144-44f0-b1e4-5e0639d7dba6 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:28:03.309194 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-47815ba9-7144-44f0-b1e4-5e0639d7dba6 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:03.309635 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-47815ba9-7144-44f0-b1e4-5e0639d7dba6 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:03.310385 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-47815ba9-7144-44f0-b1e4-5e0639d7dba6 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:03.310842 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-47815ba9-7144-44f0-b1e4-5e0639d7dba6 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:03.438098 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-47815ba9-7144-44f0-b1e4-5e0639d7dba6 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:28:03.445386 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-47815ba9-7144-44f0-b1e4-5e0639d7dba6 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.146693 Nov 01 01:28:03.445938 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 740/1422] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:28:03 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:28:03.819759 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-17c85f1e-04d0-4d7b-8ce8-023e8f443a3d tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:28:03.820670 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-17c85f1e-04d0-4d7b-8ce8-023e8f443a3d tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:28:03.826443 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-17c85f1e-04d0-4d7b-8ce8-023e8f443a3d tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:03.826893 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-17c85f1e-04d0-4d7b-8ce8-023e8f443a3d tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:03.828140 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-17c85f1e-04d0-4d7b-8ce8-023e8f443a3d tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:03.828563 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-17c85f1e-04d0-4d7b-8ce8-023e8f443a3d tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:03.856806 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-17c85f1e-04d0-4d7b-8ce8-023e8f443a3d tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040816 Nov 01 01:28:03.857347 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 683/1423] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:28:03 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:28:04.131309 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-47d84068-2f27-4105-9ae4-58a52ed15220 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:28:04.131907 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-47d84068-2f27-4105-9ae4-58a52ed15220 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:28:04.137654 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-47d84068-2f27-4105-9ae4-58a52ed15220 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:04.138098 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-47d84068-2f27-4105-9ae4-58a52ed15220 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:04.138877 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-47d84068-2f27-4105-9ae4-58a52ed15220 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:04.139304 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-47d84068-2f27-4105-9ae4-58a52ed15220 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:04.256647 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-47d84068-2f27-4105-9ae4-58a52ed15220 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:28:04.264058 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-47d84068-2f27-4105-9ae4-58a52ed15220 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.136355 Nov 01 01:28:04.264616 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 741/1424] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:28:04 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:28:04.462740 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-df7b745c-4ee4-4530-ad1d-cef1bc415715 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:28:04.463352 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-df7b745c-4ee4-4530-ad1d-cef1bc415715 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:28:04.469570 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-df7b745c-4ee4-4530-ad1d-cef1bc415715 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:04.470014 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-df7b745c-4ee4-4530-ad1d-cef1bc415715 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:04.470801 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-df7b745c-4ee4-4530-ad1d-cef1bc415715 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:04.471236 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-df7b745c-4ee4-4530-ad1d-cef1bc415715 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:04.587443 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-df7b745c-4ee4-4530-ad1d-cef1bc415715 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:28:04.595185 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-df7b745c-4ee4-4530-ad1d-cef1bc415715 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.136376 Nov 01 01:28:04.595745 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 684/1425] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:28:04 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:28:04.868200 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-9372322f-6c23-41e1-97c3-88584dbefe05 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:28:04.869104 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-9372322f-6c23-41e1-97c3-88584dbefe05 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:28:04.875314 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9372322f-6c23-41e1-97c3-88584dbefe05 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:04.875752 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9372322f-6c23-41e1-97c3-88584dbefe05 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:04.876505 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9372322f-6c23-41e1-97c3-88584dbefe05 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:04.876926 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9372322f-6c23-41e1-97c3-88584dbefe05 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:04.905180 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-9372322f-6c23-41e1-97c3-88584dbefe05 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040791 Nov 01 01:28:04.906217 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 742/1426] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:28:04 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:28:05.279783 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-2b9ccfcc-5d0a-4f39-a24d-0f59c37eaae8 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:28:05.280394 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-2b9ccfcc-5d0a-4f39-a24d-0f59c37eaae8 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:28:05.286758 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-2b9ccfcc-5d0a-4f39-a24d-0f59c37eaae8 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:05.287206 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-2b9ccfcc-5d0a-4f39-a24d-0f59c37eaae8 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:05.287959 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-2b9ccfcc-5d0a-4f39-a24d-0f59c37eaae8 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:05.288385 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-2b9ccfcc-5d0a-4f39-a24d-0f59c37eaae8 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:05.411750 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-2b9ccfcc-5d0a-4f39-a24d-0f59c37eaae8 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:28:05.418934 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-2b9ccfcc-5d0a-4f39-a24d-0f59c37eaae8 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.142893 Nov 01 01:28:05.419491 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 685/1427] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:28:05 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:28:05.612279 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-8c5e2b22-6a35-4763-9e1b-9849c7d8355c tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:28:05.612816 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-8c5e2b22-6a35-4763-9e1b-9849c7d8355c tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:28:05.619076 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8c5e2b22-6a35-4763-9e1b-9849c7d8355c tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:05.619530 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8c5e2b22-6a35-4763-9e1b-9849c7d8355c tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:05.620292 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8c5e2b22-6a35-4763-9e1b-9849c7d8355c tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:05.620725 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8c5e2b22-6a35-4763-9e1b-9849c7d8355c tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:05.737265 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-8c5e2b22-6a35-4763-9e1b-9849c7d8355c tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:28:05.744488 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-8c5e2b22-6a35-4763-9e1b-9849c7d8355c tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.135988 Nov 01 01:28:05.745048 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 743/1428] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:28:05 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:28:05.917015 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-c07b9c7e-aa64-441f-97ad-6bcd0dcacaf9 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:28:05.917850 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-c07b9c7e-aa64-441f-97ad-6bcd0dcacaf9 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:28:05.924614 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c07b9c7e-aa64-441f-97ad-6bcd0dcacaf9 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:05.925054 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c07b9c7e-aa64-441f-97ad-6bcd0dcacaf9 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:05.925807 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c07b9c7e-aa64-441f-97ad-6bcd0dcacaf9 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:05.926228 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c07b9c7e-aa64-441f-97ad-6bcd0dcacaf9 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:05.954527 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-c07b9c7e-aa64-441f-97ad-6bcd0dcacaf9 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041313 Nov 01 01:28:05.955060 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 686/1429] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:28:05 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:28:06.435548 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-231e5ccd-e23e-4b56-81d2-c5e1c1995d0e tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:28:06.436153 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-231e5ccd-e23e-4b56-81d2-c5e1c1995d0e tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:28:06.442490 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-231e5ccd-e23e-4b56-81d2-c5e1c1995d0e tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:06.442936 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-231e5ccd-e23e-4b56-81d2-c5e1c1995d0e tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:06.443695 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-231e5ccd-e23e-4b56-81d2-c5e1c1995d0e tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:06.444121 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-231e5ccd-e23e-4b56-81d2-c5e1c1995d0e tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:06.561945 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-231e5ccd-e23e-4b56-81d2-c5e1c1995d0e tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:28:06.569403 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-231e5ccd-e23e-4b56-81d2-c5e1c1995d0e tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.137523 Nov 01 01:28:06.569955 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 744/1430] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:28:06 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:28:06.761837 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-45bee017-1bb3-4f3c-8a6f-b8ed8634c379 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:28:06.762507 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-45bee017-1bb3-4f3c-8a6f-b8ed8634c379 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:28:06.768892 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-45bee017-1bb3-4f3c-8a6f-b8ed8634c379 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:06.769339 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-45bee017-1bb3-4f3c-8a6f-b8ed8634c379 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:06.770101 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-45bee017-1bb3-4f3c-8a6f-b8ed8634c379 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:06.770569 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-45bee017-1bb3-4f3c-8a6f-b8ed8634c379 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:06.889930 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-45bee017-1bb3-4f3c-8a6f-b8ed8634c379 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:28:06.897833 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-45bee017-1bb3-4f3c-8a6f-b8ed8634c379 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.139682 Nov 01 01:28:06.898401 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 687/1431] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:28:06 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:28:06.965600 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-eac29a17-a057-485b-8625-fb645ffe1ca9 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:28:06.966590 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-eac29a17-a057-485b-8625-fb645ffe1ca9 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:28:06.972366 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-eac29a17-a057-485b-8625-fb645ffe1ca9 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:06.972811 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-eac29a17-a057-485b-8625-fb645ffe1ca9 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:06.973566 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-eac29a17-a057-485b-8625-fb645ffe1ca9 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:06.973994 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-eac29a17-a057-485b-8625-fb645ffe1ca9 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:07.002314 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-eac29a17-a057-485b-8625-fb645ffe1ca9 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040389 Nov 01 01:28:07.002884 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 745/1432] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:28:06 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:28:07.585637 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-a96d10c1-7b18-4429-ac21-6cbf72fde15e tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:28:07.586278 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-a96d10c1-7b18-4429-ac21-6cbf72fde15e tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:28:07.592562 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a96d10c1-7b18-4429-ac21-6cbf72fde15e tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:07.593015 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a96d10c1-7b18-4429-ac21-6cbf72fde15e tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:07.594312 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a96d10c1-7b18-4429-ac21-6cbf72fde15e tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:07.594771 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a96d10c1-7b18-4429-ac21-6cbf72fde15e tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:07.711795 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-a96d10c1-7b18-4429-ac21-6cbf72fde15e tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:28:07.719763 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-a96d10c1-7b18-4429-ac21-6cbf72fde15e tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.137852 Nov 01 01:28:07.720326 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 688/1433] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:28:07 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:28:07.913694 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-f6df299b-7a7f-40b3-92d9-5a4553da05b5 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:28:08.046699 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-f6df299b-7a7f-40b3-92d9-5a4553da05b5 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:28:08.046699 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f6df299b-7a7f-40b3-92d9-5a4553da05b5 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:08.046699 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f6df299b-7a7f-40b3-92d9-5a4553da05b5 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:08.046699 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f6df299b-7a7f-40b3-92d9-5a4553da05b5 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:08.047481 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f6df299b-7a7f-40b3-92d9-5a4553da05b5 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:08.047584 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-77ada1c6-ec08-43bf-835c-c33c3781da30 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:28:08.047584 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-77ada1c6-ec08-43bf-835c-c33c3781da30 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:28:08.047584 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-77ada1c6-ec08-43bf-835c-c33c3781da30 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:08.047584 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-77ada1c6-ec08-43bf-835c-c33c3781da30 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:08.047956 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-77ada1c6-ec08-43bf-835c-c33c3781da30 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:08.047956 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-77ada1c6-ec08-43bf-835c-c33c3781da30 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:08.049867 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-f6df299b-7a7f-40b3-92d9-5a4553da05b5 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:28:08.052334 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-77ada1c6-ec08-43bf-835c-c33c3781da30 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043448 Nov 01 01:28:08.053125 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 689/1434] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:28:08 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:28:08.057324 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-f6df299b-7a7f-40b3-92d9-5a4553da05b5 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.147368 Nov 01 01:28:08.057865 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 746/1435] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:28:07 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:28:08.735908 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-e02e19e5-192a-4767-816b-44da2e3db21e tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:28:08.736521 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-e02e19e5-192a-4767-816b-44da2e3db21e tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:28:08.742888 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e02e19e5-192a-4767-816b-44da2e3db21e tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:08.743340 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e02e19e5-192a-4767-816b-44da2e3db21e tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:08.744106 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e02e19e5-192a-4767-816b-44da2e3db21e tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:08.744543 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e02e19e5-192a-4767-816b-44da2e3db21e tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:08.863806 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-e02e19e5-192a-4767-816b-44da2e3db21e tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:28:08.870968 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-e02e19e5-192a-4767-816b-44da2e3db21e tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.138724 Nov 01 01:28:08.871534 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 690/1436] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:28:08 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:28:09.063589 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-efb562f1-6456-49c4-a608-2316e0e07c98 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:28:09.064421 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-efb562f1-6456-49c4-a608-2316e0e07c98 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:28:09.070812 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-efb562f1-6456-49c4-a608-2316e0e07c98 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:09.071281 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-efb562f1-6456-49c4-a608-2316e0e07c98 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:09.072036 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-efb562f1-6456-49c4-a608-2316e0e07c98 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:09.072491 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-efb562f1-6456-49c4-a608-2316e0e07c98 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:09.074698 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-9d4e7d64-548f-4009-8464-33f74c404afc tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:28:09.075287 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-9d4e7d64-548f-4009-8464-33f74c404afc tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:28:09.081530 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9d4e7d64-548f-4009-8464-33f74c404afc tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:09.081977 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9d4e7d64-548f-4009-8464-33f74c404afc tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:09.082900 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9d4e7d64-548f-4009-8464-33f74c404afc tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:09.083342 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9d4e7d64-548f-4009-8464-33f74c404afc tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:09.102066 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-efb562f1-6456-49c4-a608-2316e0e07c98 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042270 Nov 01 01:28:09.102636 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 747/1437] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:28:09 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:28:09.201876 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-9d4e7d64-548f-4009-8464-33f74c404afc tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:28:09.209129 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-9d4e7d64-548f-4009-8464-33f74c404afc tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.138063 Nov 01 01:28:09.209693 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 691/1438] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:28:09 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:28:09.887638 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-589ffc1e-64f4-4266-897d-33ac6b485de9 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:28:09.888244 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-589ffc1e-64f4-4266-897d-33ac6b485de9 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:28:09.894666 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-589ffc1e-64f4-4266-897d-33ac6b485de9 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:09.895112 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-589ffc1e-64f4-4266-897d-33ac6b485de9 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:09.895871 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-589ffc1e-64f4-4266-897d-33ac6b485de9 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:09.896299 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-589ffc1e-64f4-4266-897d-33ac6b485de9 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:10.011803 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-589ffc1e-64f4-4266-897d-33ac6b485de9 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:28:10.019516 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-589ffc1e-64f4-4266-897d-33ac6b485de9 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.135555 Nov 01 01:28:10.020074 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 748/1439] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:28:09 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:28:10.112913 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-a2416d35-9a4e-4da8-a5f1-2c59cd7d41cd tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:28:10.113825 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-a2416d35-9a4e-4da8-a5f1-2c59cd7d41cd tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:28:10.120033 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a2416d35-9a4e-4da8-a5f1-2c59cd7d41cd tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:10.120472 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a2416d35-9a4e-4da8-a5f1-2c59cd7d41cd tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:10.121221 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a2416d35-9a4e-4da8-a5f1-2c59cd7d41cd tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:10.121648 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a2416d35-9a4e-4da8-a5f1-2c59cd7d41cd tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:10.150477 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-a2416d35-9a4e-4da8-a5f1-2c59cd7d41cd tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041187 Nov 01 01:28:10.150948 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 692/1440] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:28:10 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:28:10.225962 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-a92feaf2-e8aa-47e8-b3c6-2d07f8297ce9 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:28:10.226587 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-a92feaf2-e8aa-47e8-b3c6-2d07f8297ce9 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:28:10.232911 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a92feaf2-e8aa-47e8-b3c6-2d07f8297ce9 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:10.233349 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a92feaf2-e8aa-47e8-b3c6-2d07f8297ce9 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:10.234747 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a92feaf2-e8aa-47e8-b3c6-2d07f8297ce9 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:10.235175 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a92feaf2-e8aa-47e8-b3c6-2d07f8297ce9 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:10.354490 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-a92feaf2-e8aa-47e8-b3c6-2d07f8297ce9 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:28:10.362163 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-a92feaf2-e8aa-47e8-b3c6-2d07f8297ce9 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.139829 Nov 01 01:28:10.362754 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 749/1441] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:28:10 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:28:11.036549 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-0597f0b5-21d0-4083-bf07-376fae242b59 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:28:11.037156 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-0597f0b5-21d0-4083-bf07-376fae242b59 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:28:11.043150 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0597f0b5-21d0-4083-bf07-376fae242b59 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:11.043596 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0597f0b5-21d0-4083-bf07-376fae242b59 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:11.044350 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0597f0b5-21d0-4083-bf07-376fae242b59 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:11.044788 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0597f0b5-21d0-4083-bf07-376fae242b59 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:11.162230 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-59593dc8-324c-4cc7-b23f-747c3f98926f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:28:11.163318 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-59593dc8-324c-4cc7-b23f-747c3f98926f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:28:11.164051 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-0597f0b5-21d0-4083-bf07-376fae242b59 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:28:11.169194 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-59593dc8-324c-4cc7-b23f-747c3f98926f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:11.169640 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-59593dc8-324c-4cc7-b23f-747c3f98926f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:11.170459 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-59593dc8-324c-4cc7-b23f-747c3f98926f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:11.170894 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-59593dc8-324c-4cc7-b23f-747c3f98926f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:11.171388 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-0597f0b5-21d0-4083-bf07-376fae242b59 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.138560 Nov 01 01:28:11.171962 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 693/1442] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:28:11 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:28:11.198709 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-59593dc8-324c-4cc7-b23f-747c3f98926f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040226 Nov 01 01:28:11.199257 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 750/1443] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:28:11 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 01 01:28:11.379337 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-b0b245e1-181f-4323-a151-f7d36c841e45 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:28:11.379943 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-b0b245e1-181f-4323-a151-f7d36c841e45 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:28:11.385902 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b0b245e1-181f-4323-a151-f7d36c841e45 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:11.386380 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b0b245e1-181f-4323-a151-f7d36c841e45 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:11.387168 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b0b245e1-181f-4323-a151-f7d36c841e45 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:11.387599 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b0b245e1-181f-4323-a151-f7d36c841e45 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:11.506409 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-b0b245e1-181f-4323-a151-f7d36c841e45 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:28:11.513820 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-b0b245e1-181f-4323-a151-f7d36c841e45 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.138148 Nov 01 01:28:11.514385 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 694/1444] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:28:11 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:28:12.187915 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-7bf28f22-1eb9-4645-97fd-ed080045e359 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:28:12.188515 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-7bf28f22-1eb9-4645-97fd-ed080045e359 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:28:12.194756 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7bf28f22-1eb9-4645-97fd-ed080045e359 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:12.195198 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7bf28f22-1eb9-4645-97fd-ed080045e359 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:12.195942 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7bf28f22-1eb9-4645-97fd-ed080045e359 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:12.196466 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7bf28f22-1eb9-4645-97fd-ed080045e359 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:12.209686 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-977d3729-06ef-40d9-ab63-96c5cd4006f4 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:28:12.210622 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-977d3729-06ef-40d9-ab63-96c5cd4006f4 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:28:12.216844 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-977d3729-06ef-40d9-ab63-96c5cd4006f4 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:12.217280 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-977d3729-06ef-40d9-ab63-96c5cd4006f4 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:12.218545 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-977d3729-06ef-40d9-ab63-96c5cd4006f4 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:12.218980 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-977d3729-06ef-40d9-ab63-96c5cd4006f4 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:12.248413 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-977d3729-06ef-40d9-ab63-96c5cd4006f4 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042384 Nov 01 01:28:12.248971 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 695/1445] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:28:12 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 01 01:28:12.318365 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-7bf28f22-1eb9-4645-97fd-ed080045e359 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:28:12.325620 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-7bf28f22-1eb9-4645-97fd-ed080045e359 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.141348 Nov 01 01:28:12.326188 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 751/1446] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:28:12 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:28:12.531458 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-8e282812-0d72-4b60-81bc-25ce7ed2f399 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:28:12.532060 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-8e282812-0d72-4b60-81bc-25ce7ed2f399 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:28:12.537801 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8e282812-0d72-4b60-81bc-25ce7ed2f399 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:12.538239 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8e282812-0d72-4b60-81bc-25ce7ed2f399 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:12.539021 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8e282812-0d72-4b60-81bc-25ce7ed2f399 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:12.539445 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8e282812-0d72-4b60-81bc-25ce7ed2f399 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:12.657363 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-8e282812-0d72-4b60-81bc-25ce7ed2f399 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:28:12.664571 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-8e282812-0d72-4b60-81bc-25ce7ed2f399 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.137301 Nov 01 01:28:12.665123 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 696/1447] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:28:12 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:28:13.260011 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-cde1bfd8-430a-4bbd-8a2e-0d143577e098 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:28:13.260934 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-cde1bfd8-430a-4bbd-8a2e-0d143577e098 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:28:13.267243 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-cde1bfd8-430a-4bbd-8a2e-0d143577e098 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:13.267685 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-cde1bfd8-430a-4bbd-8a2e-0d143577e098 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:13.268438 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-cde1bfd8-430a-4bbd-8a2e-0d143577e098 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:13.268864 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-cde1bfd8-430a-4bbd-8a2e-0d143577e098 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:13.298050 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-cde1bfd8-430a-4bbd-8a2e-0d143577e098 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041737 Nov 01 01:28:13.298621 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 752/1448] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:28:13 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:28:13.341899 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-44b6fd87-24de-4af0-97a9-efdf8d67d843 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:28:13.342545 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-44b6fd87-24de-4af0-97a9-efdf8d67d843 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:28:13.348812 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-44b6fd87-24de-4af0-97a9-efdf8d67d843 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:13.349251 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-44b6fd87-24de-4af0-97a9-efdf8d67d843 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:13.350015 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-44b6fd87-24de-4af0-97a9-efdf8d67d843 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:13.350463 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-44b6fd87-24de-4af0-97a9-efdf8d67d843 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:13.471200 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-44b6fd87-24de-4af0-97a9-efdf8d67d843 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:28:13.478296 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-44b6fd87-24de-4af0-97a9-efdf8d67d843 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.139982 Nov 01 01:28:13.479144 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 697/1449] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:28:13 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:28:13.680610 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-913dc8e1-fa33-4b25-9d0a-890f9a96c97e tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:28:13.681209 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-913dc8e1-fa33-4b25-9d0a-890f9a96c97e tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:28:13.687361 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-913dc8e1-fa33-4b25-9d0a-890f9a96c97e tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:13.687807 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-913dc8e1-fa33-4b25-9d0a-890f9a96c97e tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:13.688564 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-913dc8e1-fa33-4b25-9d0a-890f9a96c97e tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:13.688994 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-913dc8e1-fa33-4b25-9d0a-890f9a96c97e tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:13.807328 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-913dc8e1-fa33-4b25-9d0a-890f9a96c97e tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:28:13.815098 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-913dc8e1-fa33-4b25-9d0a-890f9a96c97e tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.138054 Nov 01 01:28:13.815653 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 753/1450] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:28:13 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:28:14.308971 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-8d95b289-2012-46c0-870f-b3a5df66eb1f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:28:14.309885 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-8d95b289-2012-46c0-870f-b3a5df66eb1f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:28:14.316322 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8d95b289-2012-46c0-870f-b3a5df66eb1f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:14.316762 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8d95b289-2012-46c0-870f-b3a5df66eb1f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:14.317523 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8d95b289-2012-46c0-870f-b3a5df66eb1f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:14.317947 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8d95b289-2012-46c0-870f-b3a5df66eb1f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:14.347470 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-8d95b289-2012-46c0-870f-b3a5df66eb1f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042264 Nov 01 01:28:14.348135 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 698/1451] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:28:14 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:28:14.496614 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-aad40079-ccf0-40cb-9ccc-f822a94476a8 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:28:14.497303 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-aad40079-ccf0-40cb-9ccc-f822a94476a8 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:28:14.503429 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-aad40079-ccf0-40cb-9ccc-f822a94476a8 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:14.503879 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-aad40079-ccf0-40cb-9ccc-f822a94476a8 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:14.504650 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-aad40079-ccf0-40cb-9ccc-f822a94476a8 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:14.505085 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-aad40079-ccf0-40cb-9ccc-f822a94476a8 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:14.621860 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-aad40079-ccf0-40cb-9ccc-f822a94476a8 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:28:14.629135 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-aad40079-ccf0-40cb-9ccc-f822a94476a8 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.136941 Nov 01 01:28:14.629693 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 754/1452] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:28:14 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:28:14.832276 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-43898746-6187-4456-a228-607fecc88ad1 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:28:14.832873 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-43898746-6187-4456-a228-607fecc88ad1 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:28:14.838743 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-43898746-6187-4456-a228-607fecc88ad1 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:14.839181 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-43898746-6187-4456-a228-607fecc88ad1 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:14.839929 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-43898746-6187-4456-a228-607fecc88ad1 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:14.840352 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-43898746-6187-4456-a228-607fecc88ad1 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:14.958460 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-43898746-6187-4456-a228-607fecc88ad1 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:28:14.965584 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-43898746-6187-4456-a228-607fecc88ad1 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.136991 Nov 01 01:28:14.966135 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 699/1453] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:28:14 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:28:15.358629 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-e890c409-0c0b-41d8-ac31-d3770399df13 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:28:15.359539 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-e890c409-0c0b-41d8-ac31-d3770399df13 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:28:15.365348 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e890c409-0c0b-41d8-ac31-d3770399df13 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:15.365790 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e890c409-0c0b-41d8-ac31-d3770399df13 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:15.366849 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e890c409-0c0b-41d8-ac31-d3770399df13 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:15.367244 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e890c409-0c0b-41d8-ac31-d3770399df13 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:15.400138 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-e890c409-0c0b-41d8-ac31-d3770399df13 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045222 Nov 01 01:28:15.400689 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 755/1454] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:28:15 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:28:15.645844 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-aeae027d-c91f-4620-85dc-bc5eb9ac1b34 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:28:15.646375 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-aeae027d-c91f-4620-85dc-bc5eb9ac1b34 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:28:15.652711 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-aeae027d-c91f-4620-85dc-bc5eb9ac1b34 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:15.653156 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-aeae027d-c91f-4620-85dc-bc5eb9ac1b34 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:15.653917 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-aeae027d-c91f-4620-85dc-bc5eb9ac1b34 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:15.654347 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-aeae027d-c91f-4620-85dc-bc5eb9ac1b34 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:15.774082 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-aeae027d-c91f-4620-85dc-bc5eb9ac1b34 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:28:15.781266 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-aeae027d-c91f-4620-85dc-bc5eb9ac1b34 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.139232 Nov 01 01:28:15.781827 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 700/1455] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:28:15 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:28:15.982676 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-029277d1-95b3-4350-b24c-95a040323b6c tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:28:15.983281 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-029277d1-95b3-4350-b24c-95a040323b6c tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:28:15.990180 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-029277d1-95b3-4350-b24c-95a040323b6c tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:15.990664 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-029277d1-95b3-4350-b24c-95a040323b6c tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:15.991425 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-029277d1-95b3-4350-b24c-95a040323b6c tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:15.991854 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-029277d1-95b3-4350-b24c-95a040323b6c tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:16.110574 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-029277d1-95b3-4350-b24c-95a040323b6c tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:28:16.117853 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-029277d1-95b3-4350-b24c-95a040323b6c tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.139090 Nov 01 01:28:16.118404 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 756/1456] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:28:15 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:28:16.412347 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-730a6a4e-8d2a-451a-8a49-f3d7ca9bd207 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:28:16.413288 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-730a6a4e-8d2a-451a-8a49-f3d7ca9bd207 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:28:16.419181 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-730a6a4e-8d2a-451a-8a49-f3d7ca9bd207 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:16.419628 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-730a6a4e-8d2a-451a-8a49-f3d7ca9bd207 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:16.420388 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-730a6a4e-8d2a-451a-8a49-f3d7ca9bd207 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:16.420817 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-730a6a4e-8d2a-451a-8a49-f3d7ca9bd207 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:16.448716 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-730a6a4e-8d2a-451a-8a49-f3d7ca9bd207 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040198 Nov 01 01:28:16.449254 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 701/1457] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:28:16 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:28:16.797813 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-f8e9bed9-d6b4-4d8e-a2dd-d8144bae6b5d tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:28:16.798416 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-f8e9bed9-d6b4-4d8e-a2dd-d8144bae6b5d tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:28:16.804231 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f8e9bed9-d6b4-4d8e-a2dd-d8144bae6b5d tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:16.804677 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f8e9bed9-d6b4-4d8e-a2dd-d8144bae6b5d tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:16.805432 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f8e9bed9-d6b4-4d8e-a2dd-d8144bae6b5d tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:16.805866 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f8e9bed9-d6b4-4d8e-a2dd-d8144bae6b5d tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:16.921993 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-f8e9bed9-d6b4-4d8e-a2dd-d8144bae6b5d tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:28:16.929108 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-f8e9bed9-d6b4-4d8e-a2dd-d8144bae6b5d tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.135039 Nov 01 01:28:16.929666 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 757/1458] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:28:16 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:28:17.134577 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-49e1a1c1-52cd-4d71-b7ac-d8adda77412c tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:28:17.135099 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-49e1a1c1-52cd-4d71-b7ac-d8adda77412c tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:28:17.141165 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-49e1a1c1-52cd-4d71-b7ac-d8adda77412c tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:17.141606 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-49e1a1c1-52cd-4d71-b7ac-d8adda77412c tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:17.142361 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-49e1a1c1-52cd-4d71-b7ac-d8adda77412c tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:17.142815 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-49e1a1c1-52cd-4d71-b7ac-d8adda77412c tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:17.261788 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-49e1a1c1-52cd-4d71-b7ac-d8adda77412c tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:28:17.269083 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-49e1a1c1-52cd-4d71-b7ac-d8adda77412c tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.138399 Nov 01 01:28:17.269634 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 702/1459] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:28:17 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:28:17.460486 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-7030fa2d-fdb5-4ca3-a191-8f8f1d2bd19f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:28:17.461427 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-7030fa2d-fdb5-4ca3-a191-8f8f1d2bd19f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:28:17.467619 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7030fa2d-fdb5-4ca3-a191-8f8f1d2bd19f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:17.468565 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7030fa2d-fdb5-4ca3-a191-8f8f1d2bd19f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:17.469316 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7030fa2d-fdb5-4ca3-a191-8f8f1d2bd19f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:17.469736 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7030fa2d-fdb5-4ca3-a191-8f8f1d2bd19f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:17.498396 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-7030fa2d-fdb5-4ca3-a191-8f8f1d2bd19f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041692 Nov 01 01:28:17.499059 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 758/1460] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:28:17 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:28:17.945489 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-d184daf0-7c39-4b46-a7ea-176d958f6ad5 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:28:17.946102 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-d184daf0-7c39-4b46-a7ea-176d958f6ad5 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:28:17.952017 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d184daf0-7c39-4b46-a7ea-176d958f6ad5 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:17.952975 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d184daf0-7c39-4b46-a7ea-176d958f6ad5 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:17.953719 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d184daf0-7c39-4b46-a7ea-176d958f6ad5 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:17.954149 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d184daf0-7c39-4b46-a7ea-176d958f6ad5 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:18.075528 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-d184daf0-7c39-4b46-a7ea-176d958f6ad5 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:28:18.083151 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-d184daf0-7c39-4b46-a7ea-176d958f6ad5 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.141337 Nov 01 01:28:18.083707 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 703/1461] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:28:17 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:28:18.286020 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-0eec018f-5098-4585-87b7-0643533421c9 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:28:18.286597 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-0eec018f-5098-4585-87b7-0643533421c9 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:28:18.292375 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0eec018f-5098-4585-87b7-0643533421c9 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:18.292819 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0eec018f-5098-4585-87b7-0643533421c9 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:18.293575 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0eec018f-5098-4585-87b7-0643533421c9 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:18.294003 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0eec018f-5098-4585-87b7-0643533421c9 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:18.411558 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-0eec018f-5098-4585-87b7-0643533421c9 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:28:18.418711 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-0eec018f-5098-4585-87b7-0643533421c9 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.136348 Nov 01 01:28:18.419277 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 759/1462] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:28:18 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:28:18.509723 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-0ab926ff-deab-4230-81ff-cb1544e372bb tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:28:18.510660 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-0ab926ff-deab-4230-81ff-cb1544e372bb tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:28:18.516957 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0ab926ff-deab-4230-81ff-cb1544e372bb tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:18.517401 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0ab926ff-deab-4230-81ff-cb1544e372bb tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:18.518155 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0ab926ff-deab-4230-81ff-cb1544e372bb tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:18.518675 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0ab926ff-deab-4230-81ff-cb1544e372bb tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:18.547423 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-0ab926ff-deab-4230-81ff-cb1544e372bb tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041521 Nov 01 01:28:18.547894 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 704/1463] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:28:18 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:28:19.099883 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-3670e7df-3eca-4029-8236-a725a3cc855c tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:28:19.100494 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-3670e7df-3eca-4029-8236-a725a3cc855c tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:28:19.107152 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3670e7df-3eca-4029-8236-a725a3cc855c tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:19.107582 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3670e7df-3eca-4029-8236-a725a3cc855c tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:19.109629 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3670e7df-3eca-4029-8236-a725a3cc855c tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:19.110099 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3670e7df-3eca-4029-8236-a725a3cc855c tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:19.234707 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-3670e7df-3eca-4029-8236-a725a3cc855c tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:28:19.241962 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-3670e7df-3eca-4029-8236-a725a3cc855c tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.145884 Nov 01 01:28:19.242560 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 760/1464] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:28:19 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:28:19.435245 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-8c7b81e8-8614-4d75-822c-a7e3478f686d tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:28:19.435857 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-8c7b81e8-8614-4d75-822c-a7e3478f686d tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:28:19.441579 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8c7b81e8-8614-4d75-822c-a7e3478f686d tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:19.442085 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8c7b81e8-8614-4d75-822c-a7e3478f686d tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:19.442886 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8c7b81e8-8614-4d75-822c-a7e3478f686d tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:19.443330 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8c7b81e8-8614-4d75-822c-a7e3478f686d tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:19.558670 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-e0c0ef44-d1f9-4190-af55-92ec233519e7 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:28:19.559586 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-e0c0ef44-d1f9-4190-af55-92ec233519e7 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:28:19.565225 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-8c7b81e8-8614-4d75-822c-a7e3478f686d tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:28:19.565944 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e0c0ef44-d1f9-4190-af55-92ec233519e7 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:19.566390 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e0c0ef44-d1f9-4190-af55-92ec233519e7 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:19.567193 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e0c0ef44-d1f9-4190-af55-92ec233519e7 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:19.567622 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e0c0ef44-d1f9-4190-af55-92ec233519e7 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:19.572620 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-8c7b81e8-8614-4d75-822c-a7e3478f686d tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.140999 Nov 01 01:28:19.573179 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 705/1465] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:28:19 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:28:19.597050 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-e0c0ef44-d1f9-4190-af55-92ec233519e7 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042201 Nov 01 01:28:19.597592 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 761/1466] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:28:19 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 01 01:28:20.258482 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-107b3d76-60b9-4205-bba0-ec727bed637d tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:28:20.259101 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-107b3d76-60b9-4205-bba0-ec727bed637d tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:28:20.264928 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-107b3d76-60b9-4205-bba0-ec727bed637d tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:20.265376 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-107b3d76-60b9-4205-bba0-ec727bed637d tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:20.266133 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-107b3d76-60b9-4205-bba0-ec727bed637d tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:20.266599 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-107b3d76-60b9-4205-bba0-ec727bed637d tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:20.387096 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-107b3d76-60b9-4205-bba0-ec727bed637d tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:28:20.394313 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-107b3d76-60b9-4205-bba0-ec727bed637d tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.139554 Nov 01 01:28:20.394906 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 706/1467] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:28:20 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:28:20.589893 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-c70e3d69-26fc-4d7b-98e9-6d43d769bc7b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:28:20.590569 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-c70e3d69-26fc-4d7b-98e9-6d43d769bc7b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:28:20.597250 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c70e3d69-26fc-4d7b-98e9-6d43d769bc7b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:20.597685 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c70e3d69-26fc-4d7b-98e9-6d43d769bc7b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:20.598450 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c70e3d69-26fc-4d7b-98e9-6d43d769bc7b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:20.598879 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c70e3d69-26fc-4d7b-98e9-6d43d769bc7b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:20.608417 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-fc581e03-2e0c-4864-9c8a-2aa437f5217a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:28:20.609988 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-fc581e03-2e0c-4864-9c8a-2aa437f5217a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:28:20.616497 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-fc581e03-2e0c-4864-9c8a-2aa437f5217a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:20.616877 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-fc581e03-2e0c-4864-9c8a-2aa437f5217a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:20.617638 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-fc581e03-2e0c-4864-9c8a-2aa437f5217a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:20.618056 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-fc581e03-2e0c-4864-9c8a-2aa437f5217a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:20.647244 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-fc581e03-2e0c-4864-9c8a-2aa437f5217a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042771 Nov 01 01:28:20.647921 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 707/1468] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:28:20 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:28:20.722443 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-c70e3d69-26fc-4d7b-98e9-6d43d769bc7b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:28:20.729915 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-c70e3d69-26fc-4d7b-98e9-6d43d769bc7b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.143739 Nov 01 01:28:20.730498 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 762/1469] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:28:20 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:28:21.410805 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-c1d8babc-8e9e-40dd-a753-bf4ab27ba729 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:28:21.411408 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-c1d8babc-8e9e-40dd-a753-bf4ab27ba729 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:28:21.417368 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c1d8babc-8e9e-40dd-a753-bf4ab27ba729 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:21.417813 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c1d8babc-8e9e-40dd-a753-bf4ab27ba729 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:21.418607 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c1d8babc-8e9e-40dd-a753-bf4ab27ba729 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:21.419036 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c1d8babc-8e9e-40dd-a753-bf4ab27ba729 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:21.538521 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-c1d8babc-8e9e-40dd-a753-bf4ab27ba729 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:28:21.546453 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-c1d8babc-8e9e-40dd-a753-bf4ab27ba729 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.138725 Nov 01 01:28:21.547044 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 708/1470] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:28:21 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:28:21.659437 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-56ec160f-eb70-4c5a-8e8c-eac3c149784a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:28:21.660264 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-56ec160f-eb70-4c5a-8e8c-eac3c149784a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:28:21.666477 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-56ec160f-eb70-4c5a-8e8c-eac3c149784a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:21.666923 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-56ec160f-eb70-4c5a-8e8c-eac3c149784a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:21.667676 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-56ec160f-eb70-4c5a-8e8c-eac3c149784a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:21.668102 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-56ec160f-eb70-4c5a-8e8c-eac3c149784a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:21.695336 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-56ec160f-eb70-4c5a-8e8c-eac3c149784a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040399 Nov 01 01:28:21.695867 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 763/1471] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:28:21 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:28:21.746454 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-a6884985-b3cb-4c2b-9ee4-9d1d6d5b041d tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:28:21.747119 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-a6884985-b3cb-4c2b-9ee4-9d1d6d5b041d tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:28:21.753336 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a6884985-b3cb-4c2b-9ee4-9d1d6d5b041d tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:21.753778 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a6884985-b3cb-4c2b-9ee4-9d1d6d5b041d tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:21.754566 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a6884985-b3cb-4c2b-9ee4-9d1d6d5b041d tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:21.754998 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a6884985-b3cb-4c2b-9ee4-9d1d6d5b041d tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:21.872245 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-a6884985-b3cb-4c2b-9ee4-9d1d6d5b041d tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:28:21.879976 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-a6884985-b3cb-4c2b-9ee4-9d1d6d5b041d tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.137172 Nov 01 01:28:21.880539 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 709/1472] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:28:21 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:28:22.563857 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-55674f25-53ac-4509-9413-78b714cdb90f tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:28:22.564466 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-55674f25-53ac-4509-9413-78b714cdb90f tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:28:22.570270 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-55674f25-53ac-4509-9413-78b714cdb90f tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:22.570754 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-55674f25-53ac-4509-9413-78b714cdb90f tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:22.571507 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-55674f25-53ac-4509-9413-78b714cdb90f tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:22.571935 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-55674f25-53ac-4509-9413-78b714cdb90f tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:22.691093 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-55674f25-53ac-4509-9413-78b714cdb90f tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:28:22.698256 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-55674f25-53ac-4509-9413-78b714cdb90f tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.138700 Nov 01 01:28:22.698849 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 764/1473] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:28:22 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:28:22.706796 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-ed2802d8-4572-44a5-980d-dd4bac2befe7 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:28:22.707708 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-ed2802d8-4572-44a5-980d-dd4bac2befe7 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:28:22.713510 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ed2802d8-4572-44a5-980d-dd4bac2befe7 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:22.713947 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ed2802d8-4572-44a5-980d-dd4bac2befe7 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:22.714723 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ed2802d8-4572-44a5-980d-dd4bac2befe7 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:22.715148 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ed2802d8-4572-44a5-980d-dd4bac2befe7 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:22.745899 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-ed2802d8-4572-44a5-980d-dd4bac2befe7 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042987 Nov 01 01:28:22.746465 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 710/1474] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:28:22 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:28:22.896122 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-a2fa87b3-20a1-446a-a634-7bb24c5cf4c3 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:28:22.896784 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-a2fa87b3-20a1-446a-a634-7bb24c5cf4c3 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:28:22.902562 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a2fa87b3-20a1-446a-a634-7bb24c5cf4c3 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:22.903010 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a2fa87b3-20a1-446a-a634-7bb24c5cf4c3 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:22.903769 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a2fa87b3-20a1-446a-a634-7bb24c5cf4c3 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:22.904201 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a2fa87b3-20a1-446a-a634-7bb24c5cf4c3 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:23.024909 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-a2fa87b3-20a1-446a-a634-7bb24c5cf4c3 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:28:23.032741 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-a2fa87b3-20a1-446a-a634-7bb24c5cf4c3 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.140260 Nov 01 01:28:23.033307 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 765/1475] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:28:22 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:28:23.714795 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-71884daa-d935-42fb-85f9-b9765fe6b917 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:28:23.715409 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-71884daa-d935-42fb-85f9-b9765fe6b917 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:28:23.722221 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-71884daa-d935-42fb-85f9-b9765fe6b917 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:23.722707 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-71884daa-d935-42fb-85f9-b9765fe6b917 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:23.723485 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-71884daa-d935-42fb-85f9-b9765fe6b917 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:23.723915 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-71884daa-d935-42fb-85f9-b9765fe6b917 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:23.757637 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-750fbe73-c587-43ec-a9bb-ed4d91c3bfa7 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:28:23.758589 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-750fbe73-c587-43ec-a9bb-ed4d91c3bfa7 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:28:23.765576 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-750fbe73-c587-43ec-a9bb-ed4d91c3bfa7 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:23.766028 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-750fbe73-c587-43ec-a9bb-ed4d91c3bfa7 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:23.766836 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-750fbe73-c587-43ec-a9bb-ed4d91c3bfa7 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:23.767268 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-750fbe73-c587-43ec-a9bb-ed4d91c3bfa7 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:23.796506 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-750fbe73-c587-43ec-a9bb-ed4d91c3bfa7 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043257 Nov 01 01:28:23.797068 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 766/1476] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:28:23 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 01 01:28:23.841583 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-71884daa-d935-42fb-85f9-b9765fe6b917 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:28:23.849312 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-71884daa-d935-42fb-85f9-b9765fe6b917 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.138205 Nov 01 01:28:23.849878 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 711/1477] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:28:23 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:28:24.060745 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-2302ffee-acba-44dd-a5d5-db3abecdd689 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:28:24.061268 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-2302ffee-acba-44dd-a5d5-db3abecdd689 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:28:24.067437 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2302ffee-acba-44dd-a5d5-db3abecdd689 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:24.067874 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2302ffee-acba-44dd-a5d5-db3abecdd689 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:24.068624 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2302ffee-acba-44dd-a5d5-db3abecdd689 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:24.069048 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2302ffee-acba-44dd-a5d5-db3abecdd689 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:24.188695 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-2302ffee-acba-44dd-a5d5-db3abecdd689 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:28:24.196030 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-2302ffee-acba-44dd-a5d5-db3abecdd689 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.138965 Nov 01 01:28:24.196583 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 767/1478] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:28:24 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:28:24.807773 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-a51e426b-7dfc-49b6-9242-d3d6c53b6e40 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:28:24.808688 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-a51e426b-7dfc-49b6-9242-d3d6c53b6e40 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:28:24.815793 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a51e426b-7dfc-49b6-9242-d3d6c53b6e40 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:24.816232 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a51e426b-7dfc-49b6-9242-d3d6c53b6e40 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:24.816990 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a51e426b-7dfc-49b6-9242-d3d6c53b6e40 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:24.817416 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a51e426b-7dfc-49b6-9242-d3d6c53b6e40 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:24.845704 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-a51e426b-7dfc-49b6-9242-d3d6c53b6e40 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041732 Nov 01 01:28:24.846242 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 712/1479] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:28:24 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:28:24.865138 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-beb2feb1-c201-4a2d-9e46-18670d9103ff tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:28:24.865792 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-beb2feb1-c201-4a2d-9e46-18670d9103ff tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:28:24.871989 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-beb2feb1-c201-4a2d-9e46-18670d9103ff tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:24.872431 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-beb2feb1-c201-4a2d-9e46-18670d9103ff tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:24.873184 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-beb2feb1-c201-4a2d-9e46-18670d9103ff tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:24.873641 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-beb2feb1-c201-4a2d-9e46-18670d9103ff tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:24.993550 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-beb2feb1-c201-4a2d-9e46-18670d9103ff tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:28:25.000837 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-beb2feb1-c201-4a2d-9e46-18670d9103ff tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.139380 Nov 01 01:28:25.001395 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 768/1480] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:28:24 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:28:25.213373 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-b411e8a9-12a3-43cd-83c9-640eef805786 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:28:25.213976 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-b411e8a9-12a3-43cd-83c9-640eef805786 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:28:25.220354 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b411e8a9-12a3-43cd-83c9-640eef805786 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:25.225271 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b411e8a9-12a3-43cd-83c9-640eef805786 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:25.225271 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b411e8a9-12a3-43cd-83c9-640eef805786 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:25.225271 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b411e8a9-12a3-43cd-83c9-640eef805786 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:25.339741 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-b411e8a9-12a3-43cd-83c9-640eef805786 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:28:25.347675 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-b411e8a9-12a3-43cd-83c9-640eef805786 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.138073 Nov 01 01:28:25.348463 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 713/1481] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:28:25 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:28:25.857274 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-18a6a74b-a639-4957-9d10-d1fc30072855 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:28:25.858185 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-18a6a74b-a639-4957-9d10-d1fc30072855 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:28:25.864035 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-18a6a74b-a639-4957-9d10-d1fc30072855 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:25.864487 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-18a6a74b-a639-4957-9d10-d1fc30072855 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:25.865238 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-18a6a74b-a639-4957-9d10-d1fc30072855 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:25.865768 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-18a6a74b-a639-4957-9d10-d1fc30072855 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:25.964436 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-18a6a74b-a639-4957-9d10-d1fc30072855 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "POST /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/action" status: 200 len: 90422 microversion: 2.1 time: 0.111031 Nov 01 01:28:25.965071 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 769/1482] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Nov 1 01:28:25 2021] POST /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb/action => generated 90422 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 01 01:28:26.019764 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-3e163453-0ff3-4f61-96e2-a01a27108dda tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:28:26.020365 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-3e163453-0ff3-4f61-96e2-a01a27108dda tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:28:26.026594 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3e163453-0ff3-4f61-96e2-a01a27108dda tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:26.027035 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3e163453-0ff3-4f61-96e2-a01a27108dda tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:26.027786 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3e163453-0ff3-4f61-96e2-a01a27108dda tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:26.028213 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3e163453-0ff3-4f61-96e2-a01a27108dda tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:26.149419 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-3e163453-0ff3-4f61-96e2-a01a27108dda tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:28:26.156563 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-3e163453-0ff3-4f61-96e2-a01a27108dda tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1276 microversion: 2.1 time: 0.140435 Nov 01 01:28:26.157115 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 714/1483] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:28:26 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1276 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:28:26.172733 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-f8ba8670-6d8a-4388-841d-15e6450d91d5 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:28:26.173312 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-f8ba8670-6d8a-4388-841d-15e6450d91d5 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:28:26.180077 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f8ba8670-6d8a-4388-841d-15e6450d91d5 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:26.180520 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f8ba8670-6d8a-4388-841d-15e6450d91d5 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:26.181283 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f8ba8670-6d8a-4388-841d-15e6450d91d5 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:26.181712 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f8ba8670-6d8a-4388-841d-15e6450d91d5 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:26.206919 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-f8ba8670-6d8a-4388-841d-15e6450d91d5 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Going to try to terminate instance {{(pid=116266) delete /opt/stack/nova/nova/compute/api.py:2612}} Nov 01 01:28:26.365532 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-299d4c5f-9bc6-4989-bed7-01d72b07e5e6 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:28:26.366010 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-299d4c5f-9bc6-4989-bed7-01d72b07e5e6 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:28:26.372037 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-299d4c5f-9bc6-4989-bed7-01d72b07e5e6 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:26.372501 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-299d4c5f-9bc6-4989-bed7-01d72b07e5e6 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:26.373324 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-299d4c5f-9bc6-4989-bed7-01d72b07e5e6 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:26.373781 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-299d4c5f-9bc6-4989-bed7-01d72b07e5e6 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:26.493606 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-299d4c5f-9bc6-4989-bed7-01d72b07e5e6 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:28:26.500981 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-299d4c5f-9bc6-4989-bed7-01d72b07e5e6 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.139492 Nov 01 01:28:26.501549 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 715/1484] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:28:26 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:28:26.541434 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-f8ba8670-6d8a-4388-841d-15e6450d91d5 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "DELETE /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 204 len: 0 microversion: 2.1 time: 0.372940 Nov 01 01:28:26.541999 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 770/1485] 10.222.0.47 () {58 vars in 1238 bytes} [Mon Nov 1 01:28:26 2021] DELETE /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 01 01:28:26.550339 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-af9c013c-64d4-4a3a-ba4a-b66bff4a58cb tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:28:26.550977 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-af9c013c-64d4-4a3a-ba4a-b66bff4a58cb tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:28:26.556829 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-af9c013c-64d4-4a3a-ba4a-b66bff4a58cb tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:26.561472 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-af9c013c-64d4-4a3a-ba4a-b66bff4a58cb tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:26.561472 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-af9c013c-64d4-4a3a-ba4a-b66bff4a58cb tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:26.561472 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-af9c013c-64d4-4a3a-ba4a-b66bff4a58cb tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:26.675328 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-af9c013c-64d4-4a3a-ba4a-b66bff4a58cb tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:28:26.682378 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-af9c013c-64d4-4a3a-ba4a-b66bff4a58cb tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1264 microversion: 2.1 time: 0.135656 Nov 01 01:28:26.682971 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 716/1486] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:28:26 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1264 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:28:27.518361 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-ae76c223-c98e-49a3-83c6-30bee14fb660 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:28:27.519082 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-ae76c223-c98e-49a3-83c6-30bee14fb660 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:28:27.526005 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ae76c223-c98e-49a3-83c6-30bee14fb660 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:27.526479 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ae76c223-c98e-49a3-83c6-30bee14fb660 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:27.527251 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ae76c223-c98e-49a3-83c6-30bee14fb660 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:27.527689 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ae76c223-c98e-49a3-83c6-30bee14fb660 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:27.648125 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-ae76c223-c98e-49a3-83c6-30bee14fb660 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:28:27.655507 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-ae76c223-c98e-49a3-83c6-30bee14fb660 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.141164 Nov 01 01:28:27.656070 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 771/1487] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:28:27 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:28:27.699242 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-d9ce126f-dfd8-4266-add4-0a0bdbf1778d tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:28:27.699886 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-d9ce126f-dfd8-4266-add4-0a0bdbf1778d tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:28:27.706055 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d9ce126f-dfd8-4266-add4-0a0bdbf1778d tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:27.706528 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d9ce126f-dfd8-4266-add4-0a0bdbf1778d tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:27.707292 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d9ce126f-dfd8-4266-add4-0a0bdbf1778d tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:27.707725 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d9ce126f-dfd8-4266-add4-0a0bdbf1778d tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:27.823803 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-d9ce126f-dfd8-4266-add4-0a0bdbf1778d tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:28:27.830949 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-d9ce126f-dfd8-4266-add4-0a0bdbf1778d tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1264 microversion: 2.1 time: 0.135303 Nov 01 01:28:27.831514 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 717/1488] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:28:27 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1264 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:28:28.672132 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-9cba1e0f-93c7-4ca8-b99e-c908be61528c tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:28:28.672674 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-9cba1e0f-93c7-4ca8-b99e-c908be61528c tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:28:28.679166 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9cba1e0f-93c7-4ca8-b99e-c908be61528c tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:28.679622 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9cba1e0f-93c7-4ca8-b99e-c908be61528c tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:28.680408 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9cba1e0f-93c7-4ca8-b99e-c908be61528c tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:28.680846 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9cba1e0f-93c7-4ca8-b99e-c908be61528c tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:28.800917 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-9cba1e0f-93c7-4ca8-b99e-c908be61528c tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:28:28.808136 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-9cba1e0f-93c7-4ca8-b99e-c908be61528c tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.139745 Nov 01 01:28:28.808705 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 772/1489] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:28:28 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:28:28.847709 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-70fcaa2e-9df4-4c72-b67e-81453539bfd2 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:28:28.848330 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-70fcaa2e-9df4-4c72-b67e-81453539bfd2 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:28:28.855096 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-70fcaa2e-9df4-4c72-b67e-81453539bfd2 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:28.855543 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-70fcaa2e-9df4-4c72-b67e-81453539bfd2 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:28.856305 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-70fcaa2e-9df4-4c72-b67e-81453539bfd2 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:28.856739 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-70fcaa2e-9df4-4c72-b67e-81453539bfd2 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:28.976759 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-70fcaa2e-9df4-4c72-b67e-81453539bfd2 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:28:28.984993 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-70fcaa2e-9df4-4c72-b67e-81453539bfd2 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1264 microversion: 2.1 time: 0.140952 Nov 01 01:28:28.985578 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 718/1490] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:28:28 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1264 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:28:29.824819 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-88d047a0-7870-463f-987d-cf52f8a5f3ce tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:28:29.825421 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-88d047a0-7870-463f-987d-cf52f8a5f3ce tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:28:29.832099 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-88d047a0-7870-463f-987d-cf52f8a5f3ce tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:29.832539 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-88d047a0-7870-463f-987d-cf52f8a5f3ce tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:29.833288 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-88d047a0-7870-463f-987d-cf52f8a5f3ce tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:29.833717 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-88d047a0-7870-463f-987d-cf52f8a5f3ce tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:29.949373 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-88d047a0-7870-463f-987d-cf52f8a5f3ce tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:28:29.957156 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-88d047a0-7870-463f-987d-cf52f8a5f3ce tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.135996 Nov 01 01:28:29.965755 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 773/1491] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:28:29 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:28:30.001866 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-bf9414f3-67f3-414c-ae3f-2886adf2a9b5 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:28:30.002706 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-bf9414f3-67f3-414c-ae3f-2886adf2a9b5 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:28:30.009001 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-bf9414f3-67f3-414c-ae3f-2886adf2a9b5 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:30.009447 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-bf9414f3-67f3-414c-ae3f-2886adf2a9b5 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:30.010213 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-bf9414f3-67f3-414c-ae3f-2886adf2a9b5 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:30.010739 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-bf9414f3-67f3-414c-ae3f-2886adf2a9b5 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:30.135067 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-bf9414f3-67f3-414c-ae3f-2886adf2a9b5 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:28:30.142904 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-bf9414f3-67f3-414c-ae3f-2886adf2a9b5 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1264 microversion: 2.1 time: 0.144773 Nov 01 01:28:30.143468 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 719/1492] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:28:29 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1264 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:28:30.974136 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-6a773311-545a-49e2-9cb3-7be6c2c78ce8 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:28:30.974793 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-6a773311-545a-49e2-9cb3-7be6c2c78ce8 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:28:30.982693 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6a773311-545a-49e2-9cb3-7be6c2c78ce8 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:30.983762 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6a773311-545a-49e2-9cb3-7be6c2c78ce8 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:30.984530 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6a773311-545a-49e2-9cb3-7be6c2c78ce8 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:30.984960 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6a773311-545a-49e2-9cb3-7be6c2c78ce8 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:31.102817 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-6a773311-545a-49e2-9cb3-7be6c2c78ce8 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:28:31.111068 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-6a773311-545a-49e2-9cb3-7be6c2c78ce8 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.140544 Nov 01 01:28:31.111636 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 774/1493] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:28:30 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:28:31.160189 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-49bf20b5-b35d-4d21-9ac0-7f81964d9923 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:28:31.160800 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-49bf20b5-b35d-4d21-9ac0-7f81964d9923 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:28:31.167048 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-49bf20b5-b35d-4d21-9ac0-7f81964d9923 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:31.167495 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-49bf20b5-b35d-4d21-9ac0-7f81964d9923 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:31.168258 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-49bf20b5-b35d-4d21-9ac0-7f81964d9923 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:31.168691 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-49bf20b5-b35d-4d21-9ac0-7f81964d9923 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:31.502334 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-49bf20b5-b35d-4d21-9ac0-7f81964d9923 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:28:31.509732 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-49bf20b5-b35d-4d21-9ac0-7f81964d9923 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1264 microversion: 2.1 time: 0.353196 Nov 01 01:28:31.510304 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 720/1494] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:28:31 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1264 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:28:32.128323 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-d5fef2ef-c542-4360-bf24-531e559e69ef tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:28:32.128930 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-d5fef2ef-c542-4360-bf24-531e559e69ef tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:28:32.135110 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d5fef2ef-c542-4360-bf24-531e559e69ef tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:32.135524 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d5fef2ef-c542-4360-bf24-531e559e69ef tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:32.136278 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d5fef2ef-c542-4360-bf24-531e559e69ef tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:32.136700 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d5fef2ef-c542-4360-bf24-531e559e69ef tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:32.254161 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-d5fef2ef-c542-4360-bf24-531e559e69ef tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:28:32.261328 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-d5fef2ef-c542-4360-bf24-531e559e69ef tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.137362 Nov 01 01:28:32.261913 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 775/1495] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:28:32 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:28:32.528042 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-e468a395-6acd-4488-a0f1-621b02740f4c tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:28:32.528654 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-e468a395-6acd-4488-a0f1-621b02740f4c tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:28:32.535715 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e468a395-6acd-4488-a0f1-621b02740f4c tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:32.536185 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e468a395-6acd-4488-a0f1-621b02740f4c tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:32.536954 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e468a395-6acd-4488-a0f1-621b02740f4c tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:32.537389 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e468a395-6acd-4488-a0f1-621b02740f4c tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:32.657429 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-e468a395-6acd-4488-a0f1-621b02740f4c tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:28:32.664598 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-e468a395-6acd-4488-a0f1-621b02740f4c tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1264 microversion: 2.1 time: 0.140195 Nov 01 01:28:32.665159 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 721/1496] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:28:32 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1264 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:28:33.278089 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-585c23b8-2dc7-4c02-800b-3ad83b6b92e6 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:28:33.278711 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-585c23b8-2dc7-4c02-800b-3ad83b6b92e6 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:28:33.284894 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-585c23b8-2dc7-4c02-800b-3ad83b6b92e6 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:33.285334 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-585c23b8-2dc7-4c02-800b-3ad83b6b92e6 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:33.286086 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-585c23b8-2dc7-4c02-800b-3ad83b6b92e6 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:33.286534 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-585c23b8-2dc7-4c02-800b-3ad83b6b92e6 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:33.403277 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-585c23b8-2dc7-4c02-800b-3ad83b6b92e6 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:28:33.411025 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-585c23b8-2dc7-4c02-800b-3ad83b6b92e6 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.136507 Nov 01 01:28:33.411598 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 776/1497] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:28:33 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:28:33.682290 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-db281cfa-dcaf-4896-9db8-e7990239e1f9 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:28:33.682922 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-db281cfa-dcaf-4896-9db8-e7990239e1f9 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:28:33.689724 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-db281cfa-dcaf-4896-9db8-e7990239e1f9 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:33.690159 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-db281cfa-dcaf-4896-9db8-e7990239e1f9 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:33.691001 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-db281cfa-dcaf-4896-9db8-e7990239e1f9 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:33.691428 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-db281cfa-dcaf-4896-9db8-e7990239e1f9 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:33.809279 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-db281cfa-dcaf-4896-9db8-e7990239e1f9 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:28:33.817282 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-db281cfa-dcaf-4896-9db8-e7990239e1f9 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1264 microversion: 2.1 time: 0.138612 Nov 01 01:28:33.817849 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 722/1498] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:28:33 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1264 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:28:34.428262 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-2950cc16-6942-4c03-b6aa-19e5a0293d23 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:28:34.428899 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-2950cc16-6942-4c03-b6aa-19e5a0293d23 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:28:34.435262 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2950cc16-6942-4c03-b6aa-19e5a0293d23 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:34.435705 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2950cc16-6942-4c03-b6aa-19e5a0293d23 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:34.436466 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2950cc16-6942-4c03-b6aa-19e5a0293d23 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:34.436895 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2950cc16-6942-4c03-b6aa-19e5a0293d23 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:34.556149 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-2950cc16-6942-4c03-b6aa-19e5a0293d23 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:28:34.563820 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-2950cc16-6942-4c03-b6aa-19e5a0293d23 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.139213 Nov 01 01:28:34.564410 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 777/1499] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:28:34 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:28:34.834044 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-f36871eb-6477-4edd-8a2c-eb3e061588b2 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:28:34.834653 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-f36871eb-6477-4edd-8a2c-eb3e061588b2 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:28:34.840823 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f36871eb-6477-4edd-8a2c-eb3e061588b2 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:34.841261 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f36871eb-6477-4edd-8a2c-eb3e061588b2 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:34.842010 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f36871eb-6477-4edd-8a2c-eb3e061588b2 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:34.842447 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f36871eb-6477-4edd-8a2c-eb3e061588b2 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:34.958786 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-f36871eb-6477-4edd-8a2c-eb3e061588b2 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:28:34.965909 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-f36871eb-6477-4edd-8a2c-eb3e061588b2 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1264 microversion: 2.1 time: 0.135477 Nov 01 01:28:34.966491 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 723/1500] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:28:34 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1264 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:28:35.580552 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-03a3affe-61df-4b4f-b5bc-f46b3e4d15fb tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:28:35.581083 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-03a3affe-61df-4b4f-b5bc-f46b3e4d15fb tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:28:35.587270 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-03a3affe-61df-4b4f-b5bc-f46b3e4d15fb tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:35.587714 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-03a3affe-61df-4b4f-b5bc-f46b3e4d15fb tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:35.588469 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-03a3affe-61df-4b4f-b5bc-f46b3e4d15fb tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:35.588899 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-03a3affe-61df-4b4f-b5bc-f46b3e4d15fb tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:35.705128 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-03a3affe-61df-4b4f-b5bc-f46b3e4d15fb tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:28:35.712271 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-03a3affe-61df-4b4f-b5bc-f46b3e4d15fb tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.135488 Nov 01 01:28:35.712835 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 778/1501] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:28:35 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:28:35.983130 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-0b577823-1ac5-4d5f-aea5-00b0faaad6b4 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:28:35.984114 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-0b577823-1ac5-4d5f-aea5-00b0faaad6b4 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:28:35.990337 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0b577823-1ac5-4d5f-aea5-00b0faaad6b4 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:35.990812 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0b577823-1ac5-4d5f-aea5-00b0faaad6b4 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:35.991592 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0b577823-1ac5-4d5f-aea5-00b0faaad6b4 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:35.992018 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0b577823-1ac5-4d5f-aea5-00b0faaad6b4 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:36.112183 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-0b577823-1ac5-4d5f-aea5-00b0faaad6b4 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:28:36.119412 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-0b577823-1ac5-4d5f-aea5-00b0faaad6b4 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1264 microversion: 2.1 time: 0.140113 Nov 01 01:28:36.119968 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 724/1502] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:28:35 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1264 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:28:36.728771 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-96d8dee2-5c23-4ffe-a121-fd24673d735b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:28:36.729372 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-96d8dee2-5c23-4ffe-a121-fd24673d735b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:28:36.736143 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-96d8dee2-5c23-4ffe-a121-fd24673d735b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:36.736582 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-96d8dee2-5c23-4ffe-a121-fd24673d735b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:36.737335 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-96d8dee2-5c23-4ffe-a121-fd24673d735b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:36.737758 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-96d8dee2-5c23-4ffe-a121-fd24673d735b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:36.855949 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-96d8dee2-5c23-4ffe-a121-fd24673d735b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:28:36.863855 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-96d8dee2-5c23-4ffe-a121-fd24673d735b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.138995 Nov 01 01:28:36.864411 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 779/1503] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:28:36 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:28:37.136678 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-8ecba731-87c3-4a65-854f-6ad6ec4b01a3 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:28:37.137209 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-8ecba731-87c3-4a65-854f-6ad6ec4b01a3 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:28:37.143371 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8ecba731-87c3-4a65-854f-6ad6ec4b01a3 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:37.143817 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8ecba731-87c3-4a65-854f-6ad6ec4b01a3 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:37.144569 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8ecba731-87c3-4a65-854f-6ad6ec4b01a3 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:37.144995 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8ecba731-87c3-4a65-854f-6ad6ec4b01a3 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:37.260591 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-8ecba731-87c3-4a65-854f-6ad6ec4b01a3 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:28:37.268392 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-8ecba731-87c3-4a65-854f-6ad6ec4b01a3 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1264 microversion: 2.1 time: 0.135459 Nov 01 01:28:37.268947 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 725/1504] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:28:37 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1264 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:28:37.880149 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-64281182-a60c-49cd-9f52-8799f512f59e tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:28:37.880757 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-64281182-a60c-49cd-9f52-8799f512f59e tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:28:37.887071 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-64281182-a60c-49cd-9f52-8799f512f59e tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:37.887516 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-64281182-a60c-49cd-9f52-8799f512f59e tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:37.888281 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-64281182-a60c-49cd-9f52-8799f512f59e tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:37.888714 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-64281182-a60c-49cd-9f52-8799f512f59e tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:38.009654 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-64281182-a60c-49cd-9f52-8799f512f59e tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:28:38.017074 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-64281182-a60c-49cd-9f52-8799f512f59e tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.140579 Nov 01 01:28:38.022610 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 780/1505] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:28:37 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:28:38.285075 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-fcd73c7c-fd1b-4093-a96e-d295b931dd65 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:28:38.285684 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-fcd73c7c-fd1b-4093-a96e-d295b931dd65 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:28:38.291909 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-fcd73c7c-fd1b-4093-a96e-d295b931dd65 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:38.292348 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-fcd73c7c-fd1b-4093-a96e-d295b931dd65 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:38.293100 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-fcd73c7c-fd1b-4093-a96e-d295b931dd65 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:38.293526 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-fcd73c7c-fd1b-4093-a96e-d295b931dd65 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:38.412736 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-fcd73c7c-fd1b-4093-a96e-d295b931dd65 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:28:38.419864 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-fcd73c7c-fd1b-4093-a96e-d295b931dd65 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1264 microversion: 2.1 time: 0.138510 Nov 01 01:28:38.421066 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 726/1506] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:28:38 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1264 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:28:39.033430 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-95176400-567c-40b4-8d20-274d75110cf7 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:28:39.034030 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-95176400-567c-40b4-8d20-274d75110cf7 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:28:39.040241 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-95176400-567c-40b4-8d20-274d75110cf7 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:39.040682 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-95176400-567c-40b4-8d20-274d75110cf7 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:39.041436 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-95176400-567c-40b4-8d20-274d75110cf7 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:39.041861 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-95176400-567c-40b4-8d20-274d75110cf7 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:39.157691 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-95176400-567c-40b4-8d20-274d75110cf7 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:28:39.164926 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-95176400-567c-40b4-8d20-274d75110cf7 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.135698 Nov 01 01:28:39.165477 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 781/1507] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:28:39 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:28:39.437541 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-87c7e1fd-a295-48a1-9cfa-7bd4b45d7fd3 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:28:39.438154 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-87c7e1fd-a295-48a1-9cfa-7bd4b45d7fd3 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:28:39.444397 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-87c7e1fd-a295-48a1-9cfa-7bd4b45d7fd3 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:39.444836 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-87c7e1fd-a295-48a1-9cfa-7bd4b45d7fd3 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:39.445589 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-87c7e1fd-a295-48a1-9cfa-7bd4b45d7fd3 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:39.446009 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-87c7e1fd-a295-48a1-9cfa-7bd4b45d7fd3 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:39.571245 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-87c7e1fd-a295-48a1-9cfa-7bd4b45d7fd3 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:28:39.578452 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-87c7e1fd-a295-48a1-9cfa-7bd4b45d7fd3 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1264 microversion: 2.1 time: 0.145115 Nov 01 01:28:39.579020 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 727/1508] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:28:39 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1264 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:28:40.180605 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-9a600fdb-437b-45a5-8ee0-776efdd35275 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:28:40.181211 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-9a600fdb-437b-45a5-8ee0-776efdd35275 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:28:40.187988 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9a600fdb-437b-45a5-8ee0-776efdd35275 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:40.188432 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9a600fdb-437b-45a5-8ee0-776efdd35275 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:40.189191 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9a600fdb-437b-45a5-8ee0-776efdd35275 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:40.189619 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9a600fdb-437b-45a5-8ee0-776efdd35275 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:40.307618 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-9a600fdb-437b-45a5-8ee0-776efdd35275 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:28:40.315467 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-9a600fdb-437b-45a5-8ee0-776efdd35275 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.138548 Nov 01 01:28:40.316029 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 782/1509] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:28:40 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:28:40.595448 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-6547c8fb-21a5-4819-9410-ac394b7ae6b4 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:28:40.596048 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-6547c8fb-21a5-4819-9410-ac394b7ae6b4 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:28:40.602206 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-6547c8fb-21a5-4819-9410-ac394b7ae6b4 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:40.602743 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-6547c8fb-21a5-4819-9410-ac394b7ae6b4 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:40.603751 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-6547c8fb-21a5-4819-9410-ac394b7ae6b4 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:40.604194 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-6547c8fb-21a5-4819-9410-ac394b7ae6b4 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:40.721216 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-6547c8fb-21a5-4819-9410-ac394b7ae6b4 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:28:40.728633 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-6547c8fb-21a5-4819-9410-ac394b7ae6b4 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1264 microversion: 2.1 time: 0.137229 Nov 01 01:28:40.729185 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 728/1510] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:28:40 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1264 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:28:41.332778 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-17fc84d3-28f8-4223-bf4a-7bcfa20137b3 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:28:41.333383 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-17fc84d3-28f8-4223-bf4a-7bcfa20137b3 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:28:41.339576 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-17fc84d3-28f8-4223-bf4a-7bcfa20137b3 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:41.340019 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-17fc84d3-28f8-4223-bf4a-7bcfa20137b3 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:41.340784 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-17fc84d3-28f8-4223-bf4a-7bcfa20137b3 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:41.341236 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-17fc84d3-28f8-4223-bf4a-7bcfa20137b3 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:41.462230 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-17fc84d3-28f8-4223-bf4a-7bcfa20137b3 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:28:41.469613 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-17fc84d3-28f8-4223-bf4a-7bcfa20137b3 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.140567 Nov 01 01:28:41.470164 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 783/1511] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:28:41 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:28:41.745499 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-f9e66639-46e1-4e1a-92e1-2c7a62e6eb77 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:28:41.746108 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-f9e66639-46e1-4e1a-92e1-2c7a62e6eb77 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:28:41.753019 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f9e66639-46e1-4e1a-92e1-2c7a62e6eb77 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:41.753464 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f9e66639-46e1-4e1a-92e1-2c7a62e6eb77 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:41.754223 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f9e66639-46e1-4e1a-92e1-2c7a62e6eb77 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:41.754755 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f9e66639-46e1-4e1a-92e1-2c7a62e6eb77 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:41.870617 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-f9e66639-46e1-4e1a-92e1-2c7a62e6eb77 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:28:41.878401 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-f9e66639-46e1-4e1a-92e1-2c7a62e6eb77 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1264 microversion: 2.1 time: 0.136555 Nov 01 01:28:41.878981 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 729/1512] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:28:41 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1264 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:28:42.485617 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-fc686523-b8f8-4fd2-ace2-a30e8171a981 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:28:42.486226 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-fc686523-b8f8-4fd2-ace2-a30e8171a981 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:28:42.492507 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-fc686523-b8f8-4fd2-ace2-a30e8171a981 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:42.492951 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-fc686523-b8f8-4fd2-ace2-a30e8171a981 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:42.493712 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-fc686523-b8f8-4fd2-ace2-a30e8171a981 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:42.494143 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-fc686523-b8f8-4fd2-ace2-a30e8171a981 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:42.610108 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-fc686523-b8f8-4fd2-ace2-a30e8171a981 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:28:42.617408 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-fc686523-b8f8-4fd2-ace2-a30e8171a981 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.135371 Nov 01 01:28:42.617914 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 784/1513] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:28:42 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:28:42.895865 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-5c5aeded-e132-45de-9e59-ab5772a0b730 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:28:42.896408 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-5c5aeded-e132-45de-9e59-ab5772a0b730 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:28:42.902783 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-5c5aeded-e132-45de-9e59-ab5772a0b730 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:42.903229 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-5c5aeded-e132-45de-9e59-ab5772a0b730 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:42.903994 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-5c5aeded-e132-45de-9e59-ab5772a0b730 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:42.904425 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-5c5aeded-e132-45de-9e59-ab5772a0b730 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:43.025777 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-5c5aeded-e132-45de-9e59-ab5772a0b730 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:28:43.033141 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-5c5aeded-e132-45de-9e59-ab5772a0b730 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1264 microversion: 2.1 time: 0.141050 Nov 01 01:28:43.033742 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 730/1514] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:28:42 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1264 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:28:43.634400 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-bbce13e8-f577-4f85-86d0-6cfd93d4ba8b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:28:43.634966 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-bbce13e8-f577-4f85-86d0-6cfd93d4ba8b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:28:43.641200 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-bbce13e8-f577-4f85-86d0-6cfd93d4ba8b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:43.641648 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-bbce13e8-f577-4f85-86d0-6cfd93d4ba8b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:43.642430 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-bbce13e8-f577-4f85-86d0-6cfd93d4ba8b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:43.642874 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-bbce13e8-f577-4f85-86d0-6cfd93d4ba8b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:43.760997 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-bbce13e8-f577-4f85-86d0-6cfd93d4ba8b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:28:43.768375 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-bbce13e8-f577-4f85-86d0-6cfd93d4ba8b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.137709 Nov 01 01:28:43.768934 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 785/1515] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:28:43 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:28:44.058031 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-9b21120b-e50d-41a9-b50e-66d24a2c1e9b tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:28:44.058715 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-9b21120b-e50d-41a9-b50e-66d24a2c1e9b tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:28:44.064908 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9b21120b-e50d-41a9-b50e-66d24a2c1e9b tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:44.065349 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9b21120b-e50d-41a9-b50e-66d24a2c1e9b tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:44.066105 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9b21120b-e50d-41a9-b50e-66d24a2c1e9b tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:44.066568 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9b21120b-e50d-41a9-b50e-66d24a2c1e9b tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:44.186123 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-9b21120b-e50d-41a9-b50e-66d24a2c1e9b tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:28:44.193265 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-9b21120b-e50d-41a9-b50e-66d24a2c1e9b tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1264 microversion: 2.1 time: 0.138870 Nov 01 01:28:44.193817 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 731/1516] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:28:44 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1264 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:28:44.785447 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-8c0b9113-e931-4d05-a3e4-cfc21451e4fc tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:28:44.786059 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-8c0b9113-e931-4d05-a3e4-cfc21451e4fc tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:28:44.792249 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8c0b9113-e931-4d05-a3e4-cfc21451e4fc tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:44.792689 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8c0b9113-e931-4d05-a3e4-cfc21451e4fc tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:44.793441 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8c0b9113-e931-4d05-a3e4-cfc21451e4fc tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:44.793868 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8c0b9113-e931-4d05-a3e4-cfc21451e4fc tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:44.914064 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-8c0b9113-e931-4d05-a3e4-cfc21451e4fc tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:28:44.921288 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-8c0b9113-e931-4d05-a3e4-cfc21451e4fc tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.139471 Nov 01 01:28:44.921843 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 786/1517] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:28:44 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:28:45.210354 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-e438196f-f623-4f00-a58f-bd334b27f6c5 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:28:45.211994 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-e438196f-f623-4f00-a58f-bd334b27f6c5 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:28:45.217204 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e438196f-f623-4f00-a58f-bd334b27f6c5 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:45.217646 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e438196f-f623-4f00-a58f-bd334b27f6c5 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:45.218494 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e438196f-f623-4f00-a58f-bd334b27f6c5 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:45.218929 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e438196f-f623-4f00-a58f-bd334b27f6c5 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:45.337033 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-e438196f-f623-4f00-a58f-bd334b27f6c5 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:28:45.344229 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-e438196f-f623-4f00-a58f-bd334b27f6c5 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1264 microversion: 2.1 time: 0.137608 Nov 01 01:28:45.344916 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 732/1518] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:28:45 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1264 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:28:45.937770 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-e5a70dd8-4ffa-4415-a339-f0a3b2b65081 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:28:45.938373 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-e5a70dd8-4ffa-4415-a339-f0a3b2b65081 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:28:45.944598 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e5a70dd8-4ffa-4415-a339-f0a3b2b65081 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:45.945036 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e5a70dd8-4ffa-4415-a339-f0a3b2b65081 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:45.945788 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e5a70dd8-4ffa-4415-a339-f0a3b2b65081 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:45.946213 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e5a70dd8-4ffa-4415-a339-f0a3b2b65081 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:46.063229 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-e5a70dd8-4ffa-4415-a339-f0a3b2b65081 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:28:46.070544 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-e5a70dd8-4ffa-4415-a339-f0a3b2b65081 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.136349 Nov 01 01:28:46.071106 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 787/1519] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:28:45 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:28:46.360707 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-b4223c82-b090-41de-88a7-f20ec471cf4d tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:28:46.361305 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-b4223c82-b090-41de-88a7-f20ec471cf4d tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:28:46.367562 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b4223c82-b090-41de-88a7-f20ec471cf4d tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:46.368011 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b4223c82-b090-41de-88a7-f20ec471cf4d tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:46.368779 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b4223c82-b090-41de-88a7-f20ec471cf4d tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:46.369210 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b4223c82-b090-41de-88a7-f20ec471cf4d tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:46.489190 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-b4223c82-b090-41de-88a7-f20ec471cf4d tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:28:46.496353 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-b4223c82-b090-41de-88a7-f20ec471cf4d tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1264 microversion: 2.1 time: 0.139447 Nov 01 01:28:46.496907 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 733/1520] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:28:46 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1264 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:28:47.087255 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-9a05c11b-7b4a-4ef1-aee7-04d5af6064ab tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:28:47.087871 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-9a05c11b-7b4a-4ef1-aee7-04d5af6064ab tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:28:47.094250 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9a05c11b-7b4a-4ef1-aee7-04d5af6064ab tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:47.094727 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9a05c11b-7b4a-4ef1-aee7-04d5af6064ab tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:47.095492 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9a05c11b-7b4a-4ef1-aee7-04d5af6064ab tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:47.095925 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9a05c11b-7b4a-4ef1-aee7-04d5af6064ab tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:47.217341 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-9a05c11b-7b4a-4ef1-aee7-04d5af6064ab tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:28:47.224573 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-9a05c11b-7b4a-4ef1-aee7-04d5af6064ab tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.140978 Nov 01 01:28:47.225131 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 788/1521] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:28:47 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:28:47.513315 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-04238f1d-c011-4c7c-bd5a-e48e93ff36fd tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:28:47.513925 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-04238f1d-c011-4c7c-bd5a-e48e93ff36fd tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:28:47.519889 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-04238f1d-c011-4c7c-bd5a-e48e93ff36fd tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:47.520300 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-04238f1d-c011-4c7c-bd5a-e48e93ff36fd tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:47.521112 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-04238f1d-c011-4c7c-bd5a-e48e93ff36fd tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:47.521550 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-04238f1d-c011-4c7c-bd5a-e48e93ff36fd tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:47.639842 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-04238f1d-c011-4c7c-bd5a-e48e93ff36fd tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:28:47.647016 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-04238f1d-c011-4c7c-bd5a-e48e93ff36fd tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1264 microversion: 2.1 time: 0.137566 Nov 01 01:28:47.647579 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 734/1522] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:28:47 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1264 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:28:48.241661 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-5ec4eb69-ab69-4019-9d6e-aedf4187cd89 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:28:48.242294 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-5ec4eb69-ab69-4019-9d6e-aedf4187cd89 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:28:48.249175 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5ec4eb69-ab69-4019-9d6e-aedf4187cd89 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:48.249620 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5ec4eb69-ab69-4019-9d6e-aedf4187cd89 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:48.250368 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5ec4eb69-ab69-4019-9d6e-aedf4187cd89 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:48.250815 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5ec4eb69-ab69-4019-9d6e-aedf4187cd89 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:48.371484 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-5ec4eb69-ab69-4019-9d6e-aedf4187cd89 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:28:48.379487 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-5ec4eb69-ab69-4019-9d6e-aedf4187cd89 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.141586 Nov 01 01:28:48.380051 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 789/1523] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:28:48 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:28:48.664539 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-a18e2d5b-95de-43ed-819f-124391752339 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:28:48.665099 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-a18e2d5b-95de-43ed-819f-124391752339 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:28:48.671808 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a18e2d5b-95de-43ed-819f-124391752339 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:48.672248 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a18e2d5b-95de-43ed-819f-124391752339 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:48.673001 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a18e2d5b-95de-43ed-819f-124391752339 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:48.673425 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a18e2d5b-95de-43ed-819f-124391752339 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:48.791287 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-a18e2d5b-95de-43ed-819f-124391752339 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:28:48.798882 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-a18e2d5b-95de-43ed-819f-124391752339 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1264 microversion: 2.1 time: 0.138067 Nov 01 01:28:48.799784 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 735/1524] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:28:48 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1264 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:28:49.396876 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-e2dd7028-09d1-4a0a-9dfb-2a6d87c8e81b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:28:49.397482 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-e2dd7028-09d1-4a0a-9dfb-2a6d87c8e81b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:28:49.403672 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e2dd7028-09d1-4a0a-9dfb-2a6d87c8e81b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:49.404120 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e2dd7028-09d1-4a0a-9dfb-2a6d87c8e81b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:49.405545 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e2dd7028-09d1-4a0a-9dfb-2a6d87c8e81b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:49.405976 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e2dd7028-09d1-4a0a-9dfb-2a6d87c8e81b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:49.522527 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-e2dd7028-09d1-4a0a-9dfb-2a6d87c8e81b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:28:49.530822 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-e2dd7028-09d1-4a0a-9dfb-2a6d87c8e81b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.137355 Nov 01 01:28:49.531798 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 790/1525] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:28:49 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:28:49.816988 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-ff368be8-8f35-47b6-bbf5-76e364c249a1 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:28:49.817534 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-ff368be8-8f35-47b6-bbf5-76e364c249a1 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:28:49.823724 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ff368be8-8f35-47b6-bbf5-76e364c249a1 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:49.824169 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ff368be8-8f35-47b6-bbf5-76e364c249a1 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:49.824933 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ff368be8-8f35-47b6-bbf5-76e364c249a1 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:49.825361 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ff368be8-8f35-47b6-bbf5-76e364c249a1 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:49.945517 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-ff368be8-8f35-47b6-bbf5-76e364c249a1 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:28:49.953413 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-ff368be8-8f35-47b6-bbf5-76e364c249a1 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1264 microversion: 2.1 time: 0.140086 Nov 01 01:28:49.953987 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 736/1526] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:28:49 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1264 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:28:50.549281 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-e1bb9518-5e51-4a20-a557-412bcdf00694 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:28:50.549889 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-e1bb9518-5e51-4a20-a557-412bcdf00694 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:28:50.556123 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e1bb9518-5e51-4a20-a557-412bcdf00694 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:50.556572 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e1bb9518-5e51-4a20-a557-412bcdf00694 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:50.557336 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e1bb9518-5e51-4a20-a557-412bcdf00694 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:50.557773 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e1bb9518-5e51-4a20-a557-412bcdf00694 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:50.675232 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-e1bb9518-5e51-4a20-a557-412bcdf00694 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:28:50.682759 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-e1bb9518-5e51-4a20-a557-412bcdf00694 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.137809 Nov 01 01:28:50.693311 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 791/1527] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:28:50 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:28:50.970467 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-32cf58f9-b07f-4d60-a8b9-97523fe8be78 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:28:50.971088 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-32cf58f9-b07f-4d60-a8b9-97523fe8be78 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:28:50.977420 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-32cf58f9-b07f-4d60-a8b9-97523fe8be78 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:50.978123 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-32cf58f9-b07f-4d60-a8b9-97523fe8be78 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:50.978928 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-32cf58f9-b07f-4d60-a8b9-97523fe8be78 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:50.979358 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-32cf58f9-b07f-4d60-a8b9-97523fe8be78 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:51.096439 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-32cf58f9-b07f-4d60-a8b9-97523fe8be78 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:28:51.103880 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-32cf58f9-b07f-4d60-a8b9-97523fe8be78 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1264 microversion: 2.1 time: 0.137608 Nov 01 01:28:51.104430 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 737/1528] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:28:50 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1264 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:28:51.699362 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-e940e85c-ac40-4cc6-80ba-20b941e063f4 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:28:51.699996 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-e940e85c-ac40-4cc6-80ba-20b941e063f4 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:28:51.706195 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e940e85c-ac40-4cc6-80ba-20b941e063f4 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:51.706782 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e940e85c-ac40-4cc6-80ba-20b941e063f4 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:51.707536 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e940e85c-ac40-4cc6-80ba-20b941e063f4 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:51.707961 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e940e85c-ac40-4cc6-80ba-20b941e063f4 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:51.827327 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-e940e85c-ac40-4cc6-80ba-20b941e063f4 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:28:51.834557 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-e940e85c-ac40-4cc6-80ba-20b941e063f4 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.138802 Nov 01 01:28:51.835111 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 792/1529] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:28:51 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:28:52.121518 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-a67843cd-3ea6-4851-8b7b-1d3532f74ee3 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:28:52.122126 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-a67843cd-3ea6-4851-8b7b-1d3532f74ee3 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:28:52.128521 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a67843cd-3ea6-4851-8b7b-1d3532f74ee3 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:52.128962 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a67843cd-3ea6-4851-8b7b-1d3532f74ee3 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:52.129717 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a67843cd-3ea6-4851-8b7b-1d3532f74ee3 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:52.130141 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a67843cd-3ea6-4851-8b7b-1d3532f74ee3 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:52.247099 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-a67843cd-3ea6-4851-8b7b-1d3532f74ee3 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:28:52.254166 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-a67843cd-3ea6-4851-8b7b-1d3532f74ee3 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1264 microversion: 2.1 time: 0.136310 Nov 01 01:28:52.254747 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 738/1530] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:28:52 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1264 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:28:52.578845 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 01 01:28:52.579089 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: Mon Nov 1 01:28:52 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 01 01:28:52.852152 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-cb599a80-df6a-4f85-a7d4-dbfc9016e60b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:28:52.852961 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-cb599a80-df6a-4f85-a7d4-dbfc9016e60b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:28:52.859785 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-cb599a80-df6a-4f85-a7d4-dbfc9016e60b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:52.860224 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-cb599a80-df6a-4f85-a7d4-dbfc9016e60b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:52.860985 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-cb599a80-df6a-4f85-a7d4-dbfc9016e60b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:52.861422 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-cb599a80-df6a-4f85-a7d4-dbfc9016e60b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:53.000915 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-cb599a80-df6a-4f85-a7d4-dbfc9016e60b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:28:53.009965 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-cb599a80-df6a-4f85-a7d4-dbfc9016e60b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.161551 Nov 01 01:28:53.010757 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 793/1531] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:28:52 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:28:53.271913 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-97a57131-cc48-4d0f-ae1e-5608f5f7b718 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:28:53.272521 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-97a57131-cc48-4d0f-ae1e-5608f5f7b718 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:28:53.278783 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-97a57131-cc48-4d0f-ae1e-5608f5f7b718 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:53.279231 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-97a57131-cc48-4d0f-ae1e-5608f5f7b718 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:53.280387 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-97a57131-cc48-4d0f-ae1e-5608f5f7b718 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:53.281156 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-97a57131-cc48-4d0f-ae1e-5608f5f7b718 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:53.421728 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-97a57131-cc48-4d0f-ae1e-5608f5f7b718 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:28:53.429117 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-97a57131-cc48-4d0f-ae1e-5608f5f7b718 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1264 microversion: 2.1 time: 0.160979 Nov 01 01:28:53.429688 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 739/1532] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:28:53 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1264 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:28:54.026752 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-b6213498-8d52-4046-90cc-84e62e1e27cb tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:28:54.027359 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-b6213498-8d52-4046-90cc-84e62e1e27cb tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:28:54.034187 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b6213498-8d52-4046-90cc-84e62e1e27cb tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:54.040035 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b6213498-8d52-4046-90cc-84e62e1e27cb tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:54.040035 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b6213498-8d52-4046-90cc-84e62e1e27cb tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:54.040035 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b6213498-8d52-4046-90cc-84e62e1e27cb tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:54.153447 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-b6213498-8d52-4046-90cc-84e62e1e27cb tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:28:54.160722 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-b6213498-8d52-4046-90cc-84e62e1e27cb tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.137617 Nov 01 01:28:54.161281 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 794/1533] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:28:54 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:28:54.449198 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-c736016f-f398-4016-8707-027b3c8a9753 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:28:54.449804 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-c736016f-f398-4016-8707-027b3c8a9753 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:28:54.456741 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c736016f-f398-4016-8707-027b3c8a9753 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:54.457189 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c736016f-f398-4016-8707-027b3c8a9753 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:54.457946 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c736016f-f398-4016-8707-027b3c8a9753 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:54.458377 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c736016f-f398-4016-8707-027b3c8a9753 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:54.575036 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-c736016f-f398-4016-8707-027b3c8a9753 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:28:54.582406 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-c736016f-f398-4016-8707-027b3c8a9753 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1264 microversion: 2.1 time: 0.136848 Nov 01 01:28:54.582984 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 740/1534] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:28:54 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1264 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:28:55.177495 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-21db28f1-c53f-46c4-8266-9b56b8d1434b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:28:55.178101 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-21db28f1-c53f-46c4-8266-9b56b8d1434b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:28:55.184265 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-21db28f1-c53f-46c4-8266-9b56b8d1434b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:55.184703 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-21db28f1-c53f-46c4-8266-9b56b8d1434b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:55.185963 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-21db28f1-c53f-46c4-8266-9b56b8d1434b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:55.186387 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-21db28f1-c53f-46c4-8266-9b56b8d1434b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:55.307756 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-21db28f1-c53f-46c4-8266-9b56b8d1434b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:28:55.315618 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-21db28f1-c53f-46c4-8266-9b56b8d1434b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.141878 Nov 01 01:28:55.316176 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 795/1535] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:28:55 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:28:55.598398 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-cb514f56-5592-4a3b-8678-0ff3eca0d7c5 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:28:55.598981 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-cb514f56-5592-4a3b-8678-0ff3eca0d7c5 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:28:55.605432 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-cb514f56-5592-4a3b-8678-0ff3eca0d7c5 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:55.605881 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-cb514f56-5592-4a3b-8678-0ff3eca0d7c5 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:55.606676 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-cb514f56-5592-4a3b-8678-0ff3eca0d7c5 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:55.607746 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-cb514f56-5592-4a3b-8678-0ff3eca0d7c5 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:55.731860 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-cb514f56-5592-4a3b-8678-0ff3eca0d7c5 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:28:55.739522 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-cb514f56-5592-4a3b-8678-0ff3eca0d7c5 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1264 microversion: 2.1 time: 0.144883 Nov 01 01:28:55.740079 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 741/1536] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:28:55 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1264 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:28:56.332086 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-442b887d-58d1-4b8a-9b65-bf1acb209d11 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:28:56.332616 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-442b887d-58d1-4b8a-9b65-bf1acb209d11 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:28:56.338787 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-442b887d-58d1-4b8a-9b65-bf1acb209d11 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:56.339235 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-442b887d-58d1-4b8a-9b65-bf1acb209d11 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:56.339996 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-442b887d-58d1-4b8a-9b65-bf1acb209d11 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:56.340420 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-442b887d-58d1-4b8a-9b65-bf1acb209d11 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:56.458285 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-442b887d-58d1-4b8a-9b65-bf1acb209d11 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:28:56.465502 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-442b887d-58d1-4b8a-9b65-bf1acb209d11 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.137257 Nov 01 01:28:56.466063 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 796/1537] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:28:56 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:28:56.755812 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-8e7c4f10-bb09-4ad2-a006-3ddb6e732000 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:28:56.756449 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-8e7c4f10-bb09-4ad2-a006-3ddb6e732000 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:28:56.762736 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8e7c4f10-bb09-4ad2-a006-3ddb6e732000 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:56.763679 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8e7c4f10-bb09-4ad2-a006-3ddb6e732000 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:56.764459 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8e7c4f10-bb09-4ad2-a006-3ddb6e732000 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:56.764864 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8e7c4f10-bb09-4ad2-a006-3ddb6e732000 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:56.884133 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-8e7c4f10-bb09-4ad2-a006-3ddb6e732000 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:28:56.891921 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-8e7c4f10-bb09-4ad2-a006-3ddb6e732000 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1264 microversion: 2.1 time: 0.139769 Nov 01 01:28:56.892478 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 742/1538] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:28:56 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1264 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:28:57.483103 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-a9e7ba4d-45a8-404b-b1e5-d030d39eb12a tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:28:57.483710 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-a9e7ba4d-45a8-404b-b1e5-d030d39eb12a tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:28:57.489918 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a9e7ba4d-45a8-404b-b1e5-d030d39eb12a tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:57.490446 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a9e7ba4d-45a8-404b-b1e5-d030d39eb12a tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:57.491203 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a9e7ba4d-45a8-404b-b1e5-d030d39eb12a tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:57.491630 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a9e7ba4d-45a8-404b-b1e5-d030d39eb12a tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:57.613832 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-a9e7ba4d-45a8-404b-b1e5-d030d39eb12a tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:28:57.623748 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-a9e7ba4d-45a8-404b-b1e5-d030d39eb12a tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.142233 Nov 01 01:28:57.623748 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 797/1539] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:28:57 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:28:57.908511 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-78f38e6c-9008-4d5b-a821-81c73ac8b0eb tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:28:57.909051 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-78f38e6c-9008-4d5b-a821-81c73ac8b0eb tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:28:57.915243 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-78f38e6c-9008-4d5b-a821-81c73ac8b0eb tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:57.915686 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-78f38e6c-9008-4d5b-a821-81c73ac8b0eb tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:57.916442 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-78f38e6c-9008-4d5b-a821-81c73ac8b0eb tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:57.916869 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-78f38e6c-9008-4d5b-a821-81c73ac8b0eb tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:58.036279 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-78f38e6c-9008-4d5b-a821-81c73ac8b0eb tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:28:58.046912 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-78f38e6c-9008-4d5b-a821-81c73ac8b0eb tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1264 microversion: 2.1 time: 0.138924 Nov 01 01:28:58.046912 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 743/1540] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:28:57 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1264 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:28:58.638978 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-8e5b73c0-d5ed-448d-b21d-71c220ddf833 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:28:58.639492 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-8e5b73c0-d5ed-448d-b21d-71c220ddf833 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:28:58.645630 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8e5b73c0-d5ed-448d-b21d-71c220ddf833 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:58.646082 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8e5b73c0-d5ed-448d-b21d-71c220ddf833 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:58.646876 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8e5b73c0-d5ed-448d-b21d-71c220ddf833 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:58.647307 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8e5b73c0-d5ed-448d-b21d-71c220ddf833 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:58.767991 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-8e5b73c0-d5ed-448d-b21d-71c220ddf833 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:28:58.775428 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-8e5b73c0-d5ed-448d-b21d-71c220ddf833 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.140296 Nov 01 01:28:58.775990 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 798/1541] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:28:58 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:28:59.060584 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-2baab078-a17b-4e49-bfcf-f94009c3fcb8 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:28:59.061197 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-2baab078-a17b-4e49-bfcf-f94009c3fcb8 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:28:59.067424 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-2baab078-a17b-4e49-bfcf-f94009c3fcb8 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:59.071260 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-2baab078-a17b-4e49-bfcf-f94009c3fcb8 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:59.071260 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-2baab078-a17b-4e49-bfcf-f94009c3fcb8 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:59.071260 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-2baab078-a17b-4e49-bfcf-f94009c3fcb8 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:59.189845 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-2baab078-a17b-4e49-bfcf-f94009c3fcb8 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:28:59.198120 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-2baab078-a17b-4e49-bfcf-f94009c3fcb8 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1264 microversion: 2.1 time: 0.141296 Nov 01 01:28:59.198715 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 744/1542] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:28:59 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1264 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:28:59.792569 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-526eaa75-0b13-4a42-a5c5-0f1216f59eb9 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:28:59.793210 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-526eaa75-0b13-4a42-a5c5-0f1216f59eb9 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:28:59.799907 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-526eaa75-0b13-4a42-a5c5-0f1216f59eb9 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:59.800347 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-526eaa75-0b13-4a42-a5c5-0f1216f59eb9 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:59.801105 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-526eaa75-0b13-4a42-a5c5-0f1216f59eb9 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:28:59.801530 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-526eaa75-0b13-4a42-a5c5-0f1216f59eb9 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:28:59.918105 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-526eaa75-0b13-4a42-a5c5-0f1216f59eb9 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:28:59.925828 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-526eaa75-0b13-4a42-a5c5-0f1216f59eb9 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.136942 Nov 01 01:28:59.926389 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 799/1543] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:28:59 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:29:00.215455 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-badcb974-a3b5-498d-b42f-798a90d28a54 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:29:00.216059 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-badcb974-a3b5-498d-b42f-798a90d28a54 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:29:00.222753 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-badcb974-a3b5-498d-b42f-798a90d28a54 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:00.223194 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-badcb974-a3b5-498d-b42f-798a90d28a54 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:00.223955 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-badcb974-a3b5-498d-b42f-798a90d28a54 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:00.224370 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-badcb974-a3b5-498d-b42f-798a90d28a54 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:00.345123 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-badcb974-a3b5-498d-b42f-798a90d28a54 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:29:00.352732 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-badcb974-a3b5-498d-b42f-798a90d28a54 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1264 microversion: 2.1 time: 0.140653 Nov 01 01:29:00.353297 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 745/1544] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:29:00 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1264 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:29:00.943632 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-61546233-0450-464b-92b2-7e4c513ae3b5 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:29:00.944241 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-61546233-0450-464b-92b2-7e4c513ae3b5 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:29:00.950449 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-61546233-0450-464b-92b2-7e4c513ae3b5 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:00.951499 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-61546233-0450-464b-92b2-7e4c513ae3b5 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:00.952262 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-61546233-0450-464b-92b2-7e4c513ae3b5 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:00.952693 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-61546233-0450-464b-92b2-7e4c513ae3b5 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:01.072058 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-61546233-0450-464b-92b2-7e4c513ae3b5 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:29:01.080028 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-61546233-0450-464b-92b2-7e4c513ae3b5 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.140071 Nov 01 01:29:01.080703 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 800/1545] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:29:00 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:29:01.370199 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-961b770f-e7f9-415e-b6d6-cd0526bf055f tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:29:01.370895 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-961b770f-e7f9-415e-b6d6-cd0526bf055f tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:29:01.377680 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-961b770f-e7f9-415e-b6d6-cd0526bf055f tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:01.378121 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-961b770f-e7f9-415e-b6d6-cd0526bf055f tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:01.378899 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-961b770f-e7f9-415e-b6d6-cd0526bf055f tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:01.379327 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-961b770f-e7f9-415e-b6d6-cd0526bf055f tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:01.495335 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-961b770f-e7f9-415e-b6d6-cd0526bf055f tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:29:01.503282 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-961b770f-e7f9-415e-b6d6-cd0526bf055f tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1264 microversion: 2.1 time: 0.136736 Nov 01 01:29:01.503841 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 746/1546] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:29:01 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1264 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:29:02.097227 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-3e90062f-855b-4276-a9e6-b102cb8f3bcd tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:29:02.097833 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-3e90062f-855b-4276-a9e6-b102cb8f3bcd tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:29:02.104347 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3e90062f-855b-4276-a9e6-b102cb8f3bcd tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:02.104784 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3e90062f-855b-4276-a9e6-b102cb8f3bcd tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:02.105538 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3e90062f-855b-4276-a9e6-b102cb8f3bcd tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:02.105964 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3e90062f-855b-4276-a9e6-b102cb8f3bcd tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:02.231185 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-3e90062f-855b-4276-a9e6-b102cb8f3bcd tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:29:02.238377 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-3e90062f-855b-4276-a9e6-b102cb8f3bcd tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.144811 Nov 01 01:29:02.238970 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 801/1547] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:29:02 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:29:02.520099 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-332cc8fa-3277-4c3f-b451-cbb7f25c1485 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:29:02.520708 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-332cc8fa-3277-4c3f-b451-cbb7f25c1485 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:29:02.526947 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-332cc8fa-3277-4c3f-b451-cbb7f25c1485 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:02.527445 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-332cc8fa-3277-4c3f-b451-cbb7f25c1485 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:02.528240 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-332cc8fa-3277-4c3f-b451-cbb7f25c1485 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:02.528715 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-332cc8fa-3277-4c3f-b451-cbb7f25c1485 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:02.647766 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-332cc8fa-3277-4c3f-b451-cbb7f25c1485 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:29:02.655703 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-332cc8fa-3277-4c3f-b451-cbb7f25c1485 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1264 microversion: 2.1 time: 0.139296 Nov 01 01:29:02.656276 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 747/1548] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:29:02 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1264 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:29:03.254847 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-06dd87fd-271b-4b7e-9f22-af4c9d5262da tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:29:03.255423 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-06dd87fd-271b-4b7e-9f22-af4c9d5262da tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:29:03.261630 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-06dd87fd-271b-4b7e-9f22-af4c9d5262da tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:03.262068 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-06dd87fd-271b-4b7e-9f22-af4c9d5262da tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:03.262851 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-06dd87fd-271b-4b7e-9f22-af4c9d5262da tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:03.263839 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-06dd87fd-271b-4b7e-9f22-af4c9d5262da tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:03.380609 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-06dd87fd-271b-4b7e-9f22-af4c9d5262da tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:29:03.387897 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-06dd87fd-271b-4b7e-9f22-af4c9d5262da tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.136658 Nov 01 01:29:03.389143 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 802/1549] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:29:03 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:29:03.673209 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-ed2c032c-7cb2-4f2d-864f-6350d07698e1 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:29:03.673729 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-ed2c032c-7cb2-4f2d-864f-6350d07698e1 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:29:03.680001 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ed2c032c-7cb2-4f2d-864f-6350d07698e1 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:03.680447 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ed2c032c-7cb2-4f2d-864f-6350d07698e1 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:03.681209 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ed2c032c-7cb2-4f2d-864f-6350d07698e1 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:03.681640 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ed2c032c-7cb2-4f2d-864f-6350d07698e1 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:03.802624 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-ed2c032c-7cb2-4f2d-864f-6350d07698e1 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:29:03.810769 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-ed2c032c-7cb2-4f2d-864f-6350d07698e1 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1264 microversion: 2.1 time: 0.141226 Nov 01 01:29:03.811330 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 748/1550] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:29:03 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1264 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:29:04.405916 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-8cb5bd2c-7c11-4bdd-b035-b375c848f630 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:29:04.406518 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-8cb5bd2c-7c11-4bdd-b035-b375c848f630 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:29:04.412748 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8cb5bd2c-7c11-4bdd-b035-b375c848f630 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:04.413192 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8cb5bd2c-7c11-4bdd-b035-b375c848f630 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:04.413950 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8cb5bd2c-7c11-4bdd-b035-b375c848f630 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:04.414379 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8cb5bd2c-7c11-4bdd-b035-b375c848f630 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:04.532142 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-8cb5bd2c-7c11-4bdd-b035-b375c848f630 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:29:04.539386 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-8cb5bd2c-7c11-4bdd-b035-b375c848f630 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.137859 Nov 01 01:29:04.539946 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 803/1551] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:29:04 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:29:04.827679 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-0ba2e396-5537-4c8d-9da1-d9aa6cc20f13 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:29:04.828288 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-0ba2e396-5537-4c8d-9da1-d9aa6cc20f13 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:29:04.834539 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0ba2e396-5537-4c8d-9da1-d9aa6cc20f13 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:04.834985 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0ba2e396-5537-4c8d-9da1-d9aa6cc20f13 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:04.835740 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0ba2e396-5537-4c8d-9da1-d9aa6cc20f13 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:04.836167 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0ba2e396-5537-4c8d-9da1-d9aa6cc20f13 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:04.953657 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-0ba2e396-5537-4c8d-9da1-d9aa6cc20f13 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:29:04.960847 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-0ba2e396-5537-4c8d-9da1-d9aa6cc20f13 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1264 microversion: 2.1 time: 0.137455 Nov 01 01:29:04.961414 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 749/1552] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:29:04 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1264 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:29:05.556310 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-0627e6aa-bd6a-4e5a-8a5c-23c23ea1b69c tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:29:05.556843 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-0627e6aa-bd6a-4e5a-8a5c-23c23ea1b69c tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:29:05.563049 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0627e6aa-bd6a-4e5a-8a5c-23c23ea1b69c tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:05.563485 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0627e6aa-bd6a-4e5a-8a5c-23c23ea1b69c tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:05.564238 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0627e6aa-bd6a-4e5a-8a5c-23c23ea1b69c tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:05.564661 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0627e6aa-bd6a-4e5a-8a5c-23c23ea1b69c tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:05.686945 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-0627e6aa-bd6a-4e5a-8a5c-23c23ea1b69c tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:29:05.694268 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-0627e6aa-bd6a-4e5a-8a5c-23c23ea1b69c tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.141706 Nov 01 01:29:05.694854 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 804/1553] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:29:05 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:29:05.977849 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-e69ae4d0-e6b9-47d3-a116-1da3ceb03d18 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:29:05.978494 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-e69ae4d0-e6b9-47d3-a116-1da3ceb03d18 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:29:05.984833 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e69ae4d0-e6b9-47d3-a116-1da3ceb03d18 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:05.985282 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e69ae4d0-e6b9-47d3-a116-1da3ceb03d18 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:05.986044 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e69ae4d0-e6b9-47d3-a116-1da3ceb03d18 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:05.986499 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e69ae4d0-e6b9-47d3-a116-1da3ceb03d18 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:06.106744 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-e69ae4d0-e6b9-47d3-a116-1da3ceb03d18 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:29:06.114148 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-e69ae4d0-e6b9-47d3-a116-1da3ceb03d18 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1264 microversion: 2.1 time: 0.140201 Nov 01 01:29:06.114728 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 750/1554] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:29:05 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1264 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:29:06.711295 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-80aca57c-b89e-43f3-9086-c72a59428c8c tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:29:06.711898 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-80aca57c-b89e-43f3-9086-c72a59428c8c tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:29:06.718052 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-80aca57c-b89e-43f3-9086-c72a59428c8c tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:06.718518 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-80aca57c-b89e-43f3-9086-c72a59428c8c tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:06.719276 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-80aca57c-b89e-43f3-9086-c72a59428c8c tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:06.719703 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-80aca57c-b89e-43f3-9086-c72a59428c8c tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:06.835577 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-80aca57c-b89e-43f3-9086-c72a59428c8c tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:29:06.843411 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-80aca57c-b89e-43f3-9086-c72a59428c8c tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.135701 Nov 01 01:29:06.843981 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 805/1555] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:29:06 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:29:07.131572 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-7559521b-1609-4436-9030-6f969f013232 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:29:07.132088 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-7559521b-1609-4436-9030-6f969f013232 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:29:07.138648 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-7559521b-1609-4436-9030-6f969f013232 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:07.139116 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-7559521b-1609-4436-9030-6f969f013232 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:07.139909 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-7559521b-1609-4436-9030-6f969f013232 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:07.140333 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-7559521b-1609-4436-9030-6f969f013232 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:07.260315 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-7559521b-1609-4436-9030-6f969f013232 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:29:07.267989 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-7559521b-1609-4436-9030-6f969f013232 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1264 microversion: 2.1 time: 0.140168 Nov 01 01:29:07.268543 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 751/1556] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:29:07 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1264 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:29:07.860530 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-6e2dcb5a-9c20-40a3-8a6a-e1d9413397d5 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:29:07.861134 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-6e2dcb5a-9c20-40a3-8a6a-e1d9413397d5 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:29:07.868947 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6e2dcb5a-9c20-40a3-8a6a-e1d9413397d5 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:07.869736 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6e2dcb5a-9c20-40a3-8a6a-e1d9413397d5 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:07.871206 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6e2dcb5a-9c20-40a3-8a6a-e1d9413397d5 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:07.871819 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6e2dcb5a-9c20-40a3-8a6a-e1d9413397d5 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:07.990778 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-6e2dcb5a-9c20-40a3-8a6a-e1d9413397d5 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:29:07.998240 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-6e2dcb5a-9c20-40a3-8a6a-e1d9413397d5 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.141424 Nov 01 01:29:07.999388 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 806/1557] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:29:07 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:29:08.285333 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-9e8a14cd-fb72-4da0-91e4-9bdecddc296d tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:29:08.285934 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-9e8a14cd-fb72-4da0-91e4-9bdecddc296d tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:29:08.292371 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9e8a14cd-fb72-4da0-91e4-9bdecddc296d tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:08.292812 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9e8a14cd-fb72-4da0-91e4-9bdecddc296d tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:08.293563 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9e8a14cd-fb72-4da0-91e4-9bdecddc296d tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:08.293988 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9e8a14cd-fb72-4da0-91e4-9bdecddc296d tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:08.411350 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-9e8a14cd-fb72-4da0-91e4-9bdecddc296d tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:29:08.418516 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-9e8a14cd-fb72-4da0-91e4-9bdecddc296d tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1264 microversion: 2.1 time: 0.136815 Nov 01 01:29:08.419067 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 752/1558] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:29:08 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1264 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:29:09.015118 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-2f3282a5-2a07-4841-b0a3-002c9bb85e33 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:29:09.015724 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-2f3282a5-2a07-4841-b0a3-002c9bb85e33 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:29:09.021940 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2f3282a5-2a07-4841-b0a3-002c9bb85e33 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:09.022383 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2f3282a5-2a07-4841-b0a3-002c9bb85e33 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:09.023174 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2f3282a5-2a07-4841-b0a3-002c9bb85e33 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:09.023603 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2f3282a5-2a07-4841-b0a3-002c9bb85e33 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:09.144612 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-2f3282a5-2a07-4841-b0a3-002c9bb85e33 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:29:09.151908 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-2f3282a5-2a07-4841-b0a3-002c9bb85e33 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.141050 Nov 01 01:29:09.152475 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 807/1559] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:29:09 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:29:09.436423 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-e110c331-0c8c-45da-9a0c-f25c4c4ecfc8 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:29:09.437037 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-e110c331-0c8c-45da-9a0c-f25c4c4ecfc8 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:29:09.443186 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e110c331-0c8c-45da-9a0c-f25c4c4ecfc8 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:09.443626 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e110c331-0c8c-45da-9a0c-f25c4c4ecfc8 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:09.444380 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e110c331-0c8c-45da-9a0c-f25c4c4ecfc8 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:09.444806 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e110c331-0c8c-45da-9a0c-f25c4c4ecfc8 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:09.561566 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-e110c331-0c8c-45da-9a0c-f25c4c4ecfc8 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:29:09.568727 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-e110c331-0c8c-45da-9a0c-f25c4c4ecfc8 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1264 microversion: 2.1 time: 0.136492 Nov 01 01:29:09.569301 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 753/1560] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:29:09 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1264 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:29:10.168572 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-21b83013-522e-4277-9ab6-0c42c0d1a630 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:29:10.169183 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-21b83013-522e-4277-9ab6-0c42c0d1a630 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:29:10.176075 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-21b83013-522e-4277-9ab6-0c42c0d1a630 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:10.176524 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-21b83013-522e-4277-9ab6-0c42c0d1a630 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:10.177287 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-21b83013-522e-4277-9ab6-0c42c0d1a630 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:10.177726 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-21b83013-522e-4277-9ab6-0c42c0d1a630 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:10.296043 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-21b83013-522e-4277-9ab6-0c42c0d1a630 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:29:10.303353 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-21b83013-522e-4277-9ab6-0c42c0d1a630 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.138495 Nov 01 01:29:10.303922 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 808/1561] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:29:10 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:29:10.584843 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-d28d0d9d-b988-4ea5-b705-1e8e2b5aa5cc tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:29:10.585448 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-d28d0d9d-b988-4ea5-b705-1e8e2b5aa5cc tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:29:10.591877 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d28d0d9d-b988-4ea5-b705-1e8e2b5aa5cc tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:10.592352 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d28d0d9d-b988-4ea5-b705-1e8e2b5aa5cc tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:10.593096 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d28d0d9d-b988-4ea5-b705-1e8e2b5aa5cc tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:10.593516 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d28d0d9d-b988-4ea5-b705-1e8e2b5aa5cc tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:10.714846 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-d28d0d9d-b988-4ea5-b705-1e8e2b5aa5cc tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:29:10.721951 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-d28d0d9d-b988-4ea5-b705-1e8e2b5aa5cc tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1264 microversion: 2.1 time: 0.140736 Nov 01 01:29:10.722526 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 754/1562] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:29:10 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1264 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:29:11.319106 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-7130c03b-d54e-4b2a-9038-9ced2100e17d tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:29:11.319711 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-7130c03b-d54e-4b2a-9038-9ced2100e17d tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:29:11.325964 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7130c03b-d54e-4b2a-9038-9ced2100e17d tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:11.326410 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7130c03b-d54e-4b2a-9038-9ced2100e17d tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:11.327198 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7130c03b-d54e-4b2a-9038-9ced2100e17d tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:11.327626 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7130c03b-d54e-4b2a-9038-9ced2100e17d tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:11.424313 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 01 01:29:11.424559 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: Mon Nov 1 01:29:11 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 01 01:29:11.444781 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-7130c03b-d54e-4b2a-9038-9ced2100e17d tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:29:11.452033 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-7130c03b-d54e-4b2a-9038-9ced2100e17d tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.136612 Nov 01 01:29:11.452595 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 809/1563] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:29:11 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:29:11.739426 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-e0c9f0b4-41fa-49ae-bb4f-d6b94e20e3df tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:29:11.740030 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-e0c9f0b4-41fa-49ae-bb4f-d6b94e20e3df tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:29:11.746192 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e0c9f0b4-41fa-49ae-bb4f-d6b94e20e3df tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:11.746667 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e0c9f0b4-41fa-49ae-bb4f-d6b94e20e3df tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:11.747420 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e0c9f0b4-41fa-49ae-bb4f-d6b94e20e3df tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:11.747851 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e0c9f0b4-41fa-49ae-bb4f-d6b94e20e3df tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:11.864638 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-e0c9f0b4-41fa-49ae-bb4f-d6b94e20e3df tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:29:11.871939 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-e0c9f0b4-41fa-49ae-bb4f-d6b94e20e3df tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1264 microversion: 2.1 time: 0.136189 Nov 01 01:29:11.872504 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 755/1564] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:29:11 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1264 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:29:12.468582 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-eebb4105-c701-4882-b13e-d5cbab41a1c0 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:29:12.469201 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-eebb4105-c701-4882-b13e-d5cbab41a1c0 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:29:12.475569 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-eebb4105-c701-4882-b13e-d5cbab41a1c0 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:12.476015 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-eebb4105-c701-4882-b13e-d5cbab41a1c0 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:12.476781 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-eebb4105-c701-4882-b13e-d5cbab41a1c0 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:12.477482 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-eebb4105-c701-4882-b13e-d5cbab41a1c0 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:12.595910 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-eebb4105-c701-4882-b13e-d5cbab41a1c0 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:29:12.603552 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-eebb4105-c701-4882-b13e-d5cbab41a1c0 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.138628 Nov 01 01:29:12.604108 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 810/1565] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:29:12 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:29:12.888557 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-ae2e29cd-6a07-4d61-9745-6720e66bc640 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:29:12.889171 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-ae2e29cd-6a07-4d61-9745-6720e66bc640 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:29:12.895538 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ae2e29cd-6a07-4d61-9745-6720e66bc640 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:12.895987 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ae2e29cd-6a07-4d61-9745-6720e66bc640 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:12.896748 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ae2e29cd-6a07-4d61-9745-6720e66bc640 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:12.897182 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ae2e29cd-6a07-4d61-9745-6720e66bc640 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:13.023177 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-ae2e29cd-6a07-4d61-9745-6720e66bc640 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:29:13.030923 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-ae2e29cd-6a07-4d61-9745-6720e66bc640 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1264 microversion: 2.1 time: 0.146075 Nov 01 01:29:13.031524 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 756/1566] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:29:12 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1264 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:29:13.620813 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-22833a14-5ff2-474a-a234-627467b5caf5 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:29:13.621622 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-22833a14-5ff2-474a-a234-627467b5caf5 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:29:13.628460 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-22833a14-5ff2-474a-a234-627467b5caf5 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:13.628906 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-22833a14-5ff2-474a-a234-627467b5caf5 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:13.629668 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-22833a14-5ff2-474a-a234-627467b5caf5 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:13.630096 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-22833a14-5ff2-474a-a234-627467b5caf5 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:13.745565 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-22833a14-5ff2-474a-a234-627467b5caf5 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:29:13.753318 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-22833a14-5ff2-474a-a234-627467b5caf5 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.136275 Nov 01 01:29:13.753878 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 811/1567] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:29:13 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:29:14.047768 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-9ec9a3e8-8d5d-4377-8a61-2ddf762ad822 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:29:14.048369 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-9ec9a3e8-8d5d-4377-8a61-2ddf762ad822 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:29:14.054562 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9ec9a3e8-8d5d-4377-8a61-2ddf762ad822 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:14.055016 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9ec9a3e8-8d5d-4377-8a61-2ddf762ad822 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:14.055753 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9ec9a3e8-8d5d-4377-8a61-2ddf762ad822 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:14.056179 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9ec9a3e8-8d5d-4377-8a61-2ddf762ad822 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:14.175767 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-9ec9a3e8-8d5d-4377-8a61-2ddf762ad822 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:29:14.183060 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-9ec9a3e8-8d5d-4377-8a61-2ddf762ad822 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1264 microversion: 2.1 time: 0.138931 Nov 01 01:29:14.183619 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 757/1568] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:29:14 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1264 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:29:14.769888 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-a0376dfa-fb60-4184-9ba9-65a3f52572dc tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:29:14.770530 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-a0376dfa-fb60-4184-9ba9-65a3f52572dc tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:29:14.776334 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a0376dfa-fb60-4184-9ba9-65a3f52572dc tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:14.776777 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a0376dfa-fb60-4184-9ba9-65a3f52572dc tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:14.777534 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a0376dfa-fb60-4184-9ba9-65a3f52572dc tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:14.777962 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a0376dfa-fb60-4184-9ba9-65a3f52572dc tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:14.893911 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-a0376dfa-fb60-4184-9ba9-65a3f52572dc tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:29:14.901504 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-a0376dfa-fb60-4184-9ba9-65a3f52572dc tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.135350 Nov 01 01:29:14.902097 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 812/1569] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:29:14 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:29:15.199182 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-2046c8b0-989d-4a71-a6fc-0293d9ce8402 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:29:15.199787 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-2046c8b0-989d-4a71-a6fc-0293d9ce8402 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:29:15.206003 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-2046c8b0-989d-4a71-a6fc-0293d9ce8402 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:15.206472 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-2046c8b0-989d-4a71-a6fc-0293d9ce8402 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:15.207227 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-2046c8b0-989d-4a71-a6fc-0293d9ce8402 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:15.207652 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-2046c8b0-989d-4a71-a6fc-0293d9ce8402 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:15.326599 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-2046c8b0-989d-4a71-a6fc-0293d9ce8402 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:29:15.333707 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-2046c8b0-989d-4a71-a6fc-0293d9ce8402 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1264 microversion: 2.1 time: 0.138436 Nov 01 01:29:15.334286 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 758/1570] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:29:15 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1264 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:29:15.918691 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-2edb8a1b-6ea1-44e8-9dd2-b3b264861e9a tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:29:15.919301 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-2edb8a1b-6ea1-44e8-9dd2-b3b264861e9a tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:29:15.926741 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2edb8a1b-6ea1-44e8-9dd2-b3b264861e9a tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:15.927571 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2edb8a1b-6ea1-44e8-9dd2-b3b264861e9a tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:15.928384 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2edb8a1b-6ea1-44e8-9dd2-b3b264861e9a tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:15.928824 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2edb8a1b-6ea1-44e8-9dd2-b3b264861e9a tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:16.063875 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-2edb8a1b-6ea1-44e8-9dd2-b3b264861e9a tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:29:16.071435 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-2edb8a1b-6ea1-44e8-9dd2-b3b264861e9a tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.156325 Nov 01 01:29:16.072002 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 813/1571] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:29:15 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:29:16.350909 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-f7d739b7-3bbe-4224-a21f-19a543948510 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:29:16.351505 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-f7d739b7-3bbe-4224-a21f-19a543948510 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:29:16.358291 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f7d739b7-3bbe-4224-a21f-19a543948510 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:16.358771 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f7d739b7-3bbe-4224-a21f-19a543948510 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:16.359584 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f7d739b7-3bbe-4224-a21f-19a543948510 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:16.360002 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f7d739b7-3bbe-4224-a21f-19a543948510 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:16.478218 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-f7d739b7-3bbe-4224-a21f-19a543948510 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:29:16.485381 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-f7d739b7-3bbe-4224-a21f-19a543948510 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1264 microversion: 2.1 time: 0.138367 Nov 01 01:29:16.485966 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 759/1572] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:29:16 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1264 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:29:17.088300 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-ee5ec8c7-a1d1-46c0-ae1f-c221868a0909 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:29:17.088901 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-ee5ec8c7-a1d1-46c0-ae1f-c221868a0909 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:29:17.095283 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ee5ec8c7-a1d1-46c0-ae1f-c221868a0909 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:17.095726 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ee5ec8c7-a1d1-46c0-ae1f-c221868a0909 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:17.096655 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ee5ec8c7-a1d1-46c0-ae1f-c221868a0909 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:17.097089 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ee5ec8c7-a1d1-46c0-ae1f-c221868a0909 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:17.214751 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-ee5ec8c7-a1d1-46c0-ae1f-c221868a0909 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:29:17.222399 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-ee5ec8c7-a1d1-46c0-ae1f-c221868a0909 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.137792 Nov 01 01:29:17.222972 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 814/1573] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:29:17 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:29:17.502284 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-2983f824-0a93-4dc6-943d-427ace1af668 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:29:17.502954 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-2983f824-0a93-4dc6-943d-427ace1af668 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:29:17.508870 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-2983f824-0a93-4dc6-943d-427ace1af668 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:17.509305 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-2983f824-0a93-4dc6-943d-427ace1af668 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:17.510076 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-2983f824-0a93-4dc6-943d-427ace1af668 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:17.510531 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-2983f824-0a93-4dc6-943d-427ace1af668 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:17.633878 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-2983f824-0a93-4dc6-943d-427ace1af668 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:29:17.641059 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-2983f824-0a93-4dc6-943d-427ace1af668 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1264 microversion: 2.1 time: 0.142480 Nov 01 01:29:17.642145 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 760/1574] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:29:17 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1264 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:29:18.239634 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-72651259-ac32-4101-ab8a-9143ef2341c2 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:29:18.240231 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-72651259-ac32-4101-ab8a-9143ef2341c2 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:29:18.246523 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-72651259-ac32-4101-ab8a-9143ef2341c2 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:18.246964 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-72651259-ac32-4101-ab8a-9143ef2341c2 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:18.247716 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-72651259-ac32-4101-ab8a-9143ef2341c2 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:18.248139 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-72651259-ac32-4101-ab8a-9143ef2341c2 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:18.366478 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-72651259-ac32-4101-ab8a-9143ef2341c2 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:29:18.373788 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-72651259-ac32-4101-ab8a-9143ef2341c2 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.137813 Nov 01 01:29:18.374342 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 815/1575] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:29:18 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:29:18.657917 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-78af157a-b2ff-489b-9e66-4ee2c26de3f7 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:29:18.658631 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-78af157a-b2ff-489b-9e66-4ee2c26de3f7 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:29:18.664877 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-78af157a-b2ff-489b-9e66-4ee2c26de3f7 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:18.665311 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-78af157a-b2ff-489b-9e66-4ee2c26de3f7 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:18.666053 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-78af157a-b2ff-489b-9e66-4ee2c26de3f7 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:18.666495 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-78af157a-b2ff-489b-9e66-4ee2c26de3f7 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:18.786066 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-78af157a-b2ff-489b-9e66-4ee2c26de3f7 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:29:18.793474 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-78af157a-b2ff-489b-9e66-4ee2c26de3f7 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1264 microversion: 2.1 time: 0.139174 Nov 01 01:29:18.794040 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 761/1576] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:29:18 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1264 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:29:19.390830 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-7f98a2f4-08dc-4c9b-ad56-11782093fe15 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:29:19.391445 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-7f98a2f4-08dc-4c9b-ad56-11782093fe15 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:29:19.397635 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7f98a2f4-08dc-4c9b-ad56-11782093fe15 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:19.398081 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7f98a2f4-08dc-4c9b-ad56-11782093fe15 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:19.398876 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7f98a2f4-08dc-4c9b-ad56-11782093fe15 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:19.399312 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7f98a2f4-08dc-4c9b-ad56-11782093fe15 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:19.518812 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-7f98a2f4-08dc-4c9b-ad56-11782093fe15 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:29:19.526153 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-7f98a2f4-08dc-4c9b-ad56-11782093fe15 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.139018 Nov 01 01:29:19.526761 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 816/1577] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:29:19 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:29:19.811178 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-98abbdaf-1e1c-4aff-9ec5-d02a7c2a0c18 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:29:19.811785 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-98abbdaf-1e1c-4aff-9ec5-d02a7c2a0c18 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:29:19.818688 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-98abbdaf-1e1c-4aff-9ec5-d02a7c2a0c18 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:19.819130 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-98abbdaf-1e1c-4aff-9ec5-d02a7c2a0c18 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:19.819884 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-98abbdaf-1e1c-4aff-9ec5-d02a7c2a0c18 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:19.820314 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-98abbdaf-1e1c-4aff-9ec5-d02a7c2a0c18 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:19.936585 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-98abbdaf-1e1c-4aff-9ec5-d02a7c2a0c18 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:29:19.943758 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-98abbdaf-1e1c-4aff-9ec5-d02a7c2a0c18 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1264 microversion: 2.1 time: 0.136322 Nov 01 01:29:19.944344 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 762/1578] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:29:19 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1264 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:29:20.543356 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-e2e99111-99ca-4466-96ab-02990949b07b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:29:20.543965 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-e2e99111-99ca-4466-96ab-02990949b07b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:29:20.550140 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e2e99111-99ca-4466-96ab-02990949b07b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:20.550624 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e2e99111-99ca-4466-96ab-02990949b07b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:20.551383 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e2e99111-99ca-4466-96ab-02990949b07b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:20.551812 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e2e99111-99ca-4466-96ab-02990949b07b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:20.670609 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-e2e99111-99ca-4466-96ab-02990949b07b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:29:20.677793 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-e2e99111-99ca-4466-96ab-02990949b07b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.138076 Nov 01 01:29:20.678356 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 817/1579] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:29:20 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:29:20.961011 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-e96cd5d4-5217-4e5c-9ddf-1d54195bdbdb tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:29:20.961811 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-e96cd5d4-5217-4e5c-9ddf-1d54195bdbdb tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:29:20.967947 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e96cd5d4-5217-4e5c-9ddf-1d54195bdbdb tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:20.968390 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e96cd5d4-5217-4e5c-9ddf-1d54195bdbdb tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:20.969155 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e96cd5d4-5217-4e5c-9ddf-1d54195bdbdb tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:20.969583 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e96cd5d4-5217-4e5c-9ddf-1d54195bdbdb tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:21.084578 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-fc05b5fa-a9d7-4080-a0d8-b66e459a11f2 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:29:21.085373 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-fc05b5fa-a9d7-4080-a0d8-b66e459a11f2 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:29:21.091525 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-fc05b5fa-a9d7-4080-a0d8-b66e459a11f2 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:21.092054 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-fc05b5fa-a9d7-4080-a0d8-b66e459a11f2 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:21.092897 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-fc05b5fa-a9d7-4080-a0d8-b66e459a11f2 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:21.093331 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-fc05b5fa-a9d7-4080-a0d8-b66e459a11f2 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:21.105629 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-e96cd5d4-5217-4e5c-9ddf-1d54195bdbdb tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:29:21.114062 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-e96cd5d4-5217-4e5c-9ddf-1d54195bdbdb tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1264 microversion: 2.1 time: 0.156574 Nov 01 01:29:21.116012 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 763/1580] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:29:20 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1264 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:29:21.694866 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-f9a08409-e3f0-41b4-b194-1ed572152a35 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:29:21.695483 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-f9a08409-e3f0-41b4-b194-1ed572152a35 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:29:21.701438 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f9a08409-e3f0-41b4-b194-1ed572152a35 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:21.701884 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f9a08409-e3f0-41b4-b194-1ed572152a35 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:21.702670 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f9a08409-e3f0-41b4-b194-1ed572152a35 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:21.703105 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f9a08409-e3f0-41b4-b194-1ed572152a35 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:21.820031 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-f9a08409-e3f0-41b4-b194-1ed572152a35 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:29:21.827284 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-f9a08409-e3f0-41b4-b194-1ed572152a35 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.136802 Nov 01 01:29:21.827846 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 764/1581] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:29:21 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:29:22.131958 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-b7b37fbb-90ef-4ea6-b407-fcc41f566491 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:29:22.132570 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-b7b37fbb-90ef-4ea6-b407-fcc41f566491 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:29:22.138881 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b7b37fbb-90ef-4ea6-b407-fcc41f566491 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:22.139161 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b7b37fbb-90ef-4ea6-b407-fcc41f566491 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:22.139919 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b7b37fbb-90ef-4ea6-b407-fcc41f566491 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:22.140348 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b7b37fbb-90ef-4ea6-b407-fcc41f566491 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:22.258457 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-b7b37fbb-90ef-4ea6-b407-fcc41f566491 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:29:22.265544 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-b7b37fbb-90ef-4ea6-b407-fcc41f566491 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1264 microversion: 2.1 time: 0.137397 Nov 01 01:29:22.266104 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 765/1582] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:29:22 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1264 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:29:22.844585 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-2557b8ae-36f6-4aab-b9c4-c2ce07ae4402 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:29:22.845194 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-2557b8ae-36f6-4aab-b9c4-c2ce07ae4402 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:29:22.851078 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-2557b8ae-36f6-4aab-b9c4-c2ce07ae4402 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:22.851504 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-2557b8ae-36f6-4aab-b9c4-c2ce07ae4402 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:22.852529 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-2557b8ae-36f6-4aab-b9c4-c2ce07ae4402 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:22.852955 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-2557b8ae-36f6-4aab-b9c4-c2ce07ae4402 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:22.971950 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-2557b8ae-36f6-4aab-b9c4-c2ce07ae4402 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:29:22.979719 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-2557b8ae-36f6-4aab-b9c4-c2ce07ae4402 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.138870 Nov 01 01:29:22.980276 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 766/1583] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:29:22 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:29:23.286159 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-5937ad70-a767-4674-a538-49bce6ca1d71 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:29:23.286845 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-5937ad70-a767-4674-a538-49bce6ca1d71 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:29:23.293095 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-5937ad70-a767-4674-a538-49bce6ca1d71 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:23.293538 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-5937ad70-a767-4674-a538-49bce6ca1d71 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:23.294295 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-5937ad70-a767-4674-a538-49bce6ca1d71 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:23.294752 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-5937ad70-a767-4674-a538-49bce6ca1d71 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:23.412889 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-5937ad70-a767-4674-a538-49bce6ca1d71 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:29:23.420160 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-5937ad70-a767-4674-a538-49bce6ca1d71 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1264 microversion: 2.1 time: 0.137743 Nov 01 01:29:23.420716 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 767/1584] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:29:23 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1264 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:29:23.996121 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-a4e62be8-5077-4672-9a0b-712c56d73045 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:29:23.996722 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-a4e62be8-5077-4672-9a0b-712c56d73045 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:29:24.002393 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a4e62be8-5077-4672-9a0b-712c56d73045 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:24.002862 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a4e62be8-5077-4672-9a0b-712c56d73045 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:24.003612 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a4e62be8-5077-4672-9a0b-712c56d73045 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:24.004030 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a4e62be8-5077-4672-9a0b-712c56d73045 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:24.121271 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-a4e62be8-5077-4672-9a0b-712c56d73045 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:29:24.128521 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-a4e62be8-5077-4672-9a0b-712c56d73045 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.136076 Nov 01 01:29:24.129070 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 768/1585] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:29:23 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:29:24.437619 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-8991818e-d13e-488f-8862-2d27ea2790b0 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:29:24.438229 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-8991818e-d13e-488f-8862-2d27ea2790b0 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:29:24.444498 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8991818e-d13e-488f-8862-2d27ea2790b0 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:24.444944 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8991818e-d13e-488f-8862-2d27ea2790b0 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:24.445712 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8991818e-d13e-488f-8862-2d27ea2790b0 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:24.446143 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8991818e-d13e-488f-8862-2d27ea2790b0 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:24.565635 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-8991818e-d13e-488f-8862-2d27ea2790b0 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:29:24.573148 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-8991818e-d13e-488f-8862-2d27ea2790b0 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1264 microversion: 2.1 time: 0.139176 Nov 01 01:29:24.573733 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 769/1586] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:29:24 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1264 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:29:25.146276 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-854eb283-c634-4884-9db9-32e59b74bf48 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:29:25.146910 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-854eb283-c634-4884-9db9-32e59b74bf48 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:29:25.152719 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-854eb283-c634-4884-9db9-32e59b74bf48 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:25.153165 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-854eb283-c634-4884-9db9-32e59b74bf48 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:25.153920 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-854eb283-c634-4884-9db9-32e59b74bf48 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:25.154347 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-854eb283-c634-4884-9db9-32e59b74bf48 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:25.272483 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-854eb283-c634-4884-9db9-32e59b74bf48 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:29:25.279681 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-854eb283-c634-4884-9db9-32e59b74bf48 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.137699 Nov 01 01:29:25.280238 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 770/1587] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:29:25 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:29:25.590070 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-2eb863df-f6b3-4fd5-82a5-33b355b179ea tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:29:25.590707 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-2eb863df-f6b3-4fd5-82a5-33b355b179ea tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:29:25.596879 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-2eb863df-f6b3-4fd5-82a5-33b355b179ea tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:25.597317 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-2eb863df-f6b3-4fd5-82a5-33b355b179ea tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:25.598066 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-2eb863df-f6b3-4fd5-82a5-33b355b179ea tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:25.598518 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-2eb863df-f6b3-4fd5-82a5-33b355b179ea tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:25.722585 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-2eb863df-f6b3-4fd5-82a5-33b355b179ea tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:29:25.730082 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-2eb863df-f6b3-4fd5-82a5-33b355b179ea tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1264 microversion: 2.1 time: 0.143630 Nov 01 01:29:25.730691 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 771/1588] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:29:25 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1264 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:29:26.295992 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-146accd1-9335-45bf-ae14-8e59a4769069 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:29:26.296590 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-146accd1-9335-45bf-ae14-8e59a4769069 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:29:26.302381 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-146accd1-9335-45bf-ae14-8e59a4769069 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:26.302848 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-146accd1-9335-45bf-ae14-8e59a4769069 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:26.303596 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-146accd1-9335-45bf-ae14-8e59a4769069 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:26.304016 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-146accd1-9335-45bf-ae14-8e59a4769069 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:26.436062 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-146accd1-9335-45bf-ae14-8e59a4769069 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:29:26.443717 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-146accd1-9335-45bf-ae14-8e59a4769069 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.151494 Nov 01 01:29:26.444282 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 772/1589] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:29:26 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:29:26.747631 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-31344247-32ac-4d0f-b464-be34fd11891e tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:29:26.748255 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-31344247-32ac-4d0f-b464-be34fd11891e tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:29:26.754924 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-31344247-32ac-4d0f-b464-be34fd11891e tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:26.755363 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-31344247-32ac-4d0f-b464-be34fd11891e tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:26.756111 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-31344247-32ac-4d0f-b464-be34fd11891e tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:26.756534 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-31344247-32ac-4d0f-b464-be34fd11891e tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:26.873784 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-31344247-32ac-4d0f-b464-be34fd11891e tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:29:26.881513 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-31344247-32ac-4d0f-b464-be34fd11891e tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1264 microversion: 2.1 time: 0.137609 Nov 01 01:29:26.882067 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 773/1590] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:29:26 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1264 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:29:27.459837 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-ba44d118-38b4-437e-8514-4d664590620d tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:29:27.460441 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-ba44d118-38b4-437e-8514-4d664590620d tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:29:27.466549 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ba44d118-38b4-437e-8514-4d664590620d tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:27.466996 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ba44d118-38b4-437e-8514-4d664590620d tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:27.467814 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ba44d118-38b4-437e-8514-4d664590620d tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:27.468241 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ba44d118-38b4-437e-8514-4d664590620d tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:27.584189 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-ba44d118-38b4-437e-8514-4d664590620d tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:29:27.591502 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-ba44d118-38b4-437e-8514-4d664590620d tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.135380 Nov 01 01:29:27.592057 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 774/1591] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:29:27 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:29:27.898914 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-163a73f4-2591-40b1-a000-334a31d7f74a tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:29:27.899591 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-163a73f4-2591-40b1-a000-334a31d7f74a tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:29:27.905691 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-163a73f4-2591-40b1-a000-334a31d7f74a tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:27.906128 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-163a73f4-2591-40b1-a000-334a31d7f74a tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:27.906904 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-163a73f4-2591-40b1-a000-334a31d7f74a tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:27.907325 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-163a73f4-2591-40b1-a000-334a31d7f74a tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:28.026930 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-163a73f4-2591-40b1-a000-334a31d7f74a tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:29:28.034565 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-163a73f4-2591-40b1-a000-334a31d7f74a tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1264 microversion: 2.1 time: 0.139724 Nov 01 01:29:28.035134 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 775/1592] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:29:27 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1264 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:29:28.608689 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-ab6cac66-cf41-4405-8486-29d2db8e3147 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:29:28.609299 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-ab6cac66-cf41-4405-8486-29d2db8e3147 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:29:28.615688 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ab6cac66-cf41-4405-8486-29d2db8e3147 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:28.616084 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ab6cac66-cf41-4405-8486-29d2db8e3147 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:28.616845 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ab6cac66-cf41-4405-8486-29d2db8e3147 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:28.617273 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ab6cac66-cf41-4405-8486-29d2db8e3147 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:28.734705 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-ab6cac66-cf41-4405-8486-29d2db8e3147 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:29:28.742669 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-ab6cac66-cf41-4405-8486-29d2db8e3147 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.137768 Nov 01 01:29:28.743235 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 776/1593] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:29:28 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:29:29.052633 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-caf53df1-1e04-4950-b73f-1e380bfde0a7 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:29:29.053288 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-caf53df1-1e04-4950-b73f-1e380bfde0a7 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:29:29.060841 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-caf53df1-1e04-4950-b73f-1e380bfde0a7 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:29.061272 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-caf53df1-1e04-4950-b73f-1e380bfde0a7 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:29.062064 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-caf53df1-1e04-4950-b73f-1e380bfde0a7 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:29.062629 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-caf53df1-1e04-4950-b73f-1e380bfde0a7 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:29.181199 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-caf53df1-1e04-4950-b73f-1e380bfde0a7 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:29:29.188376 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-caf53df1-1e04-4950-b73f-1e380bfde0a7 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1264 microversion: 2.1 time: 0.139975 Nov 01 01:29:29.188930 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 777/1594] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:29:29 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1264 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:29:29.759799 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-f5537ce0-25e5-4f45-90c3-e7156775c377 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:29:29.760414 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-f5537ce0-25e5-4f45-90c3-e7156775c377 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:29:29.766264 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f5537ce0-25e5-4f45-90c3-e7156775c377 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:29.766748 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f5537ce0-25e5-4f45-90c3-e7156775c377 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:29.767510 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f5537ce0-25e5-4f45-90c3-e7156775c377 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:29.767937 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f5537ce0-25e5-4f45-90c3-e7156775c377 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:29.926789 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-f5537ce0-25e5-4f45-90c3-e7156775c377 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:29:29.926789 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-f5537ce0-25e5-4f45-90c3-e7156775c377 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.137943 Nov 01 01:29:29.926789 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 778/1595] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:29:29 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:29:30.205341 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-debd72d3-0289-47eb-86d6-e5a5831390c9 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:29:30.205936 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-debd72d3-0289-47eb-86d6-e5a5831390c9 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:29:30.212440 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-debd72d3-0289-47eb-86d6-e5a5831390c9 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:30.212885 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-debd72d3-0289-47eb-86d6-e5a5831390c9 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:30.213646 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-debd72d3-0289-47eb-86d6-e5a5831390c9 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:30.214076 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-debd72d3-0289-47eb-86d6-e5a5831390c9 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:30.333268 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-debd72d3-0289-47eb-86d6-e5a5831390c9 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:29:30.340555 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-debd72d3-0289-47eb-86d6-e5a5831390c9 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1264 microversion: 2.1 time: 0.138974 Nov 01 01:29:30.341122 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 779/1596] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:29:30 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1264 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:29:30.940747 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-7c82d8f0-eae9-4457-91d9-d9c4d7038a01 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:29:30.941358 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-7c82d8f0-eae9-4457-91d9-d9c4d7038a01 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:29:30.947257 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-7c82d8f0-eae9-4457-91d9-d9c4d7038a01 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:30.947705 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-7c82d8f0-eae9-4457-91d9-d9c4d7038a01 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:30.948467 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-7c82d8f0-eae9-4457-91d9-d9c4d7038a01 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:30.948899 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-7c82d8f0-eae9-4457-91d9-d9c4d7038a01 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:31.069756 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-7c82d8f0-eae9-4457-91d9-d9c4d7038a01 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:29:31.077090 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-7c82d8f0-eae9-4457-91d9-d9c4d7038a01 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.139986 Nov 01 01:29:31.077660 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 780/1597] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:29:30 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:29:31.358330 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-270cf5b1-25ca-412c-b336-bb59f5fe0ad5 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:29:31.358969 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-270cf5b1-25ca-412c-b336-bb59f5fe0ad5 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:29:31.365184 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-270cf5b1-25ca-412c-b336-bb59f5fe0ad5 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:31.365625 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-270cf5b1-25ca-412c-b336-bb59f5fe0ad5 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:31.366388 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-270cf5b1-25ca-412c-b336-bb59f5fe0ad5 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:31.366862 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-270cf5b1-25ca-412c-b336-bb59f5fe0ad5 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:31.495862 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-270cf5b1-25ca-412c-b336-bb59f5fe0ad5 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:29:31.503334 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-270cf5b1-25ca-412c-b336-bb59f5fe0ad5 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1264 microversion: 2.1 time: 0.148862 Nov 01 01:29:31.503892 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 781/1598] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:29:31 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1264 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:29:32.094545 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-553c0eeb-2feb-4385-b091-72a1e7f5c942 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:29:32.095148 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-553c0eeb-2feb-4385-b091-72a1e7f5c942 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:29:32.101305 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-553c0eeb-2feb-4385-b091-72a1e7f5c942 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:32.101748 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-553c0eeb-2feb-4385-b091-72a1e7f5c942 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:32.102507 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-553c0eeb-2feb-4385-b091-72a1e7f5c942 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:32.102933 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-553c0eeb-2feb-4385-b091-72a1e7f5c942 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:32.221012 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-553c0eeb-2feb-4385-b091-72a1e7f5c942 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:29:32.228532 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-553c0eeb-2feb-4385-b091-72a1e7f5c942 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.137749 Nov 01 01:29:32.229114 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 782/1599] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:29:32 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:29:32.521083 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-a85e455d-e336-425b-8932-7c788e22295a tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:29:32.521717 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-a85e455d-e336-425b-8932-7c788e22295a tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:29:32.527891 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a85e455d-e336-425b-8932-7c788e22295a tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:32.528329 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a85e455d-e336-425b-8932-7c788e22295a tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:32.529076 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a85e455d-e336-425b-8932-7c788e22295a tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:32.529533 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a85e455d-e336-425b-8932-7c788e22295a tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:32.646658 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-a85e455d-e336-425b-8932-7c788e22295a tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:29:32.653789 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-a85e455d-e336-425b-8932-7c788e22295a tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1264 microversion: 2.1 time: 0.136539 Nov 01 01:29:32.654396 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 783/1600] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:29:32 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1264 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:29:33.245116 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-8b06d54d-c0d2-4927-bf87-5092c02ece92 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:29:33.245713 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-8b06d54d-c0d2-4927-bf87-5092c02ece92 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:29:33.251537 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8b06d54d-c0d2-4927-bf87-5092c02ece92 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:33.251973 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8b06d54d-c0d2-4927-bf87-5092c02ece92 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:33.252723 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8b06d54d-c0d2-4927-bf87-5092c02ece92 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:33.253146 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8b06d54d-c0d2-4927-bf87-5092c02ece92 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:33.374544 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-8b06d54d-c0d2-4927-bf87-5092c02ece92 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:29:33.382256 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-8b06d54d-c0d2-4927-bf87-5092c02ece92 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.140831 Nov 01 01:29:33.382838 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 784/1601] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:29:33 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:29:33.671050 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-52e5fab2-a6d5-40e6-a490-05b268f60fcd tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:29:33.671641 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-52e5fab2-a6d5-40e6-a490-05b268f60fcd tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:29:33.677695 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-52e5fab2-a6d5-40e6-a490-05b268f60fcd tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:33.678131 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-52e5fab2-a6d5-40e6-a490-05b268f60fcd tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:33.678906 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-52e5fab2-a6d5-40e6-a490-05b268f60fcd tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:33.679328 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-52e5fab2-a6d5-40e6-a490-05b268f60fcd tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:33.802446 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-52e5fab2-a6d5-40e6-a490-05b268f60fcd tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:29:33.809707 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-52e5fab2-a6d5-40e6-a490-05b268f60fcd tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1264 microversion: 2.1 time: 0.142206 Nov 01 01:29:33.810487 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 785/1602] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:29:33 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1264 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:29:34.400174 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-09790d2f-ac78-4ef8-869e-a9e339b96d98 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:29:34.400717 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-09790d2f-ac78-4ef8-869e-a9e339b96d98 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:29:34.406516 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-09790d2f-ac78-4ef8-869e-a9e339b96d98 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:34.406960 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-09790d2f-ac78-4ef8-869e-a9e339b96d98 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:34.407707 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-09790d2f-ac78-4ef8-869e-a9e339b96d98 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:34.408131 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-09790d2f-ac78-4ef8-869e-a9e339b96d98 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:34.525141 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-09790d2f-ac78-4ef8-869e-a9e339b96d98 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:29:34.532637 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-09790d2f-ac78-4ef8-869e-a9e339b96d98 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.136415 Nov 01 01:29:34.533198 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 786/1603] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:29:34 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:29:34.826585 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-438a6774-27ce-4475-840a-6e90a95a33fd tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:29:34.827289 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-438a6774-27ce-4475-840a-6e90a95a33fd tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:29:34.833372 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-438a6774-27ce-4475-840a-6e90a95a33fd tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:34.833819 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-438a6774-27ce-4475-840a-6e90a95a33fd tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:34.834600 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-438a6774-27ce-4475-840a-6e90a95a33fd tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:34.835027 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-438a6774-27ce-4475-840a-6e90a95a33fd tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:34.955031 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-438a6774-27ce-4475-840a-6e90a95a33fd tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:29:34.962282 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-438a6774-27ce-4475-840a-6e90a95a33fd tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1264 microversion: 2.1 time: 0.139322 Nov 01 01:29:34.962864 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 787/1604] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:29:34 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1264 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:29:35.549423 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-18a5af27-e786-453e-a634-3bd20e989237 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:29:35.549968 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-18a5af27-e786-453e-a634-3bd20e989237 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:29:35.555798 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-18a5af27-e786-453e-a634-3bd20e989237 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:35.556240 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-18a5af27-e786-453e-a634-3bd20e989237 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:35.556995 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-18a5af27-e786-453e-a634-3bd20e989237 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:35.557422 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-18a5af27-e786-453e-a634-3bd20e989237 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:35.674103 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-18a5af27-e786-453e-a634-3bd20e989237 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:29:35.681589 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-18a5af27-e786-453e-a634-3bd20e989237 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.135940 Nov 01 01:29:35.682407 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 788/1605] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:29:35 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:29:35.979164 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-0eb91156-4c7d-46c2-89aa-196b046e9dd2 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:29:35.979810 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-0eb91156-4c7d-46c2-89aa-196b046e9dd2 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:29:35.985941 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0eb91156-4c7d-46c2-89aa-196b046e9dd2 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:35.986387 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0eb91156-4c7d-46c2-89aa-196b046e9dd2 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:35.987176 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0eb91156-4c7d-46c2-89aa-196b046e9dd2 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:35.987608 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0eb91156-4c7d-46c2-89aa-196b046e9dd2 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:36.105638 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-0eb91156-4c7d-46c2-89aa-196b046e9dd2 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:29:36.112747 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-0eb91156-4c7d-46c2-89aa-196b046e9dd2 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1264 microversion: 2.1 time: 0.137470 Nov 01 01:29:36.113305 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 789/1606] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:29:35 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1264 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:29:36.699456 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-6cfc35f4-ec9c-4664-a8f6-e66ddda58a11 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:29:36.700061 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-6cfc35f4-ec9c-4664-a8f6-e66ddda58a11 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:29:36.705983 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-6cfc35f4-ec9c-4664-a8f6-e66ddda58a11 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:36.706444 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-6cfc35f4-ec9c-4664-a8f6-e66ddda58a11 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:36.707202 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-6cfc35f4-ec9c-4664-a8f6-e66ddda58a11 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:36.708187 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-6cfc35f4-ec9c-4664-a8f6-e66ddda58a11 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:36.829514 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-6cfc35f4-ec9c-4664-a8f6-e66ddda58a11 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:29:36.837322 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-6cfc35f4-ec9c-4664-a8f6-e66ddda58a11 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.141502 Nov 01 01:29:36.837884 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 790/1607] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:29:36 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:29:37.129972 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-b27a08c7-a287-463c-947b-793259132642 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:29:37.130638 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-b27a08c7-a287-463c-947b-793259132642 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:29:37.137189 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b27a08c7-a287-463c-947b-793259132642 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:37.137626 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b27a08c7-a287-463c-947b-793259132642 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:37.138381 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b27a08c7-a287-463c-947b-793259132642 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:37.138830 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b27a08c7-a287-463c-947b-793259132642 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:37.255491 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-b27a08c7-a287-463c-947b-793259132642 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:29:37.262506 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-b27a08c7-a287-463c-947b-793259132642 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1264 microversion: 2.1 time: 0.136582 Nov 01 01:29:37.263178 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 791/1608] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:29:37 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1264 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:29:37.854184 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-d82d7316-c80b-4139-be7a-c8f307ad4c32 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:29:37.854818 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-d82d7316-c80b-4139-be7a-c8f307ad4c32 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:29:37.860667 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d82d7316-c80b-4139-be7a-c8f307ad4c32 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:37.861112 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d82d7316-c80b-4139-be7a-c8f307ad4c32 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:37.861860 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d82d7316-c80b-4139-be7a-c8f307ad4c32 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:37.862283 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d82d7316-c80b-4139-be7a-c8f307ad4c32 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:37.979819 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-d82d7316-c80b-4139-be7a-c8f307ad4c32 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:29:37.987144 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-d82d7316-c80b-4139-be7a-c8f307ad4c32 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.136907 Nov 01 01:29:37.987703 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 792/1609] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:29:37 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:29:38.279585 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-31f7c4f3-e5f9-439d-864c-d628252c07c3 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:29:38.280184 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-31f7c4f3-e5f9-439d-864c-d628252c07c3 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:29:38.286722 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-31f7c4f3-e5f9-439d-864c-d628252c07c3 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:38.287194 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-31f7c4f3-e5f9-439d-864c-d628252c07c3 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:38.287958 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-31f7c4f3-e5f9-439d-864c-d628252c07c3 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:38.288408 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-31f7c4f3-e5f9-439d-864c-d628252c07c3 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:38.409226 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-31f7c4f3-e5f9-439d-864c-d628252c07c3 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:29:38.416425 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-31f7c4f3-e5f9-439d-864c-d628252c07c3 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1264 microversion: 2.1 time: 0.140555 Nov 01 01:29:38.416988 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 793/1610] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:29:38 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1264 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:29:39.003617 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-9033e99e-c567-4c30-a226-075a32bec188 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:29:39.004222 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-9033e99e-c567-4c30-a226-075a32bec188 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:29:39.009995 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9033e99e-c567-4c30-a226-075a32bec188 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:39.010449 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9033e99e-c567-4c30-a226-075a32bec188 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:39.011234 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9033e99e-c567-4c30-a226-075a32bec188 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:39.011656 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9033e99e-c567-4c30-a226-075a32bec188 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:39.134247 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-9033e99e-c567-4c30-a226-075a32bec188 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:29:39.141467 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-9033e99e-c567-4c30-a226-075a32bec188 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.141462 Nov 01 01:29:39.142022 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 794/1611] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:29:38 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:29:39.433116 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-10b52507-6eaa-40dd-9c9f-0b65f10687d4 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:29:39.433702 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-10b52507-6eaa-40dd-9c9f-0b65f10687d4 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:29:39.439979 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-10b52507-6eaa-40dd-9c9f-0b65f10687d4 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:39.440413 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-10b52507-6eaa-40dd-9c9f-0b65f10687d4 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:39.441161 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-10b52507-6eaa-40dd-9c9f-0b65f10687d4 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:39.441583 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-10b52507-6eaa-40dd-9c9f-0b65f10687d4 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:39.559653 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-10b52507-6eaa-40dd-9c9f-0b65f10687d4 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:29:39.566792 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-10b52507-6eaa-40dd-9c9f-0b65f10687d4 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1264 microversion: 2.1 time: 0.137316 Nov 01 01:29:39.567348 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 795/1612] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:29:39 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1264 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:29:40.158332 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-627a0b07-2755-4860-b4bf-8edbb1135936 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:29:40.159055 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-627a0b07-2755-4860-b4bf-8edbb1135936 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:29:40.165403 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-627a0b07-2755-4860-b4bf-8edbb1135936 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:40.165840 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-627a0b07-2755-4860-b4bf-8edbb1135936 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:40.166619 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-627a0b07-2755-4860-b4bf-8edbb1135936 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:40.167044 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-627a0b07-2755-4860-b4bf-8edbb1135936 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:40.285617 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-627a0b07-2755-4860-b4bf-8edbb1135936 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:29:40.293402 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-627a0b07-2755-4860-b4bf-8edbb1135936 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.138785 Nov 01 01:29:40.293965 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 796/1613] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:29:40 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:29:40.584289 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-58c85996-cd65-45b5-994c-55b6fb4bd09f tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:29:40.585415 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-58c85996-cd65-45b5-994c-55b6fb4bd09f tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:29:40.591577 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-58c85996-cd65-45b5-994c-55b6fb4bd09f tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:40.592013 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-58c85996-cd65-45b5-994c-55b6fb4bd09f tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:40.592760 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-58c85996-cd65-45b5-994c-55b6fb4bd09f tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:40.593185 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-58c85996-cd65-45b5-994c-55b6fb4bd09f tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:40.713050 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-58c85996-cd65-45b5-994c-55b6fb4bd09f tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:29:40.720257 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-58c85996-cd65-45b5-994c-55b6fb4bd09f tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1264 microversion: 2.1 time: 0.139830 Nov 01 01:29:40.720820 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 797/1614] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:29:40 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1264 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:29:41.309982 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-908c056f-f39d-409d-806b-7b8fd5fb9d4b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:29:41.310618 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-908c056f-f39d-409d-806b-7b8fd5fb9d4b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:29:41.316511 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-908c056f-f39d-409d-806b-7b8fd5fb9d4b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:41.316953 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-908c056f-f39d-409d-806b-7b8fd5fb9d4b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:41.317705 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-908c056f-f39d-409d-806b-7b8fd5fb9d4b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:41.318133 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-908c056f-f39d-409d-806b-7b8fd5fb9d4b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:41.435474 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-908c056f-f39d-409d-806b-7b8fd5fb9d4b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:29:41.442646 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-908c056f-f39d-409d-806b-7b8fd5fb9d4b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.136294 Nov 01 01:29:41.443207 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 798/1615] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:29:41 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:29:41.738246 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-8959c3e8-8ee1-4d15-a108-7fd83f0ad6e2 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:29:41.738946 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-8959c3e8-8ee1-4d15-a108-7fd83f0ad6e2 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:29:41.745616 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8959c3e8-8ee1-4d15-a108-7fd83f0ad6e2 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:41.746051 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8959c3e8-8ee1-4d15-a108-7fd83f0ad6e2 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:41.746829 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8959c3e8-8ee1-4d15-a108-7fd83f0ad6e2 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:41.747249 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8959c3e8-8ee1-4d15-a108-7fd83f0ad6e2 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:41.866014 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-8959c3e8-8ee1-4d15-a108-7fd83f0ad6e2 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:29:41.873191 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-8959c3e8-8ee1-4d15-a108-7fd83f0ad6e2 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1264 microversion: 2.1 time: 0.138670 Nov 01 01:29:41.873744 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 799/1616] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:29:41 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1264 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:29:42.460400 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-b2055b92-6e2b-4047-bb1d-e42204edffcd tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:29:42.461006 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-b2055b92-6e2b-4047-bb1d-e42204edffcd tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:29:42.466932 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b2055b92-6e2b-4047-bb1d-e42204edffcd tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:42.467382 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b2055b92-6e2b-4047-bb1d-e42204edffcd tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:42.468145 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b2055b92-6e2b-4047-bb1d-e42204edffcd tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:42.468577 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b2055b92-6e2b-4047-bb1d-e42204edffcd tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:42.585297 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-b2055b92-6e2b-4047-bb1d-e42204edffcd tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:29:42.592604 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-b2055b92-6e2b-4047-bb1d-e42204edffcd tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.136592 Nov 01 01:29:42.593170 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 800/1617] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:29:42 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:29:42.889797 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-8b488f4c-dde2-470e-b77c-840aa4bab5dd tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:29:42.890454 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-8b488f4c-dde2-470e-b77c-840aa4bab5dd tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:29:42.896475 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8b488f4c-dde2-470e-b77c-840aa4bab5dd tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:42.896919 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8b488f4c-dde2-470e-b77c-840aa4bab5dd tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:42.897677 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8b488f4c-dde2-470e-b77c-840aa4bab5dd tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:42.898105 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8b488f4c-dde2-470e-b77c-840aa4bab5dd tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:43.014341 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-8b488f4c-dde2-470e-b77c-840aa4bab5dd tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:29:43.021580 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-8b488f4c-dde2-470e-b77c-840aa4bab5dd tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1264 microversion: 2.1 time: 0.135385 Nov 01 01:29:43.022143 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 801/1618] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:29:42 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1264 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:29:43.608777 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-faf73de6-1b49-41f2-bc9a-42c91b3f1993 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:29:43.609404 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-faf73de6-1b49-41f2-bc9a-42c91b3f1993 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:29:43.615229 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-faf73de6-1b49-41f2-bc9a-42c91b3f1993 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:43.615667 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-faf73de6-1b49-41f2-bc9a-42c91b3f1993 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:43.616459 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-faf73de6-1b49-41f2-bc9a-42c91b3f1993 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:43.616834 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-faf73de6-1b49-41f2-bc9a-42c91b3f1993 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:43.741706 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-faf73de6-1b49-41f2-bc9a-42c91b3f1993 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:29:43.748947 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-faf73de6-1b49-41f2-bc9a-42c91b3f1993 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.143795 Nov 01 01:29:43.749500 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 802/1619] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:29:43 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:29:44.037359 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-6f676df9-b0be-45ea-aaee-e7f54cffe614 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:29:44.037983 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-6f676df9-b0be-45ea-aaee-e7f54cffe614 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:29:44.044186 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-6f676df9-b0be-45ea-aaee-e7f54cffe614 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:44.044773 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-6f676df9-b0be-45ea-aaee-e7f54cffe614 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:44.045635 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-6f676df9-b0be-45ea-aaee-e7f54cffe614 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:44.046065 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-6f676df9-b0be-45ea-aaee-e7f54cffe614 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:44.164984 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-6f676df9-b0be-45ea-aaee-e7f54cffe614 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:29:44.172253 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-6f676df9-b0be-45ea-aaee-e7f54cffe614 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1264 microversion: 2.1 time: 0.138531 Nov 01 01:29:44.172809 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 803/1620] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:29:44 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1264 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:29:44.766072 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-b3196f5b-a376-480b-91bc-e7c874fefc8b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:29:44.766723 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-b3196f5b-a376-480b-91bc-e7c874fefc8b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:29:44.772522 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b3196f5b-a376-480b-91bc-e7c874fefc8b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:44.772962 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b3196f5b-a376-480b-91bc-e7c874fefc8b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:44.773718 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b3196f5b-a376-480b-91bc-e7c874fefc8b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:44.774150 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b3196f5b-a376-480b-91bc-e7c874fefc8b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:44.889222 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-b3196f5b-a376-480b-91bc-e7c874fefc8b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:29:44.896409 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-b3196f5b-a376-480b-91bc-e7c874fefc8b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.134191 Nov 01 01:29:44.897482 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 804/1621] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:29:44 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:29:45.188825 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-092b336c-1021-4dfa-b18d-e0e46701d2ba tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:29:45.189474 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-092b336c-1021-4dfa-b18d-e0e46701d2ba tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:29:45.195640 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-092b336c-1021-4dfa-b18d-e0e46701d2ba tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:45.196075 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-092b336c-1021-4dfa-b18d-e0e46701d2ba tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:45.198212 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-092b336c-1021-4dfa-b18d-e0e46701d2ba tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:45.198212 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-092b336c-1021-4dfa-b18d-e0e46701d2ba tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:45.318626 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-092b336c-1021-4dfa-b18d-e0e46701d2ba tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:29:45.325828 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-092b336c-1021-4dfa-b18d-e0e46701d2ba tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1264 microversion: 2.1 time: 0.140676 Nov 01 01:29:45.326404 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 805/1622] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:29:45 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1264 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:29:45.914204 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-dc4161f8-092b-434c-b8fb-14e5cebb7a76 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:29:45.914830 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-dc4161f8-092b-434c-b8fb-14e5cebb7a76 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:29:45.920643 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-dc4161f8-092b-434c-b8fb-14e5cebb7a76 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:45.921085 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-dc4161f8-092b-434c-b8fb-14e5cebb7a76 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:45.921831 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-dc4161f8-092b-434c-b8fb-14e5cebb7a76 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:45.922255 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-dc4161f8-092b-434c-b8fb-14e5cebb7a76 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:46.037756 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-dc4161f8-092b-434c-b8fb-14e5cebb7a76 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:29:46.045059 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-dc4161f8-092b-434c-b8fb-14e5cebb7a76 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.135193 Nov 01 01:29:46.045620 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 806/1623] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:29:45 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:29:46.342879 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-6cea8786-2e5d-4cb4-bf5a-23f0fa372019 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:29:46.343577 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-6cea8786-2e5d-4cb4-bf5a-23f0fa372019 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:29:46.349853 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-6cea8786-2e5d-4cb4-bf5a-23f0fa372019 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:46.350290 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-6cea8786-2e5d-4cb4-bf5a-23f0fa372019 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:46.351343 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-6cea8786-2e5d-4cb4-bf5a-23f0fa372019 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:46.351766 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-6cea8786-2e5d-4cb4-bf5a-23f0fa372019 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:46.469349 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-6cea8786-2e5d-4cb4-bf5a-23f0fa372019 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:29:46.476827 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-6cea8786-2e5d-4cb4-bf5a-23f0fa372019 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1264 microversion: 2.1 time: 0.137697 Nov 01 01:29:46.477383 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 807/1624] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:29:46 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1264 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:29:47.061735 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-67230fbd-e4a6-4ba8-9c29-9c60b1b3e5af tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:29:47.062286 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-67230fbd-e4a6-4ba8-9c29-9c60b1b3e5af tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:29:47.068189 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-67230fbd-e4a6-4ba8-9c29-9c60b1b3e5af tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:47.068673 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-67230fbd-e4a6-4ba8-9c29-9c60b1b3e5af tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:47.069422 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-67230fbd-e4a6-4ba8-9c29-9c60b1b3e5af tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:47.069842 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-67230fbd-e4a6-4ba8-9c29-9c60b1b3e5af tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:47.198099 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-67230fbd-e4a6-4ba8-9c29-9c60b1b3e5af tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:29:47.205277 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-67230fbd-e4a6-4ba8-9c29-9c60b1b3e5af tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.147270 Nov 01 01:29:47.205840 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 808/1625] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:29:47 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:29:47.493797 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-13beae54-f321-49e3-a19b-7f445add4682 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:29:47.494476 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-13beae54-f321-49e3-a19b-7f445add4682 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:29:47.500288 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-13beae54-f321-49e3-a19b-7f445add4682 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:47.500753 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-13beae54-f321-49e3-a19b-7f445add4682 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:47.501492 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-13beae54-f321-49e3-a19b-7f445add4682 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:47.501916 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-13beae54-f321-49e3-a19b-7f445add4682 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:47.618626 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-13beae54-f321-49e3-a19b-7f445add4682 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:29:47.625769 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-13beae54-f321-49e3-a19b-7f445add4682 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1264 microversion: 2.1 time: 0.135675 Nov 01 01:29:47.626330 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 809/1626] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:29:47 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1264 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:29:48.222356 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-24eeffcd-1c14-4b24-ae0f-6f4e484fff1f tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:29:48.223030 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-24eeffcd-1c14-4b24-ae0f-6f4e484fff1f tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:29:48.229992 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-24eeffcd-1c14-4b24-ae0f-6f4e484fff1f tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:48.230446 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-24eeffcd-1c14-4b24-ae0f-6f4e484fff1f tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:48.231223 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-24eeffcd-1c14-4b24-ae0f-6f4e484fff1f tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:48.231659 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-24eeffcd-1c14-4b24-ae0f-6f4e484fff1f tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:48.348117 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-24eeffcd-1c14-4b24-ae0f-6f4e484fff1f tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:29:48.356530 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-24eeffcd-1c14-4b24-ae0f-6f4e484fff1f tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.137933 Nov 01 01:29:48.357090 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 810/1627] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:29:48 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:29:48.643303 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-a10d966c-fa69-4e72-9221-5a7e74575281 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:29:48.643952 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-a10d966c-fa69-4e72-9221-5a7e74575281 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:29:48.650214 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a10d966c-fa69-4e72-9221-5a7e74575281 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:48.650679 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a10d966c-fa69-4e72-9221-5a7e74575281 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:48.651464 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a10d966c-fa69-4e72-9221-5a7e74575281 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:48.651892 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a10d966c-fa69-4e72-9221-5a7e74575281 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:48.770901 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-a10d966c-fa69-4e72-9221-5a7e74575281 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:29:48.778858 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-a10d966c-fa69-4e72-9221-5a7e74575281 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1264 microversion: 2.1 time: 0.139327 Nov 01 01:29:48.779431 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 811/1628] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:29:48 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1264 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:29:49.373416 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-416abe87-9fca-4a53-9e93-87e1e0735b47 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:29:49.374024 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-416abe87-9fca-4a53-9e93-87e1e0735b47 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:29:49.380484 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-416abe87-9fca-4a53-9e93-87e1e0735b47 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:49.380980 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-416abe87-9fca-4a53-9e93-87e1e0735b47 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:49.382235 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-416abe87-9fca-4a53-9e93-87e1e0735b47 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:49.382697 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-416abe87-9fca-4a53-9e93-87e1e0735b47 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:49.498724 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-416abe87-9fca-4a53-9e93-87e1e0735b47 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:29:49.506572 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-416abe87-9fca-4a53-9e93-87e1e0735b47 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.136209 Nov 01 01:29:49.507139 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 812/1629] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:29:49 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:29:49.796460 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-75637348-2431-4e1d-921a-d8fc7d2e01cd tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:29:49.797089 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-75637348-2431-4e1d-921a-d8fc7d2e01cd tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:29:49.803416 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-75637348-2431-4e1d-921a-d8fc7d2e01cd tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:49.803864 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-75637348-2431-4e1d-921a-d8fc7d2e01cd tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:49.804621 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-75637348-2431-4e1d-921a-d8fc7d2e01cd tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:49.805046 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-75637348-2431-4e1d-921a-d8fc7d2e01cd tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:49.922164 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-75637348-2431-4e1d-921a-d8fc7d2e01cd tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:29:49.930030 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-75637348-2431-4e1d-921a-d8fc7d2e01cd tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1264 microversion: 2.1 time: 0.137324 Nov 01 01:29:49.930631 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 813/1630] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:29:49 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1264 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:29:50.524065 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-c1678952-f54c-4112-9b10-0cd1b5d87adc tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:29:50.524672 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-c1678952-f54c-4112-9b10-0cd1b5d87adc tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:29:50.530994 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c1678952-f54c-4112-9b10-0cd1b5d87adc tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:50.531440 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c1678952-f54c-4112-9b10-0cd1b5d87adc tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:50.532202 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c1678952-f54c-4112-9b10-0cd1b5d87adc tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:50.532839 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c1678952-f54c-4112-9b10-0cd1b5d87adc tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:50.657072 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-c1678952-f54c-4112-9b10-0cd1b5d87adc tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:29:50.664470 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-c1678952-f54c-4112-9b10-0cd1b5d87adc tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.144717 Nov 01 01:29:50.665040 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 814/1631] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:29:50 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:29:50.947826 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-82f74b21-e3b1-444b-829d-f7684ea906e0 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:29:50.948478 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-82f74b21-e3b1-444b-829d-f7684ea906e0 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:29:50.954307 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-82f74b21-e3b1-444b-829d-f7684ea906e0 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:50.954799 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-82f74b21-e3b1-444b-829d-f7684ea906e0 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:50.955578 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-82f74b21-e3b1-444b-829d-f7684ea906e0 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:50.956003 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-82f74b21-e3b1-444b-829d-f7684ea906e0 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:51.071970 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-82f74b21-e3b1-444b-829d-f7684ea906e0 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:29:51.079235 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-82f74b21-e3b1-444b-829d-f7684ea906e0 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1264 microversion: 2.1 time: 0.135618 Nov 01 01:29:51.079790 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 815/1632] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:29:50 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1264 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:29:51.681249 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-3b7f7da3-79a7-4ca7-a303-d3263cafc52a tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:29:51.681855 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-3b7f7da3-79a7-4ca7-a303-d3263cafc52a tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:29:51.688179 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3b7f7da3-79a7-4ca7-a303-d3263cafc52a tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:51.688617 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3b7f7da3-79a7-4ca7-a303-d3263cafc52a tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:51.689365 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3b7f7da3-79a7-4ca7-a303-d3263cafc52a tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:51.689790 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3b7f7da3-79a7-4ca7-a303-d3263cafc52a tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:51.808487 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-3b7f7da3-79a7-4ca7-a303-d3263cafc52a tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:29:51.815713 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-3b7f7da3-79a7-4ca7-a303-d3263cafc52a tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.138182 Nov 01 01:29:51.816272 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 816/1633] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:29:51 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:29:52.096329 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-8fd9e39d-708f-40e5-ad7a-55c2fd2af932 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:29:52.096949 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-8fd9e39d-708f-40e5-ad7a-55c2fd2af932 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:29:52.102968 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8fd9e39d-708f-40e5-ad7a-55c2fd2af932 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:52.103420 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8fd9e39d-708f-40e5-ad7a-55c2fd2af932 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:52.104181 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8fd9e39d-708f-40e5-ad7a-55c2fd2af932 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:52.104617 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8fd9e39d-708f-40e5-ad7a-55c2fd2af932 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:52.234453 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-8fd9e39d-708f-40e5-ad7a-55c2fd2af932 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:29:52.241583 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-8fd9e39d-708f-40e5-ad7a-55c2fd2af932 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1264 microversion: 2.1 time: 0.148994 Nov 01 01:29:52.242139 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 817/1634] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:29:52 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1264 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:29:52.832895 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-1ff2e8c5-b105-464c-a53f-78cfd32bb4b2 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:29:52.833504 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-1ff2e8c5-b105-464c-a53f-78cfd32bb4b2 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:29:52.840441 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-1ff2e8c5-b105-464c-a53f-78cfd32bb4b2 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:52.840887 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-1ff2e8c5-b105-464c-a53f-78cfd32bb4b2 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:52.841644 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-1ff2e8c5-b105-464c-a53f-78cfd32bb4b2 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:52.842071 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-1ff2e8c5-b105-464c-a53f-78cfd32bb4b2 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:52.957682 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-1ff2e8c5-b105-464c-a53f-78cfd32bb4b2 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:29:52.965615 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-1ff2e8c5-b105-464c-a53f-78cfd32bb4b2 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.136367 Nov 01 01:29:52.966183 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 818/1635] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:29:52 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:29:53.258345 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-14a650f2-7a97-4c96-99a6-b9e5d44b36ba tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:29:53.259107 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-14a650f2-7a97-4c96-99a6-b9e5d44b36ba tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:29:53.264851 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-14a650f2-7a97-4c96-99a6-b9e5d44b36ba tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:53.265291 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-14a650f2-7a97-4c96-99a6-b9e5d44b36ba tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:53.266048 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-14a650f2-7a97-4c96-99a6-b9e5d44b36ba tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:53.266509 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-14a650f2-7a97-4c96-99a6-b9e5d44b36ba tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:53.382958 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-14a650f2-7a97-4c96-99a6-b9e5d44b36ba tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:29:53.390136 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-14a650f2-7a97-4c96-99a6-b9e5d44b36ba tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1264 microversion: 2.1 time: 0.136127 Nov 01 01:29:53.390732 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 819/1636] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:29:53 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1264 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:29:53.982592 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-51f9d7ec-e9b7-4e0f-a669-aca57d230962 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:29:53.983203 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-51f9d7ec-e9b7-4e0f-a669-aca57d230962 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:29:53.989652 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-51f9d7ec-e9b7-4e0f-a669-aca57d230962 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:53.990097 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-51f9d7ec-e9b7-4e0f-a669-aca57d230962 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:53.990899 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-51f9d7ec-e9b7-4e0f-a669-aca57d230962 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:53.991330 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-51f9d7ec-e9b7-4e0f-a669-aca57d230962 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:54.112796 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-51f9d7ec-e9b7-4e0f-a669-aca57d230962 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:29:54.120076 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-51f9d7ec-e9b7-4e0f-a669-aca57d230962 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.141168 Nov 01 01:29:54.120638 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 820/1637] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:29:53 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:29:54.406051 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-c9d61b4d-6d35-423b-96e5-a016edaf1459 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:29:54.406677 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-c9d61b4d-6d35-423b-96e5-a016edaf1459 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:29:54.412490 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c9d61b4d-6d35-423b-96e5-a016edaf1459 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:54.413441 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c9d61b4d-6d35-423b-96e5-a016edaf1459 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:54.414192 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c9d61b4d-6d35-423b-96e5-a016edaf1459 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:54.414656 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c9d61b4d-6d35-423b-96e5-a016edaf1459 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:54.540088 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-c9d61b4d-6d35-423b-96e5-a016edaf1459 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:29:54.547324 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-c9d61b4d-6d35-423b-96e5-a016edaf1459 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1264 microversion: 2.1 time: 0.145006 Nov 01 01:29:54.547890 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 821/1638] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:29:54 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1264 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:29:55.143150 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-fd4623a1-97b2-49ed-845b-84d003a65c71 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:29:55.143759 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-fd4623a1-97b2-49ed-845b-84d003a65c71 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:29:55.150791 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-fd4623a1-97b2-49ed-845b-84d003a65c71 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:55.151236 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-fd4623a1-97b2-49ed-845b-84d003a65c71 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:55.152011 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-fd4623a1-97b2-49ed-845b-84d003a65c71 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:55.152438 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-fd4623a1-97b2-49ed-845b-84d003a65c71 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:55.281781 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-fd4623a1-97b2-49ed-845b-84d003a65c71 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:29:55.289156 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-fd4623a1-97b2-49ed-845b-84d003a65c71 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.149683 Nov 01 01:29:55.289738 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 822/1639] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:29:55 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:29:55.564948 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-69c7741f-1df8-4e49-ba53-8d88f4155411 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:29:55.565620 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-69c7741f-1df8-4e49-ba53-8d88f4155411 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:29:55.571921 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-69c7741f-1df8-4e49-ba53-8d88f4155411 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:55.572349 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-69c7741f-1df8-4e49-ba53-8d88f4155411 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:55.573093 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-69c7741f-1df8-4e49-ba53-8d88f4155411 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:55.573543 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-69c7741f-1df8-4e49-ba53-8d88f4155411 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:55.694263 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-69c7741f-1df8-4e49-ba53-8d88f4155411 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:29:55.701357 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-69c7741f-1df8-4e49-ba53-8d88f4155411 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1264 microversion: 2.1 time: 0.140401 Nov 01 01:29:55.701914 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 823/1640] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:29:55 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1264 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:29:56.306211 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-fdc11866-bb29-41ea-8077-a790dbd1b27d tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:29:56.306849 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-fdc11866-bb29-41ea-8077-a790dbd1b27d tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:29:56.313171 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-fdc11866-bb29-41ea-8077-a790dbd1b27d tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:56.313617 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-fdc11866-bb29-41ea-8077-a790dbd1b27d tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:56.314377 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-fdc11866-bb29-41ea-8077-a790dbd1b27d tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:56.314839 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-fdc11866-bb29-41ea-8077-a790dbd1b27d tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:56.433457 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-fdc11866-bb29-41ea-8077-a790dbd1b27d tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:29:56.440779 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-fdc11866-bb29-41ea-8077-a790dbd1b27d tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.138379 Nov 01 01:29:56.441376 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 824/1641] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:29:56 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:29:56.718749 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-f67cbe0f-dac7-45d2-9ad7-9735e123b276 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:29:56.719395 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-f67cbe0f-dac7-45d2-9ad7-9735e123b276 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:29:56.725070 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f67cbe0f-dac7-45d2-9ad7-9735e123b276 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:56.725518 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f67cbe0f-dac7-45d2-9ad7-9735e123b276 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:56.726569 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f67cbe0f-dac7-45d2-9ad7-9735e123b276 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:56.726998 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f67cbe0f-dac7-45d2-9ad7-9735e123b276 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:56.842747 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-f67cbe0f-dac7-45d2-9ad7-9735e123b276 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:29:56.849840 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-f67cbe0f-dac7-45d2-9ad7-9735e123b276 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1264 microversion: 2.1 time: 0.134778 Nov 01 01:29:56.850397 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 825/1642] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:29:56 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1264 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:29:57.457975 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-c13f8b12-5386-4bab-9ee2-c7fca6eefa11 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:29:57.458614 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-c13f8b12-5386-4bab-9ee2-c7fca6eefa11 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:29:57.464891 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c13f8b12-5386-4bab-9ee2-c7fca6eefa11 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:57.465365 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c13f8b12-5386-4bab-9ee2-c7fca6eefa11 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:57.466124 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c13f8b12-5386-4bab-9ee2-c7fca6eefa11 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:57.466588 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c13f8b12-5386-4bab-9ee2-c7fca6eefa11 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:57.587397 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-c13f8b12-5386-4bab-9ee2-c7fca6eefa11 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:29:57.595473 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-c13f8b12-5386-4bab-9ee2-c7fca6eefa11 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.141144 Nov 01 01:29:57.596071 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 826/1643] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:29:57 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:29:57.866505 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-ccc8db04-7ca0-4a8e-ac0d-1edc485c6c12 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:29:57.867160 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-ccc8db04-7ca0-4a8e-ac0d-1edc485c6c12 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:29:57.873032 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ccc8db04-7ca0-4a8e-ac0d-1edc485c6c12 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:57.873481 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ccc8db04-7ca0-4a8e-ac0d-1edc485c6c12 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:57.874241 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ccc8db04-7ca0-4a8e-ac0d-1edc485c6c12 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:57.874713 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ccc8db04-7ca0-4a8e-ac0d-1edc485c6c12 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:57.990723 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-ccc8db04-7ca0-4a8e-ac0d-1edc485c6c12 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:29:57.997867 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-ccc8db04-7ca0-4a8e-ac0d-1edc485c6c12 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1264 microversion: 2.1 time: 0.135070 Nov 01 01:29:57.998440 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 827/1644] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:29:57 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1264 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:29:58.612569 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-40f9cf07-81ec-46d0-bad8-ed503b87a1af tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:29:58.613184 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-40f9cf07-81ec-46d0-bad8-ed503b87a1af tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:29:58.620151 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-40f9cf07-81ec-46d0-bad8-ed503b87a1af tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:58.620593 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-40f9cf07-81ec-46d0-bad8-ed503b87a1af tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:58.621350 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-40f9cf07-81ec-46d0-bad8-ed503b87a1af tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:58.621776 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-40f9cf07-81ec-46d0-bad8-ed503b87a1af tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:58.738551 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-40f9cf07-81ec-46d0-bad8-ed503b87a1af tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:29:58.746479 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-40f9cf07-81ec-46d0-bad8-ed503b87a1af tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.137599 Nov 01 01:29:58.747045 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 828/1645] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:29:58 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:29:59.014701 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-2420231e-950f-4013-b8c7-0ae31c95b483 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:29:59.015358 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-2420231e-950f-4013-b8c7-0ae31c95b483 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:29:59.021021 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-2420231e-950f-4013-b8c7-0ae31c95b483 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:59.021466 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-2420231e-950f-4013-b8c7-0ae31c95b483 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:59.022220 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-2420231e-950f-4013-b8c7-0ae31c95b483 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:59.022671 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-2420231e-950f-4013-b8c7-0ae31c95b483 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:59.142871 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-2420231e-950f-4013-b8c7-0ae31c95b483 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:29:59.150821 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-2420231e-950f-4013-b8c7-0ae31c95b483 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1264 microversion: 2.1 time: 0.139142 Nov 01 01:29:59.151399 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 829/1646] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:29:59 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1264 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:29:59.763704 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-d3bb8b2c-6ed3-427f-8b5a-31e691017f25 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:29:59.764340 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-d3bb8b2c-6ed3-427f-8b5a-31e691017f25 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:29:59.770589 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d3bb8b2c-6ed3-427f-8b5a-31e691017f25 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:59.771037 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d3bb8b2c-6ed3-427f-8b5a-31e691017f25 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:59.771791 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d3bb8b2c-6ed3-427f-8b5a-31e691017f25 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:29:59.772218 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d3bb8b2c-6ed3-427f-8b5a-31e691017f25 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:29:59.888375 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-d3bb8b2c-6ed3-427f-8b5a-31e691017f25 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:29:59.895553 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-d3bb8b2c-6ed3-427f-8b5a-31e691017f25 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.136118 Nov 01 01:29:59.896113 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 830/1647] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:29:59 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:30:00.168409 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-ba70e01f-63e8-4b9e-a990-5348b45bcc3e tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:30:00.169018 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-ba70e01f-63e8-4b9e-a990-5348b45bcc3e tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:30:00.174828 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ba70e01f-63e8-4b9e-a990-5348b45bcc3e tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:30:00.175275 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ba70e01f-63e8-4b9e-a990-5348b45bcc3e tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:30:00.176034 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ba70e01f-63e8-4b9e-a990-5348b45bcc3e tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:30:00.176463 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ba70e01f-63e8-4b9e-a990-5348b45bcc3e tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:30:00.293056 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-ba70e01f-63e8-4b9e-a990-5348b45bcc3e tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:30:00.300239 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-ba70e01f-63e8-4b9e-a990-5348b45bcc3e tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1264 microversion: 2.1 time: 0.135977 Nov 01 01:30:00.300802 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 831/1648] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:30:00 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1264 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:30:00.912037 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-2cf6ea0b-eee1-4090-ba62-f7696c4b5e2b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:30:00.912650 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-2cf6ea0b-eee1-4090-ba62-f7696c4b5e2b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:30:00.919440 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-2cf6ea0b-eee1-4090-ba62-f7696c4b5e2b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:30:00.919882 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-2cf6ea0b-eee1-4090-ba62-f7696c4b5e2b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:30:00.920637 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-2cf6ea0b-eee1-4090-ba62-f7696c4b5e2b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:30:00.921067 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-2cf6ea0b-eee1-4090-ba62-f7696c4b5e2b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:30:01.041631 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-2cf6ea0b-eee1-4090-ba62-f7696c4b5e2b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:30:01.047469 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-2cf6ea0b-eee1-4090-ba62-f7696c4b5e2b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.139127 Nov 01 01:30:01.048030 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 832/1649] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:30:00 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:30:01.317274 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-8bc116cf-3c13-4c6e-995f-80b3ded77f41 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:30:01.317926 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-8bc116cf-3c13-4c6e-995f-80b3ded77f41 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:30:01.323784 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8bc116cf-3c13-4c6e-995f-80b3ded77f41 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:30:01.324231 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8bc116cf-3c13-4c6e-995f-80b3ded77f41 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:30:01.324989 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8bc116cf-3c13-4c6e-995f-80b3ded77f41 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:30:01.325419 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8bc116cf-3c13-4c6e-995f-80b3ded77f41 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:30:01.441672 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-8bc116cf-3c13-4c6e-995f-80b3ded77f41 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:30:01.449144 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-8bc116cf-3c13-4c6e-995f-80b3ded77f41 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1264 microversion: 2.1 time: 0.135563 Nov 01 01:30:01.449706 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 833/1650] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:30:01 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1264 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:30:02.064306 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-ab16e81b-77f5-4a73-95dd-05f11b0ff38a tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:30:02.064840 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-ab16e81b-77f5-4a73-95dd-05f11b0ff38a tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:30:02.071119 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ab16e81b-77f5-4a73-95dd-05f11b0ff38a tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:30:02.071566 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ab16e81b-77f5-4a73-95dd-05f11b0ff38a tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:30:02.072322 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ab16e81b-77f5-4a73-95dd-05f11b0ff38a tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:30:02.072746 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ab16e81b-77f5-4a73-95dd-05f11b0ff38a tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:30:02.190813 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-ab16e81b-77f5-4a73-95dd-05f11b0ff38a tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:30:02.198152 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-ab16e81b-77f5-4a73-95dd-05f11b0ff38a tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.137597 Nov 01 01:30:02.198753 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 834/1651] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:30:02 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:30:02.466597 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-59fd1904-61ff-47c7-8d67-d0ac621c788a tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:30:02.467187 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-59fd1904-61ff-47c7-8d67-d0ac621c788a tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:30:02.473053 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-59fd1904-61ff-47c7-8d67-d0ac621c788a tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:30:02.473495 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-59fd1904-61ff-47c7-8d67-d0ac621c788a tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:30:02.474251 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-59fd1904-61ff-47c7-8d67-d0ac621c788a tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:30:02.474704 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-59fd1904-61ff-47c7-8d67-d0ac621c788a tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:30:02.599853 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-59fd1904-61ff-47c7-8d67-d0ac621c788a tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:30:02.607309 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-59fd1904-61ff-47c7-8d67-d0ac621c788a tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1264 microversion: 2.1 time: 0.145002 Nov 01 01:30:02.607872 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 835/1652] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:30:02 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1264 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:30:03.216249 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-e67a1390-326a-419d-8e64-0ffbd85585a1 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:30:03.216860 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-e67a1390-326a-419d-8e64-0ffbd85585a1 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:30:03.223126 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e67a1390-326a-419d-8e64-0ffbd85585a1 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:30:03.223567 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e67a1390-326a-419d-8e64-0ffbd85585a1 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:30:03.224359 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e67a1390-326a-419d-8e64-0ffbd85585a1 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:30:03.224785 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e67a1390-326a-419d-8e64-0ffbd85585a1 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:30:03.341769 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-e67a1390-326a-419d-8e64-0ffbd85585a1 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:30:03.349124 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-e67a1390-326a-419d-8e64-0ffbd85585a1 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.137699 Nov 01 01:30:03.349692 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 836/1653] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:30:03 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:30:03.624880 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-38bd1e48-60ab-4451-ae07-c1b9eadcbd70 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:30:03.625472 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-38bd1e48-60ab-4451-ae07-c1b9eadcbd70 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:30:03.631217 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-38bd1e48-60ab-4451-ae07-c1b9eadcbd70 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:30:03.631662 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-38bd1e48-60ab-4451-ae07-c1b9eadcbd70 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:30:03.632414 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-38bd1e48-60ab-4451-ae07-c1b9eadcbd70 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:30:03.632841 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-38bd1e48-60ab-4451-ae07-c1b9eadcbd70 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:30:03.756470 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-38bd1e48-60ab-4451-ae07-c1b9eadcbd70 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:30:03.761851 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-38bd1e48-60ab-4451-ae07-c1b9eadcbd70 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1264 microversion: 2.1 time: 0.140684 Nov 01 01:30:03.762432 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 837/1654] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:30:03 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1264 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:30:04.365717 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-22a76442-9915-4d4e-bf86-ec6e11bef3b9 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:30:04.366330 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-22a76442-9915-4d4e-bf86-ec6e11bef3b9 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:30:04.372527 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-22a76442-9915-4d4e-bf86-ec6e11bef3b9 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:30:04.372964 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-22a76442-9915-4d4e-bf86-ec6e11bef3b9 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:30:04.373708 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-22a76442-9915-4d4e-bf86-ec6e11bef3b9 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:30:04.374129 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-22a76442-9915-4d4e-bf86-ec6e11bef3b9 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:30:04.492772 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-22a76442-9915-4d4e-bf86-ec6e11bef3b9 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:30:04.500086 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-22a76442-9915-4d4e-bf86-ec6e11bef3b9 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.138026 Nov 01 01:30:04.500645 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 838/1655] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:30:04 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:30:04.778737 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-f2d78479-a95e-42ea-af7d-f8c37b00ac2b tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:30:04.779459 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-f2d78479-a95e-42ea-af7d-f8c37b00ac2b tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:30:04.785256 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f2d78479-a95e-42ea-af7d-f8c37b00ac2b tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:30:04.785694 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f2d78479-a95e-42ea-af7d-f8c37b00ac2b tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:30:04.786466 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f2d78479-a95e-42ea-af7d-f8c37b00ac2b tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:30:04.786893 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f2d78479-a95e-42ea-af7d-f8c37b00ac2b tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:30:04.903096 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-f2d78479-a95e-42ea-af7d-f8c37b00ac2b tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:30:04.910161 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-f2d78479-a95e-42ea-af7d-f8c37b00ac2b tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1264 microversion: 2.1 time: 0.134972 Nov 01 01:30:04.910750 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 839/1656] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:30:04 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1264 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:30:05.516642 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-f3df7271-a11a-4657-b6f2-75ea82700ac1 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:30:05.517220 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-f3df7271-a11a-4657-b6f2-75ea82700ac1 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:30:05.523407 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f3df7271-a11a-4657-b6f2-75ea82700ac1 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:30:05.523865 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f3df7271-a11a-4657-b6f2-75ea82700ac1 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:30:05.524594 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f3df7271-a11a-4657-b6f2-75ea82700ac1 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:30:05.525017 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f3df7271-a11a-4657-b6f2-75ea82700ac1 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:30:05.649309 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-f3df7271-a11a-4657-b6f2-75ea82700ac1 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:30:05.657199 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-f3df7271-a11a-4657-b6f2-75ea82700ac1 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.144235 Nov 01 01:30:05.657764 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 840/1657] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:30:05 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:30:05.927702 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-f24f0599-bb05-40de-a043-9fe389a655cd tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:30:05.928451 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-f24f0599-bb05-40de-a043-9fe389a655cd tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:30:05.934819 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f24f0599-bb05-40de-a043-9fe389a655cd tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:30:05.935265 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f24f0599-bb05-40de-a043-9fe389a655cd tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:30:05.936022 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f24f0599-bb05-40de-a043-9fe389a655cd tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:30:05.936454 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f24f0599-bb05-40de-a043-9fe389a655cd tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:30:06.055082 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-f24f0599-bb05-40de-a043-9fe389a655cd tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:30:06.062644 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-f24f0599-bb05-40de-a043-9fe389a655cd tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1264 microversion: 2.1 time: 0.138607 Nov 01 01:30:06.063197 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 841/1658] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:30:05 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1264 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:30:06.673834 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-f5ccad26-1aab-4266-b33a-9dfaa85a1aa1 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:30:06.674360 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-f5ccad26-1aab-4266-b33a-9dfaa85a1aa1 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:30:06.680603 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f5ccad26-1aab-4266-b33a-9dfaa85a1aa1 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:30:06.681041 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f5ccad26-1aab-4266-b33a-9dfaa85a1aa1 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:30:06.681819 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f5ccad26-1aab-4266-b33a-9dfaa85a1aa1 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:30:06.682272 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f5ccad26-1aab-4266-b33a-9dfaa85a1aa1 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:30:06.798583 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-f5ccad26-1aab-4266-b33a-9dfaa85a1aa1 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:30:06.805767 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-f5ccad26-1aab-4266-b33a-9dfaa85a1aa1 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.135638 Nov 01 01:30:06.806342 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 842/1659] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:30:06 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:30:07.080053 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-47bff7ce-81e4-4ffe-acaa-97bf84afb9be tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:30:07.080689 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-47bff7ce-81e4-4ffe-acaa-97bf84afb9be tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:30:07.086450 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-47bff7ce-81e4-4ffe-acaa-97bf84afb9be tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:30:07.086911 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-47bff7ce-81e4-4ffe-acaa-97bf84afb9be tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:30:07.088278 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-47bff7ce-81e4-4ffe-acaa-97bf84afb9be tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:30:07.088715 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-47bff7ce-81e4-4ffe-acaa-97bf84afb9be tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:30:07.208398 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-47bff7ce-81e4-4ffe-acaa-97bf84afb9be tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:30:07.216227 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-47bff7ce-81e4-4ffe-acaa-97bf84afb9be tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1264 microversion: 2.1 time: 0.139779 Nov 01 01:30:07.216798 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 843/1660] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:30:07 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1264 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:30:07.822688 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-e5891fc2-c71c-427a-b43d-6902a8f1524b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:30:07.823294 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-e5891fc2-c71c-427a-b43d-6902a8f1524b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:30:07.829538 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e5891fc2-c71c-427a-b43d-6902a8f1524b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:30:07.829986 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e5891fc2-c71c-427a-b43d-6902a8f1524b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:30:07.830779 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e5891fc2-c71c-427a-b43d-6902a8f1524b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:30:07.831213 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e5891fc2-c71c-427a-b43d-6902a8f1524b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:30:07.959715 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-e5891fc2-c71c-427a-b43d-6902a8f1524b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:30:07.966958 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-e5891fc2-c71c-427a-b43d-6902a8f1524b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.147977 Nov 01 01:30:07.967526 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 844/1661] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:30:07 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:30:08.234906 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-9dfee9e6-45a2-4ed0-86b2-efb327190753 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:30:08.235583 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-9dfee9e6-45a2-4ed0-86b2-efb327190753 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:30:08.241456 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9dfee9e6-45a2-4ed0-86b2-efb327190753 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:30:08.241897 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9dfee9e6-45a2-4ed0-86b2-efb327190753 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:30:08.242674 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9dfee9e6-45a2-4ed0-86b2-efb327190753 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:30:08.243108 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9dfee9e6-45a2-4ed0-86b2-efb327190753 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:30:08.362328 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-9dfee9e6-45a2-4ed0-86b2-efb327190753 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:30:08.369545 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-9dfee9e6-45a2-4ed0-86b2-efb327190753 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1264 microversion: 2.1 time: 0.138734 Nov 01 01:30:08.370097 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 845/1662] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:30:08 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1264 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:30:08.983873 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-f0ae22d4-ba88-447d-bd11-fe29de264e9c tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:30:08.984583 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-f0ae22d4-ba88-447d-bd11-fe29de264e9c tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:30:08.990834 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f0ae22d4-ba88-447d-bd11-fe29de264e9c tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:30:08.991272 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f0ae22d4-ba88-447d-bd11-fe29de264e9c tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:30:08.992020 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f0ae22d4-ba88-447d-bd11-fe29de264e9c tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:30:08.992442 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f0ae22d4-ba88-447d-bd11-fe29de264e9c tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:30:09.110211 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-f0ae22d4-ba88-447d-bd11-fe29de264e9c tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:30:09.117402 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-f0ae22d4-ba88-447d-bd11-fe29de264e9c tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.137176 Nov 01 01:30:09.117961 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 846/1663] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:30:08 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:30:09.386117 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-9ec317db-4297-4503-a7d6-0a772d51b1a7 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:30:09.386746 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-9ec317db-4297-4503-a7d6-0a772d51b1a7 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:30:09.392551 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9ec317db-4297-4503-a7d6-0a772d51b1a7 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:30:09.392991 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9ec317db-4297-4503-a7d6-0a772d51b1a7 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:30:09.393744 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9ec317db-4297-4503-a7d6-0a772d51b1a7 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:30:09.394172 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9ec317db-4297-4503-a7d6-0a772d51b1a7 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:30:09.514837 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-9ec317db-4297-4503-a7d6-0a772d51b1a7 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:30:09.521985 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-9ec317db-4297-4503-a7d6-0a772d51b1a7 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1264 microversion: 2.1 time: 0.140108 Nov 01 01:30:09.522564 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 847/1664] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:30:09 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1264 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:30:10.134504 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-2ec3855e-4f49-4d08-b46d-5f90ce654f02 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:30:10.135119 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-2ec3855e-4f49-4d08-b46d-5f90ce654f02 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:30:10.141418 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-2ec3855e-4f49-4d08-b46d-5f90ce654f02 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:30:10.141867 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-2ec3855e-4f49-4d08-b46d-5f90ce654f02 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:30:10.142658 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-2ec3855e-4f49-4d08-b46d-5f90ce654f02 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:30:10.143096 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-2ec3855e-4f49-4d08-b46d-5f90ce654f02 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:30:10.260045 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-2ec3855e-4f49-4d08-b46d-5f90ce654f02 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:30:10.267328 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-2ec3855e-4f49-4d08-b46d-5f90ce654f02 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.136493 Nov 01 01:30:10.267896 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 848/1665] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:30:10 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:30:10.539232 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-bc850339-8c2a-4edc-96a8-20809961be55 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:30:10.539883 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-bc850339-8c2a-4edc-96a8-20809961be55 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:30:10.546267 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-bc850339-8c2a-4edc-96a8-20809961be55 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:30:10.546743 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-bc850339-8c2a-4edc-96a8-20809961be55 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:30:10.547507 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-bc850339-8c2a-4edc-96a8-20809961be55 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:30:10.547938 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-bc850339-8c2a-4edc-96a8-20809961be55 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:30:10.665487 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-bc850339-8c2a-4edc-96a8-20809961be55 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:30:10.672835 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-bc850339-8c2a-4edc-96a8-20809961be55 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1264 microversion: 2.1 time: 0.137229 Nov 01 01:30:10.673412 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 849/1666] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:30:10 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1264 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:30:11.284542 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-d8f6eae1-6b81-44b5-8874-45d465de9cc0 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:30:11.285146 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-d8f6eae1-6b81-44b5-8874-45d465de9cc0 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:30:11.291439 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d8f6eae1-6b81-44b5-8874-45d465de9cc0 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:30:11.291882 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d8f6eae1-6b81-44b5-8874-45d465de9cc0 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:30:11.292636 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d8f6eae1-6b81-44b5-8874-45d465de9cc0 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:30:11.293065 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d8f6eae1-6b81-44b5-8874-45d465de9cc0 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:30:11.412839 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-d8f6eae1-6b81-44b5-8874-45d465de9cc0 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:30:11.420689 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-d8f6eae1-6b81-44b5-8874-45d465de9cc0 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.139970 Nov 01 01:30:11.421254 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 850/1667] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:30:11 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:30:11.689717 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-ca84d919-762e-46a7-b795-5db1304d310e tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:30:11.690530 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-ca84d919-762e-46a7-b795-5db1304d310e tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:30:11.696381 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ca84d919-762e-46a7-b795-5db1304d310e tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:30:11.696822 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ca84d919-762e-46a7-b795-5db1304d310e tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:30:11.697564 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ca84d919-762e-46a7-b795-5db1304d310e tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:30:11.697994 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ca84d919-762e-46a7-b795-5db1304d310e tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:30:11.819337 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-ca84d919-762e-46a7-b795-5db1304d310e tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:30:11.826602 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-ca84d919-762e-46a7-b795-5db1304d310e tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1264 microversion: 2.1 time: 0.140448 Nov 01 01:30:11.827157 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 851/1668] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:30:11 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1264 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:30:12.437380 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-565f9025-1e9c-4d47-beba-2eb7f060e2bf tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:30:12.437989 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-565f9025-1e9c-4d47-beba-2eb7f060e2bf tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:30:12.444341 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-565f9025-1e9c-4d47-beba-2eb7f060e2bf tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:30:12.444781 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-565f9025-1e9c-4d47-beba-2eb7f060e2bf tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:30:12.445536 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-565f9025-1e9c-4d47-beba-2eb7f060e2bf tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:30:12.445966 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-565f9025-1e9c-4d47-beba-2eb7f060e2bf tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:30:12.563548 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-565f9025-1e9c-4d47-beba-2eb7f060e2bf tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:30:12.570765 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-565f9025-1e9c-4d47-beba-2eb7f060e2bf tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.137595 Nov 01 01:30:12.571319 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 852/1669] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:30:12 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:30:12.843571 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-877ace1c-d0b0-4df6-931f-d6695f197361 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:30:12.844163 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-877ace1c-d0b0-4df6-931f-d6695f197361 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:30:12.849846 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-877ace1c-d0b0-4df6-931f-d6695f197361 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:30:12.850577 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-877ace1c-d0b0-4df6-931f-d6695f197361 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:30:12.851333 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-877ace1c-d0b0-4df6-931f-d6695f197361 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:30:12.851762 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-877ace1c-d0b0-4df6-931f-d6695f197361 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:30:12.972039 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-877ace1c-d0b0-4df6-931f-d6695f197361 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:30:12.979439 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-877ace1c-d0b0-4df6-931f-d6695f197361 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1264 microversion: 2.1 time: 0.139551 Nov 01 01:30:12.979996 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 853/1670] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:30:12 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1264 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:30:13.588077 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-bbc4443a-305e-4e92-b307-9a1b5c9aab4d tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:30:13.588684 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-bbc4443a-305e-4e92-b307-9a1b5c9aab4d tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:30:13.595420 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-bbc4443a-305e-4e92-b307-9a1b5c9aab4d tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:30:13.595858 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-bbc4443a-305e-4e92-b307-9a1b5c9aab4d tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:30:13.596605 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-bbc4443a-305e-4e92-b307-9a1b5c9aab4d tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:30:13.597029 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-bbc4443a-305e-4e92-b307-9a1b5c9aab4d tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:30:13.716139 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-bbc4443a-305e-4e92-b307-9a1b5c9aab4d tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:30:13.723381 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-bbc4443a-305e-4e92-b307-9a1b5c9aab4d tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.139062 Nov 01 01:30:13.723950 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 854/1671] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:30:13 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:30:13.729265 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-78aa440a-9a7b-4efc-9dba-65478d31975f tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:30:13.729915 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-78aa440a-9a7b-4efc-9dba-65478d31975f tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:30:13.735675 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-78aa440a-9a7b-4efc-9dba-65478d31975f tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:30:13.735951 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-78aa440a-9a7b-4efc-9dba-65478d31975f tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:30:13.736715 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-78aa440a-9a7b-4efc-9dba-65478d31975f tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:30:13.737235 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-78aa440a-9a7b-4efc-9dba-65478d31975f tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:30:13.776303 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-78aa440a-9a7b-4efc-9dba-65478d31975f tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043204 Nov 01 01:30:13.776303 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 855/1672] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:30:13 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:30:13.786349 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.objects.instance [None req-fc05b5fa-a9d7-4080-a0d8-b66e459a11f2 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lazy-loading 'services' on Instance uuid 0eb63a66-7e46-40fb-9087-543fbf9cad4b {{(pid=116266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 01 01:30:13.997368 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-dc7cd3f7-3cee-42ca-ad8c-1657b10ced61 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:30:13.997973 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-dc7cd3f7-3cee-42ca-ad8c-1657b10ced61 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:30:14.003655 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-dc7cd3f7-3cee-42ca-ad8c-1657b10ced61 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:30:14.004099 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-dc7cd3f7-3cee-42ca-ad8c-1657b10ced61 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:30:14.004851 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-dc7cd3f7-3cee-42ca-ad8c-1657b10ced61 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:30:14.005279 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-dc7cd3f7-3cee-42ca-ad8c-1657b10ced61 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:30:14.124041 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-dc7cd3f7-3cee-42ca-ad8c-1657b10ced61 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:30:14.131295 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-dc7cd3f7-3cee-42ca-ad8c-1657b10ced61 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1264 microversion: 2.1 time: 0.138167 Nov 01 01:30:14.131854 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 856/1673] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:30:13 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1264 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:30:14.740153 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-5238a84e-aefc-4d19-8544-197e127213b1 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:30:14.740755 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-5238a84e-aefc-4d19-8544-197e127213b1 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:30:14.747069 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-5238a84e-aefc-4d19-8544-197e127213b1 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:30:14.747513 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-5238a84e-aefc-4d19-8544-197e127213b1 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:30:14.748264 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-5238a84e-aefc-4d19-8544-197e127213b1 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:30:14.748726 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-5238a84e-aefc-4d19-8544-197e127213b1 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:30:14.868468 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-5238a84e-aefc-4d19-8544-197e127213b1 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:30:14.875710 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-5238a84e-aefc-4d19-8544-197e127213b1 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.139218 Nov 01 01:30:14.876274 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 857/1674] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:30:14 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:30:14.880527 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-b4a3215a-5079-4468-9ccc-efe3989b7b11 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:30:14.881412 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-b4a3215a-5079-4468-9ccc-efe3989b7b11 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:30:14.886701 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b4a3215a-5079-4468-9ccc-efe3989b7b11 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:30:14.887146 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b4a3215a-5079-4468-9ccc-efe3989b7b11 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:30:14.887950 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b4a3215a-5079-4468-9ccc-efe3989b7b11 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:30:14.888380 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b4a3215a-5079-4468-9ccc-efe3989b7b11 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:30:14.916603 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-b4a3215a-5079-4468-9ccc-efe3989b7b11 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039361 Nov 01 01:30:14.917147 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 858/1675] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:30:14 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:30:15.148852 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-5c030aea-d46b-4f99-be7b-f096a3893ebe tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:30:15.149454 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-5c030aea-d46b-4f99-be7b-f096a3893ebe tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:30:15.155723 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-5c030aea-d46b-4f99-be7b-f096a3893ebe tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:30:15.156171 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-5c030aea-d46b-4f99-be7b-f096a3893ebe tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:30:15.156921 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-5c030aea-d46b-4f99-be7b-f096a3893ebe tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:30:15.157348 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-5c030aea-d46b-4f99-be7b-f096a3893ebe tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:30:15.487412 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-5c030aea-d46b-4f99-be7b-f096a3893ebe tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:30:15.494509 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-5c030aea-d46b-4f99-be7b-f096a3893ebe tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1264 microversion: 2.1 time: 0.349265 Nov 01 01:30:15.495099 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 859/1676] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:30:15 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1264 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:30:15.891501 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-92a8a461-650b-4418-8743-3327c4cc7316 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:30:15.892109 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-92a8a461-650b-4418-8743-3327c4cc7316 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:30:15.898513 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-92a8a461-650b-4418-8743-3327c4cc7316 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:30:15.900033 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-92a8a461-650b-4418-8743-3327c4cc7316 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:30:15.900806 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-92a8a461-650b-4418-8743-3327c4cc7316 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:30:15.901239 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-92a8a461-650b-4418-8743-3327c4cc7316 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:30:16.020858 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-92a8a461-650b-4418-8743-3327c4cc7316 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:30:16.028284 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-92a8a461-650b-4418-8743-3327c4cc7316 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.140474 Nov 01 01:30:16.028802 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 860/1677] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:30:15 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:30:16.033281 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-9c40a1df-795a-414a-923a-89bc861ebe83 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:30:16.034167 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-9c40a1df-795a-414a-923a-89bc861ebe83 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:30:16.039664 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9c40a1df-795a-414a-923a-89bc861ebe83 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:30:16.046192 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9c40a1df-795a-414a-923a-89bc861ebe83 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:30:16.046192 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9c40a1df-795a-414a-923a-89bc861ebe83 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:30:16.046192 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9c40a1df-795a-414a-923a-89bc861ebe83 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:30:16.070871 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-9c40a1df-795a-414a-923a-89bc861ebe83 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040916 Nov 01 01:30:16.071454 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 861/1678] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:30:16 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:30:16.512084 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-39ea8954-5fd9-4933-a504-f8fe49798310 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:30:16.512693 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-39ea8954-5fd9-4933-a504-f8fe49798310 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:30:16.518985 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-39ea8954-5fd9-4933-a504-f8fe49798310 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:30:16.519430 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-39ea8954-5fd9-4933-a504-f8fe49798310 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:30:16.520182 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-39ea8954-5fd9-4933-a504-f8fe49798310 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:30:16.520609 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-39ea8954-5fd9-4933-a504-f8fe49798310 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:30:16.645510 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-39ea8954-5fd9-4933-a504-f8fe49798310 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:30:16.652702 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-39ea8954-5fd9-4933-a504-f8fe49798310 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1264 microversion: 2.1 time: 0.144458 Nov 01 01:30:16.653266 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 862/1679] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:30:16 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1264 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:30:17.044607 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-56270df7-b96b-459d-9a55-3f4bc877a93e tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:30:17.045216 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-56270df7-b96b-459d-9a55-3f4bc877a93e tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:30:17.051589 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-56270df7-b96b-459d-9a55-3f4bc877a93e tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:30:17.052033 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-56270df7-b96b-459d-9a55-3f4bc877a93e tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:30:17.052821 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-56270df7-b96b-459d-9a55-3f4bc877a93e tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:30:17.053247 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-56270df7-b96b-459d-9a55-3f4bc877a93e tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:30:17.170776 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-56270df7-b96b-459d-9a55-3f4bc877a93e tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:30:17.178050 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-56270df7-b96b-459d-9a55-3f4bc877a93e tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.137041 Nov 01 01:30:17.178649 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 863/1680] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:30:17 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:30:17.182891 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-cee63c1c-8757-422e-b602-e94f4f2a2ecf tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:30:17.183779 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-cee63c1c-8757-422e-b602-e94f4f2a2ecf tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:30:17.189582 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-cee63c1c-8757-422e-b602-e94f4f2a2ecf tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:30:17.190022 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-cee63c1c-8757-422e-b602-e94f4f2a2ecf tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:30:17.190813 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-cee63c1c-8757-422e-b602-e94f4f2a2ecf tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:30:17.191242 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-cee63c1c-8757-422e-b602-e94f4f2a2ecf tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:30:17.223346 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-cee63c1c-8757-422e-b602-e94f4f2a2ecf tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043689 Nov 01 01:30:17.223895 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 864/1681] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:30:17 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:30:17.670864 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-3fd242a0-6457-49f4-b675-1c24159d2a6c tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:30:17.671509 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-3fd242a0-6457-49f4-b675-1c24159d2a6c tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:30:17.677402 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3fd242a0-6457-49f4-b675-1c24159d2a6c tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:30:17.677845 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3fd242a0-6457-49f4-b675-1c24159d2a6c tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:30:17.678636 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3fd242a0-6457-49f4-b675-1c24159d2a6c tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:30:17.679061 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3fd242a0-6457-49f4-b675-1c24159d2a6c tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:30:17.801012 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-3fd242a0-6457-49f4-b675-1c24159d2a6c tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:30:17.808166 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-3fd242a0-6457-49f4-b675-1c24159d2a6c tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1264 microversion: 2.1 time: 0.141577 Nov 01 01:30:17.808725 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 865/1682] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:30:17 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1264 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:30:18.194975 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-db778316-0ff7-4894-974a-98a285371f53 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:30:18.195578 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-db778316-0ff7-4894-974a-98a285371f53 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:30:18.201724 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-db778316-0ff7-4894-974a-98a285371f53 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:30:18.202196 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-db778316-0ff7-4894-974a-98a285371f53 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:30:18.202978 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-db778316-0ff7-4894-974a-98a285371f53 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:30:18.203405 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-db778316-0ff7-4894-974a-98a285371f53 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:30:18.325777 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-db778316-0ff7-4894-974a-98a285371f53 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:30:18.333065 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-db778316-0ff7-4894-974a-98a285371f53 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.141767 Nov 01 01:30:18.333634 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 866/1683] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:30:18 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:30:18.337984 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-a10c5aa4-593d-4c1a-a111-c2647705468c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:30:18.338909 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-a10c5aa4-593d-4c1a-a111-c2647705468c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:30:18.344836 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a10c5aa4-593d-4c1a-a111-c2647705468c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:30:18.345287 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a10c5aa4-593d-4c1a-a111-c2647705468c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:30:18.346053 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a10c5aa4-593d-4c1a-a111-c2647705468c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:30:18.346509 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a10c5aa4-593d-4c1a-a111-c2647705468c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:30:18.376765 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-a10c5aa4-593d-4c1a-a111-c2647705468c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042121 Nov 01 01:30:18.377824 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 867/1684] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:30:18 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:30:18.825530 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-a55ade49-3e16-43d5-ab9e-8902f51f4209 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:30:18.826197 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-a55ade49-3e16-43d5-ab9e-8902f51f4209 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:30:18.832454 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a55ade49-3e16-43d5-ab9e-8902f51f4209 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:30:18.832889 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a55ade49-3e16-43d5-ab9e-8902f51f4209 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:30:18.833641 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a55ade49-3e16-43d5-ab9e-8902f51f4209 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:30:18.834063 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a55ade49-3e16-43d5-ab9e-8902f51f4209 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:30:18.950014 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-a55ade49-3e16-43d5-ab9e-8902f51f4209 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:30:18.957934 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-a55ade49-3e16-43d5-ab9e-8902f51f4209 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1264 microversion: 2.1 time: 0.136135 Nov 01 01:30:18.958510 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 868/1685] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:30:18 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1264 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:30:19.350532 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-b0fde9fb-e74f-4394-bf77-c8abc6f22e70 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:30:19.351215 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-b0fde9fb-e74f-4394-bf77-c8abc6f22e70 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:30:19.358140 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b0fde9fb-e74f-4394-bf77-c8abc6f22e70 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:30:19.358615 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b0fde9fb-e74f-4394-bf77-c8abc6f22e70 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:30:19.359392 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b0fde9fb-e74f-4394-bf77-c8abc6f22e70 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:30:19.359812 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b0fde9fb-e74f-4394-bf77-c8abc6f22e70 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:30:19.476759 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-b0fde9fb-e74f-4394-bf77-c8abc6f22e70 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:30:19.484580 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-b0fde9fb-e74f-4394-bf77-c8abc6f22e70 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.137963 Nov 01 01:30:19.485170 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 869/1686] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:30:19 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:30:19.489510 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-797cd309-3a5d-4764-856c-253f9fa51e8f tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:30:19.490399 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-797cd309-3a5d-4764-856c-253f9fa51e8f tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:30:19.495723 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-797cd309-3a5d-4764-856c-253f9fa51e8f tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:30:19.496180 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-797cd309-3a5d-4764-856c-253f9fa51e8f tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:30:19.496925 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-797cd309-3a5d-4764-856c-253f9fa51e8f tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:30:19.497353 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-797cd309-3a5d-4764-856c-253f9fa51e8f tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:30:19.525914 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-797cd309-3a5d-4764-856c-253f9fa51e8f tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039705 Nov 01 01:30:19.526375 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 870/1687] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:30:19 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:30:19.975516 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-049727e6-3249-49c5-a9f5-b36013cb74dd tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:30:19.976166 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-049727e6-3249-49c5-a9f5-b36013cb74dd tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:30:19.981945 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-049727e6-3249-49c5-a9f5-b36013cb74dd tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:30:19.982405 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-049727e6-3249-49c5-a9f5-b36013cb74dd tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:30:19.983172 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-049727e6-3249-49c5-a9f5-b36013cb74dd tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:30:19.983599 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-049727e6-3249-49c5-a9f5-b36013cb74dd tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:30:20.103269 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-049727e6-3249-49c5-a9f5-b36013cb74dd tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:30:20.110571 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-049727e6-3249-49c5-a9f5-b36013cb74dd tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1264 microversion: 2.1 time: 0.138936 Nov 01 01:30:20.111129 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 871/1688] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:30:19 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1264 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:30:20.501566 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-e32c040d-c757-46f4-89c3-517ec26a73d9 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:30:20.502357 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-e32c040d-c757-46f4-89c3-517ec26a73d9 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:30:20.508818 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e32c040d-c757-46f4-89c3-517ec26a73d9 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:30:20.509257 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e32c040d-c757-46f4-89c3-517ec26a73d9 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:30:20.510025 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e32c040d-c757-46f4-89c3-517ec26a73d9 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:30:20.510468 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e32c040d-c757-46f4-89c3-517ec26a73d9 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:30:20.630355 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-e32c040d-c757-46f4-89c3-517ec26a73d9 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:30:20.637899 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-e32c040d-c757-46f4-89c3-517ec26a73d9 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.140609 Nov 01 01:30:20.638800 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 872/1689] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:30:20 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:30:20.644499 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-c3a360f5-7ea7-4665-bcfb-b27f0b434b4b tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:30:20.645478 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-c3a360f5-7ea7-4665-bcfb-b27f0b434b4b tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:30:20.651013 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c3a360f5-7ea7-4665-bcfb-b27f0b434b4b tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:30:20.651454 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c3a360f5-7ea7-4665-bcfb-b27f0b434b4b tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:30:20.652208 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c3a360f5-7ea7-4665-bcfb-b27f0b434b4b tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:30:20.652628 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c3a360f5-7ea7-4665-bcfb-b27f0b434b4b tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:30:20.682288 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-c3a360f5-7ea7-4665-bcfb-b27f0b434b4b tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041794 Nov 01 01:30:20.682872 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 873/1690] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:30:20 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:30:21.127560 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-7613cf8c-5643-47fd-b64b-f774490ece0a tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:30:21.128201 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-7613cf8c-5643-47fd-b64b-f774490ece0a tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:30:21.133926 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-7613cf8c-5643-47fd-b64b-f774490ece0a tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:30:21.134319 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-7613cf8c-5643-47fd-b64b-f774490ece0a tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:30:21.135118 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-7613cf8c-5643-47fd-b64b-f774490ece0a tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:30:21.135553 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-7613cf8c-5643-47fd-b64b-f774490ece0a tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:30:21.259556 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-7613cf8c-5643-47fd-b64b-f774490ece0a tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:30:21.274240 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-7613cf8c-5643-47fd-b64b-f774490ece0a tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1264 microversion: 2.1 time: 0.150377 Nov 01 01:30:21.274929 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 874/1691] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:30:21 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1264 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:30:21.281039 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-0c75b9d6-e55d-46b4-9e8d-ba73584d4796 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:30:21.281618 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-0c75b9d6-e55d-46b4-9e8d-ba73584d4796 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:30:21.291337 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0c75b9d6-e55d-46b4-9e8d-ba73584d4796 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:30:21.291773 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0c75b9d6-e55d-46b4-9e8d-ba73584d4796 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:30:21.292786 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0c75b9d6-e55d-46b4-9e8d-ba73584d4796 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:30:21.292988 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0c75b9d6-e55d-46b4-9e8d-ba73584d4796 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:30:34.231147 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 01 01:30:34.231733 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: Mon Nov 1 01:30:34 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b/os-volume_attachments/9c1da9b4-cfe5-429d-bc30-5fa4e7cf4308 (ip 10.222.0.47) !!! Nov 01 01:30:40.001967 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 01 01:30:40.002574 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: Mon Nov 1 01:30:40 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b/os-volume_attachments/9c1da9b4-cfe5-429d-bc30-5fa4e7cf4308 (ip 10.222.0.47) !!! Nov 01 01:31:21.401179 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: ERROR oslo.messaging._drivers.impl_rabbit [None req-fc05b5fa-a9d7-4080-a0d8-b66e459a11f2 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [adb701d4-fc7b-46f9-af6c-59e38b773f8c] AMQP server on 10.222.0.47:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 01 01:31:21.421496 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.objects.instance [None req-0c75b9d6-e55d-46b4-9e8d-ba73584d4796 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lazy-loading 'services' on Instance uuid 0eb63a66-7e46-40fb-9087-543fbf9cad4b {{(pid=116267) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 01 01:31:22.416857 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO oslo.messaging._drivers.impl_rabbit [None req-fc05b5fa-a9d7-4080-a0d8-b66e459a11f2 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [adb701d4-fc7b-46f9-af6c-59e38b773f8c] Reconnected to AMQP server on 10.222.0.47:5672 via [amqp] client with port 49414. Nov 01 01:31:22.420351 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-fc05b5fa-a9d7-4080-a0d8-b66e459a11f2 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "DELETE /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b/os-volume_attachments/9c1da9b4-cfe5-429d-bc30-5fa4e7cf4308" status: 202 len: 0 microversion: 2.1 time: 121.339543 Nov 01 01:31:22.420932 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 818/1692] 10.222.0.47 () {58 vars in 1415 bytes} [Mon Nov 1 01:29:21 2021] DELETE /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b/os-volume_attachments/9c1da9b4-cfe5-429d-bc30-5fa4e7cf4308 => generated 0 bytes in 121341 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 01 01:31:22.426269 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-1808fc3d-e7d5-4aa6-9875-4dc21ef1f533 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:31:22.426997 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-1808fc3d-e7d5-4aa6-9875-4dc21ef1f533 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:31:22.433666 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1808fc3d-e7d5-4aa6-9875-4dc21ef1f533 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:31:22.434112 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1808fc3d-e7d5-4aa6-9875-4dc21ef1f533 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:31:22.434912 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1808fc3d-e7d5-4aa6-9875-4dc21ef1f533 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:31:22.435342 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1808fc3d-e7d5-4aa6-9875-4dc21ef1f533 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:31:22.565475 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-1808fc3d-e7d5-4aa6-9875-4dc21ef1f533 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:31:22.574153 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-1808fc3d-e7d5-4aa6-9875-4dc21ef1f533 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.152091 Nov 01 01:31:22.574763 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 819/1693] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:31:22 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:31:22.579087 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-b33aaea2-abd8-4ccf-977c-db87551fab11 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:31:22.580038 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-b33aaea2-abd8-4ccf-977c-db87551fab11 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:31:22.585966 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b33aaea2-abd8-4ccf-977c-db87551fab11 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:31:22.592162 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b33aaea2-abd8-4ccf-977c-db87551fab11 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:31:22.592162 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b33aaea2-abd8-4ccf-977c-db87551fab11 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:31:22.592162 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b33aaea2-abd8-4ccf-977c-db87551fab11 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:31:22.617530 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-b33aaea2-abd8-4ccf-977c-db87551fab11 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041695 Nov 01 01:31:22.618004 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 820/1694] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:31:22 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:31:22.622646 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-5340a3f7-39c7-4152-b038-5394626577bc tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:31:22.623234 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-5340a3f7-39c7-4152-b038-5394626577bc tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:31:22.628336 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5340a3f7-39c7-4152-b038-5394626577bc tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:31:22.628774 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5340a3f7-39c7-4152-b038-5394626577bc tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:31:22.629520 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5340a3f7-39c7-4152-b038-5394626577bc tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:31:22.629948 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5340a3f7-39c7-4152-b038-5394626577bc tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:31:22.746855 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-5340a3f7-39c7-4152-b038-5394626577bc tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:31:22.754049 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-5340a3f7-39c7-4152-b038-5394626577bc tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1264 microversion: 2.1 time: 0.134543 Nov 01 01:31:22.754647 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 821/1695] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:31:22 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1264 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:31:22.758880 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-7fee0ca6-65f5-46f5-b9ea-5fb33ad5cc5c tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:31:22.759408 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-7fee0ca6-65f5-46f5-b9ea-5fb33ad5cc5c tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:31:22.764542 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7fee0ca6-65f5-46f5-b9ea-5fb33ad5cc5c tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:31:22.764982 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7fee0ca6-65f5-46f5-b9ea-5fb33ad5cc5c tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:31:22.765730 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7fee0ca6-65f5-46f5-b9ea-5fb33ad5cc5c tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:31:22.766152 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7fee0ca6-65f5-46f5-b9ea-5fb33ad5cc5c tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:32:12.596976 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 01 01:32:12.597510 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: Mon Nov 1 01:32:12 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b/os-volume_attachments/9c1da9b4-cfe5-429d-bc30-5fa4e7cf4308 (ip 10.222.0.47) !!! Nov 01 01:32:13.875910 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.wsgi [None req-0c75b9d6-e55d-46b4-9e8d-ba73584d4796 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-83eb1cb2-e86c-4187-b66e-7fe6ec1de9fa) Nov 01 01:32:13.876603 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-0c75b9d6-e55d-46b4-9e8d-ba73584d4796 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-83eb1cb2-e86c-4187-b66e-7fe6ec1de9fa) {{(pid=116267) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 01 01:32:13.877891 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-0c75b9d6-e55d-46b4-9e8d-ba73584d4796 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "DELETE /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b/os-volume_attachments/9c1da9b4-cfe5-429d-bc30-5fa4e7cf4308" status: 400 len: 269 microversion: 2.1 time: 112.601066 Nov 01 01:32:13.878530 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 875/1696] 10.222.0.47 () {58 vars in 1415 bytes} [Mon Nov 1 01:30:21 2021] DELETE /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b/os-volume_attachments/9c1da9b4-cfe5-429d-bc30-5fa4e7cf4308 => generated 269 bytes in 112603 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 01 01:32:14.036446 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-a673d691-7d11-4387-895e-0771a17dd7f7 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:32:14.037054 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-a673d691-7d11-4387-895e-0771a17dd7f7 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:32:14.042833 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a673d691-7d11-4387-895e-0771a17dd7f7 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:32:14.043274 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a673d691-7d11-4387-895e-0771a17dd7f7 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:32:14.044029 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a673d691-7d11-4387-895e-0771a17dd7f7 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:32:14.044452 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a673d691-7d11-4387-895e-0771a17dd7f7 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:32:14.063086 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.objects.instance [None req-7fee0ca6-65f5-46f5-b9ea-5fb33ad5cc5c tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lazy-loading 'services' on Instance uuid 0eb63a66-7e46-40fb-9087-543fbf9cad4b {{(pid=116266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 01 01:32:14.168135 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-a673d691-7d11-4387-895e-0771a17dd7f7 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:32:14.175484 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-a673d691-7d11-4387-895e-0771a17dd7f7 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.295926 Nov 01 01:32:14.176052 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 876/1697] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:32:13 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:32:14.180320 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-a3db722a-25e9-41de-b075-b8a672cff7f6 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:32:14.181285 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-a3db722a-25e9-41de-b075-b8a672cff7f6 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:32:14.186645 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a3db722a-25e9-41de-b075-b8a672cff7f6 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:32:14.187095 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a3db722a-25e9-41de-b075-b8a672cff7f6 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:32:14.187856 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a3db722a-25e9-41de-b075-b8a672cff7f6 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:32:14.188287 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a3db722a-25e9-41de-b075-b8a672cff7f6 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:32:14.217984 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-a3db722a-25e9-41de-b075-b8a672cff7f6 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040879 Nov 01 01:32:14.218569 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 877/1698] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:32:14 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:32:14.286753 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-4da91b56-4d22-4833-a7f5-f5a2cc014593 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:32:14.287367 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-4da91b56-4d22-4833-a7f5-f5a2cc014593 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:32:14.293293 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4da91b56-4d22-4833-a7f5-f5a2cc014593 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:32:14.293732 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4da91b56-4d22-4833-a7f5-f5a2cc014593 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:32:14.294520 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4da91b56-4d22-4833-a7f5-f5a2cc014593 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:32:14.294957 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4da91b56-4d22-4833-a7f5-f5a2cc014593 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:32:14.468496 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-4da91b56-4d22-4833-a7f5-f5a2cc014593 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:32:14.476585 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-4da91b56-4d22-4833-a7f5-f5a2cc014593 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1264 microversion: 2.1 time: 0.257071 Nov 01 01:32:14.477149 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 878/1699] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:32:14 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1264 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:32:15.188061 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-f1abc7fb-1602-4a8d-9963-6694e2e982ad tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:32:15.191694 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-f1abc7fb-1602-4a8d-9963-6694e2e982ad tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:32:15.195509 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f1abc7fb-1602-4a8d-9963-6694e2e982ad tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:32:15.195963 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f1abc7fb-1602-4a8d-9963-6694e2e982ad tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:32:15.196727 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f1abc7fb-1602-4a8d-9963-6694e2e982ad tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:32:15.197159 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f1abc7fb-1602-4a8d-9963-6694e2e982ad tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:32:15.222652 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-f1abc7fb-1602-4a8d-9963-6694e2e982ad tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Going to try to terminate instance {{(pid=116267) delete /opt/stack/nova/nova/compute/api.py:2612}} Nov 01 01:32:15.436040 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: ERROR oslo.messaging._drivers.impl_rabbit [None req-f1abc7fb-1602-4a8d-9963-6694e2e982ad tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [d6748a1e-8370-493e-b3b5-ff17386f722d] AMQP server on 10.222.0.47:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 01 01:32:16.452393 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO oslo.messaging._drivers.impl_rabbit [None req-f1abc7fb-1602-4a8d-9963-6694e2e982ad tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [d6748a1e-8370-493e-b3b5-ff17386f722d] Reconnected to AMQP server on 10.222.0.47:5672 via [amqp] client with port 49468. Nov 01 01:32:16.526334 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-f1abc7fb-1602-4a8d-9963-6694e2e982ad tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "DELETE /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 204 len: 0 microversion: 2.1 time: 1.342015 Nov 01 01:32:16.526957 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 879/1700] 10.222.0.47 () {58 vars in 1238 bytes} [Mon Nov 1 01:32:15 2021] DELETE /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 0 bytes in 1344 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 01 01:32:16.580554 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [req-6c1d371f-4ad6-40a3-b7d8-17403c80bb30 req-3ee71574-be29-4dc1-b529-6454342fdb51 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7554da88-1726-438a-bed5-4e30d999ba9d", "tag": "bebb1bd2-6980-4bbb-a08e-ca30b1d8aac9"}]} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:32:16.582097 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 01 01:32:16.582097 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: warnings.warn(msg) Nov 01 01:32:16.589408 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [req-6c1d371f-4ad6-40a3-b7d8-17403c80bb30 req-3ee71574-be29-4dc1-b529-6454342fdb51 service nova] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:32:16.589834 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [req-6c1d371f-4ad6-40a3-b7d8-17403c80bb30 req-3ee71574-be29-4dc1-b529-6454342fdb51 service nova] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:32:16.600670 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.compute.server_external_events [req-6c1d371f-4ad6-40a3-b7d8-17403c80bb30 req-3ee71574-be29-4dc1-b529-6454342fdb51 service nova] Creating event network-changed:bebb1bd2-6980-4bbb-a08e-ca30b1d8aac9 for instance 7554da88-1726-438a-bed5-4e30d999ba9d on hv-cinder-81561 Nov 01 01:32:16.605275 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [req-6c1d371f-4ad6-40a3-b7d8-17403c80bb30 req-3ee71574-be29-4dc1-b529-6454342fdb51 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076822 Nov 01 01:32:16.605835 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 880/1701] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Nov 1 01:32:16 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:32:16.610741 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-6d3af0e3-d9a5-42a7-b827-2463f271fb68 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:32:16.611692 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-6d3af0e3-d9a5-42a7-b827-2463f271fb68 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:32:16.617401 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-6d3af0e3-d9a5-42a7-b827-2463f271fb68 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:32:16.617835 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-6d3af0e3-d9a5-42a7-b827-2463f271fb68 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:32:16.618615 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-6d3af0e3-d9a5-42a7-b827-2463f271fb68 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:32:16.619038 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-6d3af0e3-d9a5-42a7-b827-2463f271fb68 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:32:16.647933 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-6d3af0e3-d9a5-42a7-b827-2463f271fb68 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040823 Nov 01 01:32:16.648480 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 881/1702] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:32:16 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:32:16.652749 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-3cea1f48-1c7f-4fb2-8499-864c9678a744 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:32:16.653337 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-3cea1f48-1c7f-4fb2-8499-864c9678a744 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:32:16.660239 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3cea1f48-1c7f-4fb2-8499-864c9678a744 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:32:16.660676 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3cea1f48-1c7f-4fb2-8499-864c9678a744 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:32:16.661429 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3cea1f48-1c7f-4fb2-8499-864c9678a744 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:32:16.661851 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3cea1f48-1c7f-4fb2-8499-864c9678a744 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:32:16.782483 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-3cea1f48-1c7f-4fb2-8499-864c9678a744 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:32:16.789698 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-3cea1f48-1c7f-4fb2-8499-864c9678a744 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1264 microversion: 2.1 time: 0.140287 Nov 01 01:32:16.790279 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 882/1703] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:32:16 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1264 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:32:16.794652 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-6677dc4d-590f-4bb4-9009-f9a91a458086 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:32:16.795242 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-6677dc4d-590f-4bb4-9009-f9a91a458086 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:32:16.800753 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-6677dc4d-590f-4bb4-9009-f9a91a458086 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:32:16.801190 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-6677dc4d-590f-4bb4-9009-f9a91a458086 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:32:16.801938 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-6677dc4d-590f-4bb4-9009-f9a91a458086 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:32:16.802358 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-6677dc4d-590f-4bb4-9009-f9a91a458086 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:32:16.925458 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-6677dc4d-590f-4bb4-9009-f9a91a458086 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:32:16.932772 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-6677dc4d-590f-4bb4-9009-f9a91a458086 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1568 microversion: 2.1 time: 0.141490 Nov 01 01:32:16.933562 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 883/1704] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:32:16 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1568 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:32:17.660065 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-dcfd89b9-3747-4e60-8061-1e6342eef366 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:32:17.663211 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-dcfd89b9-3747-4e60-8061-1e6342eef366 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:32:17.668319 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-dcfd89b9-3747-4e60-8061-1e6342eef366 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:32:17.668770 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-dcfd89b9-3747-4e60-8061-1e6342eef366 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:32:17.669546 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-dcfd89b9-3747-4e60-8061-1e6342eef366 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:32:17.669979 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-dcfd89b9-3747-4e60-8061-1e6342eef366 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:32:17.700242 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-dcfd89b9-3747-4e60-8061-1e6342eef366 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044826 Nov 01 01:32:17.700791 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 884/1705] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:32:17 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 01 01:32:17.806010 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-86850dbd-0643-430f-a0f8-79fad2793bef tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:32:17.806637 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-86850dbd-0643-430f-a0f8-79fad2793bef tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:32:17.812167 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-86850dbd-0643-430f-a0f8-79fad2793bef tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:32:17.812613 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-86850dbd-0643-430f-a0f8-79fad2793bef tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:32:17.813371 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-86850dbd-0643-430f-a0f8-79fad2793bef tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:32:17.813799 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-86850dbd-0643-430f-a0f8-79fad2793bef tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:32:17.930593 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-86850dbd-0643-430f-a0f8-79fad2793bef tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:32:17.937739 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-86850dbd-0643-430f-a0f8-79fad2793bef tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1264 microversion: 2.1 time: 0.135055 Nov 01 01:32:17.938303 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 885/1706] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:32:17 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1264 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:32:17.950165 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-4dc2312d-0aae-418d-a2f0-aed245efaa67 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:32:17.950790 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-4dc2312d-0aae-418d-a2f0-aed245efaa67 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:32:17.956374 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4dc2312d-0aae-418d-a2f0-aed245efaa67 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:32:17.956817 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4dc2312d-0aae-418d-a2f0-aed245efaa67 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:32:17.957569 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4dc2312d-0aae-418d-a2f0-aed245efaa67 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:32:17.957996 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4dc2312d-0aae-418d-a2f0-aed245efaa67 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:32:18.074569 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-4dc2312d-0aae-418d-a2f0-aed245efaa67 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:32:18.081720 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-4dc2312d-0aae-418d-a2f0-aed245efaa67 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1449 microversion: 2.1 time: 0.134936 Nov 01 01:32:18.082280 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 886/1707] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:32:17 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1449 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:32:18.711659 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-e4050921-821b-40c7-84a3-314cb0879687 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:32:18.712564 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-e4050921-821b-40c7-84a3-314cb0879687 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:32:18.718765 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e4050921-821b-40c7-84a3-314cb0879687 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:32:18.719204 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e4050921-821b-40c7-84a3-314cb0879687 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:32:18.719946 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e4050921-821b-40c7-84a3-314cb0879687 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:32:18.720971 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e4050921-821b-40c7-84a3-314cb0879687 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:32:18.749007 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-e4050921-821b-40c7-84a3-314cb0879687 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041129 Nov 01 01:32:18.749545 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 887/1708] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:32:18 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 01 01:32:18.954316 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-bc77b7c3-8140-4f09-a8bc-196eb4e31a61 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:32:18.955455 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-bc77b7c3-8140-4f09-a8bc-196eb4e31a61 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:32:18.961392 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-bc77b7c3-8140-4f09-a8bc-196eb4e31a61 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:32:18.961883 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-bc77b7c3-8140-4f09-a8bc-196eb4e31a61 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:32:18.962610 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-bc77b7c3-8140-4f09-a8bc-196eb4e31a61 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:32:18.963033 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-bc77b7c3-8140-4f09-a8bc-196eb4e31a61 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:32:19.084694 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-bc77b7c3-8140-4f09-a8bc-196eb4e31a61 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:32:19.091999 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-bc77b7c3-8140-4f09-a8bc-196eb4e31a61 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1264 microversion: 2.1 time: 0.141370 Nov 01 01:32:19.092568 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 888/1709] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:32:18 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1264 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:32:19.097469 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-a5bc7f16-989d-49a2-9ba6-c9e8f04a3ce3 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:32:19.098061 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-a5bc7f16-989d-49a2-9ba6-c9e8f04a3ce3 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:32:19.103583 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a5bc7f16-989d-49a2-9ba6-c9e8f04a3ce3 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:32:19.104020 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a5bc7f16-989d-49a2-9ba6-c9e8f04a3ce3 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:32:19.104770 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a5bc7f16-989d-49a2-9ba6-c9e8f04a3ce3 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:32:19.105190 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a5bc7f16-989d-49a2-9ba6-c9e8f04a3ce3 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:32:19.223800 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-a5bc7f16-989d-49a2-9ba6-c9e8f04a3ce3 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:32:19.231137 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-a5bc7f16-989d-49a2-9ba6-c9e8f04a3ce3 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1449 microversion: 2.1 time: 0.137651 Nov 01 01:32:19.231784 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 889/1710] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:32:19 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1449 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:32:19.760415 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-dfeb3e98-01a1-4801-ac06-a936e2972104 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:32:19.761321 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-dfeb3e98-01a1-4801-ac06-a936e2972104 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:32:19.768182 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-dfeb3e98-01a1-4801-ac06-a936e2972104 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:32:19.768616 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-dfeb3e98-01a1-4801-ac06-a936e2972104 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:32:19.769365 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-dfeb3e98-01a1-4801-ac06-a936e2972104 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:32:19.769785 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-dfeb3e98-01a1-4801-ac06-a936e2972104 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:32:19.797725 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-dfeb3e98-01a1-4801-ac06-a936e2972104 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041079 Nov 01 01:32:19.798256 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 890/1711] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:32:19 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 01 01:32:20.110143 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-8619cd06-7f47-48a6-9619-d837390f163a tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:32:20.110696 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-8619cd06-7f47-48a6-9619-d837390f163a tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:32:20.116929 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8619cd06-7f47-48a6-9619-d837390f163a tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:32:20.117369 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8619cd06-7f47-48a6-9619-d837390f163a tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:32:20.118116 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8619cd06-7f47-48a6-9619-d837390f163a tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:32:20.118562 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8619cd06-7f47-48a6-9619-d837390f163a tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:32:20.240260 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-8619cd06-7f47-48a6-9619-d837390f163a tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:32:20.247743 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-8619cd06-7f47-48a6-9619-d837390f163a tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1264 microversion: 2.1 time: 0.141209 Nov 01 01:32:20.248308 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 891/1712] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:32:20 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1264 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:32:20.253089 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-6fb8bda4-d397-4d20-a6b8-cc6e730e6c0d tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:32:20.253774 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-6fb8bda4-d397-4d20-a6b8-cc6e730e6c0d tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:32:20.259274 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-6fb8bda4-d397-4d20-a6b8-cc6e730e6c0d tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:32:20.259718 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-6fb8bda4-d397-4d20-a6b8-cc6e730e6c0d tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:32:20.260478 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-6fb8bda4-d397-4d20-a6b8-cc6e730e6c0d tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:32:20.260908 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-6fb8bda4-d397-4d20-a6b8-cc6e730e6c0d tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:32:20.382822 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-6fb8bda4-d397-4d20-a6b8-cc6e730e6c0d tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:32:20.389948 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-6fb8bda4-d397-4d20-a6b8-cc6e730e6c0d tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1449 microversion: 2.1 time: 0.140674 Nov 01 01:32:20.390514 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 892/1713] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:32:20 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1449 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:32:20.808697 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-40c94241-c1b2-497e-9137-93dbf39419c2 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:32:20.809603 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-40c94241-c1b2-497e-9137-93dbf39419c2 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:32:20.815844 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-40c94241-c1b2-497e-9137-93dbf39419c2 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:32:20.816282 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-40c94241-c1b2-497e-9137-93dbf39419c2 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:32:20.817028 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-40c94241-c1b2-497e-9137-93dbf39419c2 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:32:20.817453 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-40c94241-c1b2-497e-9137-93dbf39419c2 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:32:20.845062 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-40c94241-c1b2-497e-9137-93dbf39419c2 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040198 Nov 01 01:32:20.846122 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 893/1714] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:32:20 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 01 01:32:21.265016 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-9d948ded-005d-4078-99ba-f6edf44740e4 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:32:21.265608 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-9d948ded-005d-4078-99ba-f6edf44740e4 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:32:21.271948 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9d948ded-005d-4078-99ba-f6edf44740e4 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:32:21.272391 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9d948ded-005d-4078-99ba-f6edf44740e4 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:32:21.273140 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9d948ded-005d-4078-99ba-f6edf44740e4 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:32:21.273561 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9d948ded-005d-4078-99ba-f6edf44740e4 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:32:21.390974 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-9d948ded-005d-4078-99ba-f6edf44740e4 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:32:21.398758 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-9d948ded-005d-4078-99ba-f6edf44740e4 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1264 microversion: 2.1 time: 0.137440 Nov 01 01:32:21.399314 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 894/1715] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:32:21 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1264 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:32:21.403783 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-a96def9a-4a67-4dcc-99b7-ab291b3fbb5d tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:32:21.404265 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-a96def9a-4a67-4dcc-99b7-ab291b3fbb5d tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:32:21.409441 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a96def9a-4a67-4dcc-99b7-ab291b3fbb5d tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:32:21.409884 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a96def9a-4a67-4dcc-99b7-ab291b3fbb5d tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:32:21.410660 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a96def9a-4a67-4dcc-99b7-ab291b3fbb5d tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:32:21.411093 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a96def9a-4a67-4dcc-99b7-ab291b3fbb5d tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:33:21.587177 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.wsgi [None req-7fee0ca6-65f5-46f5-b9ea-5fb33ad5cc5c tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-bdc5b9cc-889b-4ccb-a91c-6a272889be0a) Nov 01 01:33:21.587845 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-7fee0ca6-65f5-46f5-b9ea-5fb33ad5cc5c tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-bdc5b9cc-889b-4ccb-a91c-6a272889be0a) {{(pid=116266) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 01 01:33:21.588719 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-7fee0ca6-65f5-46f5-b9ea-5fb33ad5cc5c tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "DELETE /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b/os-volume_attachments/9c1da9b4-cfe5-429d-bc30-5fa4e7cf4308" status: 400 len: 269 microversion: 2.1 time: 118.833177 Nov 01 01:33:21.589574 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 822/1716] 10.222.0.47 () {58 vars in 1415 bytes} [Mon Nov 1 01:31:22 2021] DELETE /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b/os-volume_attachments/9c1da9b4-cfe5-429d-bc30-5fa4e7cf4308 => generated 269 bytes in 118834 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 01 01:33:21.594237 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-2dc249c6-495f-44fc-8407-c420234fcccc tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:33:21.595291 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-2dc249c6-495f-44fc-8407-c420234fcccc tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:33:21.602334 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2dc249c6-495f-44fc-8407-c420234fcccc tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:33:21.602822 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2dc249c6-495f-44fc-8407-c420234fcccc tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:33:21.603585 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2dc249c6-495f-44fc-8407-c420234fcccc tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:33:21.604014 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2dc249c6-495f-44fc-8407-c420234fcccc tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:33:21.732254 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-2dc249c6-495f-44fc-8407-c420234fcccc tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:33:21.738119 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-2dc249c6-495f-44fc-8407-c420234fcccc tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1449 microversion: 2.1 time: 0.147777 Nov 01 01:33:21.738731 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 823/1717] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:33:21 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1449 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:33:21.856364 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-4e713281-33fe-4e62-b091-d50db9942092 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:33:21.857803 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-4e713281-33fe-4e62-b091-d50db9942092 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:33:21.865139 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4e713281-33fe-4e62-b091-d50db9942092 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:33:21.865311 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.objects.instance [None req-a96def9a-4a67-4dcc-99b7-ab291b3fbb5d tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lazy-loading 'services' on Instance uuid 0eb63a66-7e46-40fb-9087-543fbf9cad4b {{(pid=116267) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 01 01:33:21.866346 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4e713281-33fe-4e62-b091-d50db9942092 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:33:21.867149 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4e713281-33fe-4e62-b091-d50db9942092 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:33:21.867816 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4e713281-33fe-4e62-b091-d50db9942092 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:33:21.899634 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-4e713281-33fe-4e62-b091-d50db9942092 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.159849 Nov 01 01:33:21.900445 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 824/1718] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:33:21 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/os-volume_attachments => generated 197 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:33:21.907763 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-56772fb1-d882-4f2d-8f3d-47410c4c7fea tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:33:21.908362 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-56772fb1-d882-4f2d-8f3d-47410c4c7fea tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:33:21.913957 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-56772fb1-d882-4f2d-8f3d-47410c4c7fea tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:33:21.914760 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-56772fb1-d882-4f2d-8f3d-47410c4c7fea tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:33:21.915179 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-56772fb1-d882-4f2d-8f3d-47410c4c7fea tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:33:21.915607 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-56772fb1-d882-4f2d-8f3d-47410c4c7fea tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:33:22.040892 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-56772fb1-d882-4f2d-8f3d-47410c4c7fea tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:33:22.045634 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-56772fb1-d882-4f2d-8f3d-47410c4c7fea tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1264 microversion: 2.1 time: 0.144334 Nov 01 01:33:22.046198 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 825/1719] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:33:21 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1264 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:33:22.050655 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-a3e933a3-6b2d-41b7-84b5-a7893893ccea tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:33:22.051069 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-a3e933a3-6b2d-41b7-84b5-a7893893ccea tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:33:22.056577 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a3e933a3-6b2d-41b7-84b5-a7893893ccea tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:33:22.057022 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a3e933a3-6b2d-41b7-84b5-a7893893ccea tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:33:22.057779 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a3e933a3-6b2d-41b7-84b5-a7893893ccea tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:33:22.058209 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a3e933a3-6b2d-41b7-84b5-a7893893ccea tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:33:54.249393 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 01 01:33:54.250047 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: Mon Nov 1 01:33:54 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b/os-volume_attachments/9c1da9b4-cfe5-429d-bc30-5fa4e7cf4308 (ip 10.222.0.47) !!! Nov 01 01:34:00.023640 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 01 01:34:00.024085 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: Mon Nov 1 01:34:00 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b/os-volume_attachments/9c1da9b4-cfe5-429d-bc30-5fa4e7cf4308 (ip 10.222.0.47) !!! Nov 01 01:34:14.115114 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.wsgi [None req-a96def9a-4a67-4dcc-99b7-ab291b3fbb5d tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-27a2cfad-8598-4795-a929-dc3ff912214e) Nov 01 01:34:14.115750 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-a96def9a-4a67-4dcc-99b7-ab291b3fbb5d tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-27a2cfad-8598-4795-a929-dc3ff912214e) {{(pid=116267) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 01 01:34:14.116612 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-a96def9a-4a67-4dcc-99b7-ab291b3fbb5d tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "DELETE /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b/os-volume_attachments/9c1da9b4-cfe5-429d-bc30-5fa4e7cf4308" status: 400 len: 269 microversion: 2.1 time: 112.716383 Nov 01 01:34:14.117243 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 895/1720] 10.222.0.47 () {58 vars in 1415 bytes} [Mon Nov 1 01:32:21 2021] DELETE /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b/os-volume_attachments/9c1da9b4-cfe5-429d-bc30-5fa4e7cf4308 => generated 269 bytes in 112717 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 01 01:34:14.122687 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-c63acb20-aab9-4136-a666-0e7105f9eb2e tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:34:14.123289 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-c63acb20-aab9-4136-a666-0e7105f9eb2e tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:34:14.129005 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c63acb20-aab9-4136-a666-0e7105f9eb2e tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:34:14.130942 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c63acb20-aab9-4136-a666-0e7105f9eb2e tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:34:14.130942 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c63acb20-aab9-4136-a666-0e7105f9eb2e tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:34:14.130942 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c63acb20-aab9-4136-a666-0e7105f9eb2e tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:34:14.161762 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.objects.instance [None req-a3e933a3-6b2d-41b7-84b5-a7893893ccea tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lazy-loading 'services' on Instance uuid 0eb63a66-7e46-40fb-9087-543fbf9cad4b {{(pid=116266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 01 01:34:14.253257 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-c63acb20-aab9-4136-a666-0e7105f9eb2e tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:34:14.260898 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-c63acb20-aab9-4136-a666-0e7105f9eb2e tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1449 microversion: 2.1 time: 0.142833 Nov 01 01:34:14.261456 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 896/1721] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:34:14 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1449 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:34:14.265714 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-9e079002-59bc-4980-9133-8697d58cb31a tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:34:14.266683 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-9e079002-59bc-4980-9133-8697d58cb31a tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:34:14.271941 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9e079002-59bc-4980-9133-8697d58cb31a tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:34:14.272455 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9e079002-59bc-4980-9133-8697d58cb31a tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:34:14.273204 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9e079002-59bc-4980-9133-8697d58cb31a tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:34:14.273624 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9e079002-59bc-4980-9133-8697d58cb31a tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:34:14.301931 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-9e079002-59bc-4980-9133-8697d58cb31a tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039395 Nov 01 01:34:14.302494 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 897/1722] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:34:14 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:34:14.307279 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-4eeb6fdc-d46f-4192-b13d-284b95aaaa3b tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:34:14.307867 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-4eeb6fdc-d46f-4192-b13d-284b95aaaa3b tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:34:14.313654 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4eeb6fdc-d46f-4192-b13d-284b95aaaa3b tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:34:14.314093 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4eeb6fdc-d46f-4192-b13d-284b95aaaa3b tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:34:14.314888 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4eeb6fdc-d46f-4192-b13d-284b95aaaa3b tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:34:14.315316 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4eeb6fdc-d46f-4192-b13d-284b95aaaa3b tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:34:14.435163 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-4eeb6fdc-d46f-4192-b13d-284b95aaaa3b tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:34:14.442246 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-4eeb6fdc-d46f-4192-b13d-284b95aaaa3b tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1264 microversion: 2.1 time: 0.138830 Nov 01 01:34:14.442844 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 898/1723] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:34:14 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1264 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:34:15.277123 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-608e8bb1-47e5-474a-be01-ed19745e8f67 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:34:15.277793 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-608e8bb1-47e5-474a-be01-ed19745e8f67 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:34:15.283918 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-608e8bb1-47e5-474a-be01-ed19745e8f67 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:34:15.284361 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-608e8bb1-47e5-474a-be01-ed19745e8f67 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:34:15.285115 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-608e8bb1-47e5-474a-be01-ed19745e8f67 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:34:15.285571 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-608e8bb1-47e5-474a-be01-ed19745e8f67 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:34:15.407854 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-608e8bb1-47e5-474a-be01-ed19745e8f67 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:34:15.416017 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-608e8bb1-47e5-474a-be01-ed19745e8f67 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1449 microversion: 2.1 time: 0.142535 Nov 01 01:34:15.416580 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 899/1724] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:34:15 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1449 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:34:15.420853 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-ab258a59-605c-4e67-a7a0-b8d70365e306 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:34:15.421741 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-ab258a59-605c-4e67-a7a0-b8d70365e306 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:34:15.427289 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ab258a59-605c-4e67-a7a0-b8d70365e306 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:34:15.427936 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ab258a59-605c-4e67-a7a0-b8d70365e306 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:34:15.428691 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ab258a59-605c-4e67-a7a0-b8d70365e306 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:34:15.429121 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ab258a59-605c-4e67-a7a0-b8d70365e306 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:34:15.456645 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-ab258a59-605c-4e67-a7a0-b8d70365e306 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039099 Nov 01 01:34:15.457186 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 900/1725] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:34:15 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:34:15.461680 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-0db3395c-0d4a-4712-91cf-bdab83e6b6dd tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:34:15.462269 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-0db3395c-0d4a-4712-91cf-bdab83e6b6dd tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:34:15.467434 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0db3395c-0d4a-4712-91cf-bdab83e6b6dd tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:34:15.468133 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0db3395c-0d4a-4712-91cf-bdab83e6b6dd tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:34:15.468867 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0db3395c-0d4a-4712-91cf-bdab83e6b6dd tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:34:15.469287 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0db3395c-0d4a-4712-91cf-bdab83e6b6dd tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:34:15.583526 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-0db3395c-0d4a-4712-91cf-bdab83e6b6dd tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:34:15.591175 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-0db3395c-0d4a-4712-91cf-bdab83e6b6dd tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1264 microversion: 2.1 time: 0.133086 Nov 01 01:34:15.591730 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 901/1726] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:34:15 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1264 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:34:16.433206 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-969ada7d-30f4-4aa8-a179-18768d2418e7 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:34:16.433861 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-969ada7d-30f4-4aa8-a179-18768d2418e7 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:34:16.439988 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-969ada7d-30f4-4aa8-a179-18768d2418e7 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:34:16.440428 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-969ada7d-30f4-4aa8-a179-18768d2418e7 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:34:16.441175 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-969ada7d-30f4-4aa8-a179-18768d2418e7 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:34:16.441595 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-969ada7d-30f4-4aa8-a179-18768d2418e7 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:34:16.559401 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-969ada7d-30f4-4aa8-a179-18768d2418e7 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:34:16.566635 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-969ada7d-30f4-4aa8-a179-18768d2418e7 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1449 microversion: 2.1 time: 0.137695 Nov 01 01:34:16.567193 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 902/1727] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:34:16 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1449 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:34:16.571569 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-f806ee71-0597-453c-a007-dbc6cf34df1e tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:34:16.572480 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-f806ee71-0597-453c-a007-dbc6cf34df1e tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:34:16.577736 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f806ee71-0597-453c-a007-dbc6cf34df1e tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:34:16.578173 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f806ee71-0597-453c-a007-dbc6cf34df1e tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:34:16.578959 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f806ee71-0597-453c-a007-dbc6cf34df1e tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:34:16.579383 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f806ee71-0597-453c-a007-dbc6cf34df1e tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:34:16.607762 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-f806ee71-0597-453c-a007-dbc6cf34df1e tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039596 Nov 01 01:34:16.608302 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 903/1728] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:34:16 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:34:16.612445 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-ee22b75e-5cd7-494b-817d-628baa85c006 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:34:16.613043 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-ee22b75e-5cd7-494b-817d-628baa85c006 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:34:16.619185 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ee22b75e-5cd7-494b-817d-628baa85c006 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:34:16.619630 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ee22b75e-5cd7-494b-817d-628baa85c006 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:34:16.620382 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ee22b75e-5cd7-494b-817d-628baa85c006 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:34:16.620809 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ee22b75e-5cd7-494b-817d-628baa85c006 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:34:16.739534 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-ee22b75e-5cd7-494b-817d-628baa85c006 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:34:16.747333 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-ee22b75e-5cd7-494b-817d-628baa85c006 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1264 microversion: 2.1 time: 0.138123 Nov 01 01:34:16.751276 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 904/1729] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:34:16 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1264 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:34:17.583217 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-1f7cd418-4347-4319-bce1-84dd123b22f2 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:34:17.583860 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-1f7cd418-4347-4319-bce1-84dd123b22f2 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:34:17.590400 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-1f7cd418-4347-4319-bce1-84dd123b22f2 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:34:17.590870 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-1f7cd418-4347-4319-bce1-84dd123b22f2 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:34:17.591812 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-1f7cd418-4347-4319-bce1-84dd123b22f2 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:34:17.592239 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-1f7cd418-4347-4319-bce1-84dd123b22f2 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:34:17.709616 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-1f7cd418-4347-4319-bce1-84dd123b22f2 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:34:17.716902 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-1f7cd418-4347-4319-bce1-84dd123b22f2 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1449 microversion: 2.1 time: 0.137335 Nov 01 01:34:17.717467 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 905/1730] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:34:17 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1449 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:34:17.721976 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-aa5bc21d-6674-46bc-8fed-b7ce5cdc2ed5 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:34:17.722890 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-aa5bc21d-6674-46bc-8fed-b7ce5cdc2ed5 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:34:17.728945 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-aa5bc21d-6674-46bc-8fed-b7ce5cdc2ed5 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:34:17.729387 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-aa5bc21d-6674-46bc-8fed-b7ce5cdc2ed5 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:34:17.730148 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-aa5bc21d-6674-46bc-8fed-b7ce5cdc2ed5 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:34:17.730605 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-aa5bc21d-6674-46bc-8fed-b7ce5cdc2ed5 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:34:17.760565 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-aa5bc21d-6674-46bc-8fed-b7ce5cdc2ed5 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041847 Nov 01 01:34:17.761109 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 906/1731] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:34:17 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:34:17.765174 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-fa954384-e5a3-42a1-b380-2d64fd019a4d tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:34:17.765770 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-fa954384-e5a3-42a1-b380-2d64fd019a4d tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:34:17.771012 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-fa954384-e5a3-42a1-b380-2d64fd019a4d tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:34:17.771454 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-fa954384-e5a3-42a1-b380-2d64fd019a4d tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:34:17.772198 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-fa954384-e5a3-42a1-b380-2d64fd019a4d tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:34:17.772627 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-fa954384-e5a3-42a1-b380-2d64fd019a4d tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:34:17.888574 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-fa954384-e5a3-42a1-b380-2d64fd019a4d tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:34:17.895691 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-fa954384-e5a3-42a1-b380-2d64fd019a4d tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1264 microversion: 2.1 time: 0.133669 Nov 01 01:34:17.896249 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 907/1732] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:34:17 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1264 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:34:18.735396 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-db5093b0-760f-4a58-859a-2bbf34f03e5b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:34:18.736059 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-db5093b0-760f-4a58-859a-2bbf34f03e5b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:34:18.742290 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-db5093b0-760f-4a58-859a-2bbf34f03e5b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:34:18.742770 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-db5093b0-760f-4a58-859a-2bbf34f03e5b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:34:18.743528 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-db5093b0-760f-4a58-859a-2bbf34f03e5b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:34:18.743958 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-db5093b0-760f-4a58-859a-2bbf34f03e5b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:34:18.863577 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-db5093b0-760f-4a58-859a-2bbf34f03e5b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:34:18.870796 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-db5093b0-760f-4a58-859a-2bbf34f03e5b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1449 microversion: 2.1 time: 0.139297 Nov 01 01:34:18.871359 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 908/1733] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:34:18 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1449 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:34:18.875657 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-5dbe8a4b-89e9-4df5-9218-b7d36e98cb86 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:34:18.876544 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-5dbe8a4b-89e9-4df5-9218-b7d36e98cb86 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:34:18.881865 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-5dbe8a4b-89e9-4df5-9218-b7d36e98cb86 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:34:18.882856 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-5dbe8a4b-89e9-4df5-9218-b7d36e98cb86 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:34:18.883610 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-5dbe8a4b-89e9-4df5-9218-b7d36e98cb86 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:34:18.884036 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-5dbe8a4b-89e9-4df5-9218-b7d36e98cb86 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:34:18.912535 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-5dbe8a4b-89e9-4df5-9218-b7d36e98cb86 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040212 Nov 01 01:34:18.913072 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 909/1734] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:34:18 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:34:18.917127 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-3967175a-8a3c-43e5-98c9-e366c9f2e5ee tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:34:18.917721 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-3967175a-8a3c-43e5-98c9-e366c9f2e5ee tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:34:18.922931 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3967175a-8a3c-43e5-98c9-e366c9f2e5ee tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:34:18.923406 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3967175a-8a3c-43e5-98c9-e366c9f2e5ee tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:34:18.924154 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3967175a-8a3c-43e5-98c9-e366c9f2e5ee tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:34:18.924612 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3967175a-8a3c-43e5-98c9-e366c9f2e5ee tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:34:19.040936 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-3967175a-8a3c-43e5-98c9-e366c9f2e5ee tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:34:19.048080 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-3967175a-8a3c-43e5-98c9-e366c9f2e5ee tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1264 microversion: 2.1 time: 0.134073 Nov 01 01:34:19.048636 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 910/1735] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:34:18 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1264 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:34:19.887226 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-d7968cac-3b0c-4c95-892f-66d84cf35f64 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:34:19.887880 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-d7968cac-3b0c-4c95-892f-66d84cf35f64 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:34:19.893987 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d7968cac-3b0c-4c95-892f-66d84cf35f64 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:34:19.894447 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d7968cac-3b0c-4c95-892f-66d84cf35f64 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:34:19.895197 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d7968cac-3b0c-4c95-892f-66d84cf35f64 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:34:19.895616 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d7968cac-3b0c-4c95-892f-66d84cf35f64 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:34:20.011805 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-d7968cac-3b0c-4c95-892f-66d84cf35f64 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:34:20.018997 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-d7968cac-3b0c-4c95-892f-66d84cf35f64 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1449 microversion: 2.1 time: 0.135408 Nov 01 01:34:20.019580 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 911/1736] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:34:19 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1449 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:34:20.024298 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-82e103ad-f12d-4238-8e75-f5da565aa32f tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:34:20.025177 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-82e103ad-f12d-4238-8e75-f5da565aa32f tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:34:20.030361 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-82e103ad-f12d-4238-8e75-f5da565aa32f tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:34:20.030830 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-82e103ad-f12d-4238-8e75-f5da565aa32f tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:34:20.031581 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-82e103ad-f12d-4238-8e75-f5da565aa32f tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:34:20.032003 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-82e103ad-f12d-4238-8e75-f5da565aa32f tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:34:20.060332 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-82e103ad-f12d-4238-8e75-f5da565aa32f tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039793 Nov 01 01:34:20.060864 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 912/1737] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:34:20 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:34:20.064848 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-4ac9830d-16bf-46aa-a5e2-a3ab19d763cd tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:34:20.065443 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-4ac9830d-16bf-46aa-a5e2-a3ab19d763cd tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:34:20.070774 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4ac9830d-16bf-46aa-a5e2-a3ab19d763cd tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:34:20.071211 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4ac9830d-16bf-46aa-a5e2-a3ab19d763cd tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:34:20.071946 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4ac9830d-16bf-46aa-a5e2-a3ab19d763cd tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:34:20.072367 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4ac9830d-16bf-46aa-a5e2-a3ab19d763cd tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:34:20.191824 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-4ac9830d-16bf-46aa-a5e2-a3ab19d763cd tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:34:20.198898 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-4ac9830d-16bf-46aa-a5e2-a3ab19d763cd tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1264 microversion: 2.1 time: 0.137094 Nov 01 01:34:20.199457 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 913/1738] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:34:20 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1264 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:34:21.035985 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-4c87ef2c-2084-404d-b826-461a5bca5a3b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:34:21.036665 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-4c87ef2c-2084-404d-b826-461a5bca5a3b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:34:21.043027 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4c87ef2c-2084-404d-b826-461a5bca5a3b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:34:21.043496 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4c87ef2c-2084-404d-b826-461a5bca5a3b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:34:21.044249 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4c87ef2c-2084-404d-b826-461a5bca5a3b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:34:21.044673 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4c87ef2c-2084-404d-b826-461a5bca5a3b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:34:21.161054 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-4c87ef2c-2084-404d-b826-461a5bca5a3b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:34:21.168280 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-4c87ef2c-2084-404d-b826-461a5bca5a3b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1449 microversion: 2.1 time: 0.135981 Nov 01 01:34:21.168843 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 914/1739] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:34:21 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1449 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:34:21.173050 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-709a730c-ddf4-49e0-ac45-908a0c35d7ed tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:34:21.173932 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-709a730c-ddf4-49e0-ac45-908a0c35d7ed tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:34:21.179253 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-709a730c-ddf4-49e0-ac45-908a0c35d7ed tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:34:21.179692 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-709a730c-ddf4-49e0-ac45-908a0c35d7ed tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:34:21.180439 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-709a730c-ddf4-49e0-ac45-908a0c35d7ed tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:34:21.180862 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-709a730c-ddf4-49e0-ac45-908a0c35d7ed tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:34:21.208968 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-709a730c-ddf4-49e0-ac45-908a0c35d7ed tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039173 Nov 01 01:34:21.209494 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 915/1740] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:34:21 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:34:21.215447 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-77ec27a5-506f-4401-acb6-d4b94ddd1d0b tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:34:21.216070 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-77ec27a5-506f-4401-acb6-d4b94ddd1d0b tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:34:21.221689 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-77ec27a5-506f-4401-acb6-d4b94ddd1d0b tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:34:21.222137 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-77ec27a5-506f-4401-acb6-d4b94ddd1d0b tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:34:21.222931 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-77ec27a5-506f-4401-acb6-d4b94ddd1d0b tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:34:21.223365 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-77ec27a5-506f-4401-acb6-d4b94ddd1d0b tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:34:21.339784 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-77ec27a5-506f-4401-acb6-d4b94ddd1d0b tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:34:21.347279 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-77ec27a5-506f-4401-acb6-d4b94ddd1d0b tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1264 microversion: 2.1 time: 0.135141 Nov 01 01:34:21.347844 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 916/1741] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:34:21 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1264 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:34:21.378314 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-3af1581b-b4b9-4b22-9855-2dfd1820f8e7 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:34:21.378824 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-3af1581b-b4b9-4b22-9855-2dfd1820f8e7 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:34:21.385152 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3af1581b-b4b9-4b22-9855-2dfd1820f8e7 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:34:21.385591 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3af1581b-b4b9-4b22-9855-2dfd1820f8e7 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:34:21.386341 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3af1581b-b4b9-4b22-9855-2dfd1820f8e7 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:34:21.386786 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3af1581b-b4b9-4b22-9855-2dfd1820f8e7 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:35:22.054272 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.wsgi [None req-a3e933a3-6b2d-41b7-84b5-a7893893ccea tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-557e0e92-1f2c-4ba0-812a-ef7189bc7910) Nov 01 01:35:22.054957 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-a3e933a3-6b2d-41b7-84b5-a7893893ccea tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-557e0e92-1f2c-4ba0-812a-ef7189bc7910) {{(pid=116266) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 01 01:35:22.055901 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-a3e933a3-6b2d-41b7-84b5-a7893893ccea tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "DELETE /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b/os-volume_attachments/9c1da9b4-cfe5-429d-bc30-5fa4e7cf4308" status: 400 len: 269 microversion: 2.1 time: 120.008780 Nov 01 01:35:22.056488 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 826/1742] 10.222.0.47 () {58 vars in 1415 bytes} [Mon Nov 1 01:33:22 2021] DELETE /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b/os-volume_attachments/9c1da9b4-cfe5-429d-bc30-5fa4e7cf4308 => generated 269 bytes in 120010 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 01 01:35:22.062169 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-0c06569c-81ae-46a4-970e-4b007eb5902e tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:35:22.062799 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-0c06569c-81ae-46a4-970e-4b007eb5902e tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:35:22.068479 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0c06569c-81ae-46a4-970e-4b007eb5902e tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:35:22.068926 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0c06569c-81ae-46a4-970e-4b007eb5902e tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:35:22.069744 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0c06569c-81ae-46a4-970e-4b007eb5902e tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:35:22.070105 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0c06569c-81ae-46a4-970e-4b007eb5902e tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:35:22.195995 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-0c06569c-81ae-46a4-970e-4b007eb5902e tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:35:22.203334 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-0c06569c-81ae-46a4-970e-4b007eb5902e tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1449 microversion: 2.1 time: 0.145857 Nov 01 01:35:22.203894 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 827/1743] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:35:22 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1449 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:35:22.208968 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-a18b57f0-3e1c-4370-a73e-5202454722ca tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:35:22.210134 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-a18b57f0-3e1c-4370-a73e-5202454722ca tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:35:22.216275 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a18b57f0-3e1c-4370-a73e-5202454722ca tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:35:22.216713 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a18b57f0-3e1c-4370-a73e-5202454722ca tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:35:22.217474 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a18b57f0-3e1c-4370-a73e-5202454722ca tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:35:22.217899 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a18b57f0-3e1c-4370-a73e-5202454722ca tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:35:22.247511 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-a18b57f0-3e1c-4370-a73e-5202454722ca tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042331 Nov 01 01:35:22.247982 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 828/1744] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:35:22 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:35:22.252308 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-0208445e-edf8-4e84-ab72-b715951d6482 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:35:22.258649 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-0208445e-edf8-4e84-ab72-b715951d6482 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] [instance: 330dc645-b56f-4c45-8a1b-7535494ce136] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:35:22.258649 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0208445e-edf8-4e84-ab72-b715951d6482 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:35:22.259033 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0208445e-edf8-4e84-ab72-b715951d6482 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:35:22.259688 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0208445e-edf8-4e84-ab72-b715951d6482 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:35:22.260114 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0208445e-edf8-4e84-ab72-b715951d6482 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:35:22.285774 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.objects.instance [None req-3af1581b-b4b9-4b22-9855-2dfd1820f8e7 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lazy-loading 'services' on Instance uuid 0eb63a66-7e46-40fb-9087-543fbf9cad4b {{(pid=116267) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 01 01:35:22.401141 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-0208445e-edf8-4e84-ab72-b715951d6482 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4897556a37d144428d3b385a5859d724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca84d6acd44f8d92713d50ac2e825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:35:22.405192 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.wsgi [None req-3af1581b-b4b9-4b22-9855-2dfd1820f8e7 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c61193a8-1ea7-4182-bda4-a7708350537d) Nov 01 01:35:22.405797 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-3af1581b-b4b9-4b22-9855-2dfd1820f8e7 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c61193a8-1ea7-4182-bda4-a7708350537d) {{(pid=116267) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 01 01:35:22.406712 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-3af1581b-b4b9-4b22-9855-2dfd1820f8e7 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "DELETE /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b/os-volume_attachments/9c1da9b4-cfe5-429d-bc30-5fa4e7cf4308" status: 400 len: 269 microversion: 2.1 time: 61.032047 Nov 01 01:35:22.407423 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 917/1745] 10.222.0.47 () {58 vars in 1415 bytes} [Mon Nov 1 01:34:21 2021] DELETE /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b/os-volume_attachments/9c1da9b4-cfe5-429d-bc30-5fa4e7cf4308 => generated 269 bytes in 61033 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Nov 01 01:35:22.411854 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-0208445e-edf8-4e84-ab72-b715951d6482 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136" status: 200 len: 1264 microversion: 2.1 time: 0.162904 Nov 01 01:35:22.412894 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 829/1746] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:35:22 2021] GET /compute/v2.1/servers/330dc645-b56f-4c45-8a1b-7535494ce136 => generated 1264 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:35:22.413506 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-7dbcae2d-eb42-424a-b5dd-aecced4b56d8 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:35:22.414004 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-7dbcae2d-eb42-424a-b5dd-aecced4b56d8 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:35:22.419995 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-7dbcae2d-eb42-424a-b5dd-aecced4b56d8 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:35:22.420449 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-7dbcae2d-eb42-424a-b5dd-aecced4b56d8 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:35:22.421214 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-7dbcae2d-eb42-424a-b5dd-aecced4b56d8 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:35:22.421637 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-7dbcae2d-eb42-424a-b5dd-aecced4b56d8 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:35:22.558149 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.objects.instance [None req-7dbcae2d-eb42-424a-b5dd-aecced4b56d8 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lazy-loading 'services' on Instance uuid 0eb63a66-7e46-40fb-9087-543fbf9cad4b {{(pid=116267) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 01 01:35:22.661254 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.wsgi [None req-7dbcae2d-eb42-424a-b5dd-aecced4b56d8 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-6930e505-a95c-4c4a-9ecb-91040ea30d96) Nov 01 01:35:22.661893 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-7dbcae2d-eb42-424a-b5dd-aecced4b56d8 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-6930e505-a95c-4c4a-9ecb-91040ea30d96) {{(pid=116267) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 01 01:35:22.662775 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-7dbcae2d-eb42-424a-b5dd-aecced4b56d8 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "DELETE /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b/os-volume_attachments/9c1da9b4-cfe5-429d-bc30-5fa4e7cf4308" status: 400 len: 269 microversion: 2.1 time: 0.254356 Nov 01 01:35:22.663320 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 918/1747] 10.222.0.47 () {58 vars in 1415 bytes} [Mon Nov 1 01:35:22 2021] DELETE /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b/os-volume_attachments/9c1da9b4-cfe5-429d-bc30-5fa4e7cf4308 => generated 269 bytes in 255 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 01 01:35:23.220885 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-1a6946fd-756d-4108-8a2d-f3b37b45203f tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:35:23.221586 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-1a6946fd-756d-4108-8a2d-f3b37b45203f tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:35:23.227856 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1a6946fd-756d-4108-8a2d-f3b37b45203f tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:35:23.228303 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1a6946fd-756d-4108-8a2d-f3b37b45203f tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:35:23.229069 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1a6946fd-756d-4108-8a2d-f3b37b45203f tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:35:23.229502 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1a6946fd-756d-4108-8a2d-f3b37b45203f tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:35:23.259854 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-3cb7da0c-a8fe-42bf-ba4d-e743fc1e7768 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:35:23.260975 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-3cb7da0c-a8fe-42bf-ba4d-e743fc1e7768 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:35:23.267726 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3cb7da0c-a8fe-42bf-ba4d-e743fc1e7768 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:35:23.268172 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3cb7da0c-a8fe-42bf-ba4d-e743fc1e7768 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:35:23.269158 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3cb7da0c-a8fe-42bf-ba4d-e743fc1e7768 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:35:23.271404 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3cb7da0c-a8fe-42bf-ba4d-e743fc1e7768 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:35:23.317130 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-3cb7da0c-a8fe-42bf-ba4d-e743fc1e7768 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061541 Nov 01 01:35:23.318321 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 919/1748] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:35:23 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 01 01:35:23.356920 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-1a6946fd-756d-4108-8a2d-f3b37b45203f tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:35:23.365000 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-1a6946fd-756d-4108-8a2d-f3b37b45203f tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1449 microversion: 2.1 time: 0.147822 Nov 01 01:35:23.365571 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 830/1749] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:35:23 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1449 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:35:23.577182 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [req-18822c8c-f337-4755-a315-99bd9bf8d2ea req-08899720-603c-4e78-9ef5-044981624aa5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "330dc645-b56f-4c45-8a1b-7535494ce136", "name": "network-vif-deleted", "tag": "64c69a07-6eee-4d10-bcdf-91cd955820d9"}]} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:35:23.581087 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 01 01:35:23.581087 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: warnings.warn(msg) Nov 01 01:35:23.586494 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [req-18822c8c-f337-4755-a315-99bd9bf8d2ea req-08899720-603c-4e78-9ef5-044981624aa5 service nova] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:35:23.586949 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [req-18822c8c-f337-4755-a315-99bd9bf8d2ea req-08899720-603c-4e78-9ef5-044981624aa5 service nova] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:35:23.598811 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.compute.server_external_events [req-18822c8c-f337-4755-a315-99bd9bf8d2ea req-08899720-603c-4e78-9ef5-044981624aa5 service nova] Unable to find a host for instance 330dc645-b56f-4c45-8a1b-7535494ce136. Dropping event network-vif-deleted {{(pid=116267) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Nov 01 01:35:23.599697 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [req-18822c8c-f337-4755-a315-99bd9bf8d2ea req-08899720-603c-4e78-9ef5-044981624aa5 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.090018 Nov 01 01:35:23.600283 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 920/1750] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Nov 1 01:35:23 2021] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 91 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Nov 01 01:35:24.328885 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-73dbbe3f-d6b7-4262-b6ac-c3f3861e78bd tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:35:24.329786 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-73dbbe3f-d6b7-4262-b6ac-c3f3861e78bd tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:35:24.336629 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-73dbbe3f-d6b7-4262-b6ac-c3f3861e78bd tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:35:24.337071 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-73dbbe3f-d6b7-4262-b6ac-c3f3861e78bd tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:35:24.337856 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-73dbbe3f-d6b7-4262-b6ac-c3f3861e78bd tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:35:24.338279 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-73dbbe3f-d6b7-4262-b6ac-c3f3861e78bd tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:35:24.367482 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-73dbbe3f-d6b7-4262-b6ac-c3f3861e78bd tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042317 Nov 01 01:35:24.368031 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 831/1751] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:35:24 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:35:24.381235 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-4f30440b-5e4d-4336-a9c1-27b534afd294 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:35:24.381847 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-4f30440b-5e4d-4336-a9c1-27b534afd294 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:35:24.388069 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4f30440b-5e4d-4336-a9c1-27b534afd294 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:35:24.388508 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4f30440b-5e4d-4336-a9c1-27b534afd294 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:35:24.389263 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4f30440b-5e4d-4336-a9c1-27b534afd294 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:35:24.389688 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4f30440b-5e4d-4336-a9c1-27b534afd294 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:35:24.509190 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-4f30440b-5e4d-4336-a9c1-27b534afd294 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:35:24.516532 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-4f30440b-5e4d-4336-a9c1-27b534afd294 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1449 microversion: 2.1 time: 0.139502 Nov 01 01:35:24.517109 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 921/1752] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:35:24 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1449 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:35:25.378500 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-58db8a27-cca5-49aa-943d-d63238afcb75 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:35:25.379401 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-58db8a27-cca5-49aa-943d-d63238afcb75 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:35:25.385559 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-58db8a27-cca5-49aa-943d-d63238afcb75 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:35:25.385995 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-58db8a27-cca5-49aa-943d-d63238afcb75 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:35:25.386783 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-58db8a27-cca5-49aa-943d-d63238afcb75 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:35:25.387207 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-58db8a27-cca5-49aa-943d-d63238afcb75 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:35:25.415665 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-58db8a27-cca5-49aa-943d-d63238afcb75 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040985 Nov 01 01:35:25.416193 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 832/1753] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:35:25 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:35:25.533544 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-c9ccbffe-efa5-4905-8304-aa0654652b4f tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:35:25.534140 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-c9ccbffe-efa5-4905-8304-aa0654652b4f tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:35:25.540370 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c9ccbffe-efa5-4905-8304-aa0654652b4f tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:35:25.540808 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c9ccbffe-efa5-4905-8304-aa0654652b4f tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:35:25.541557 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c9ccbffe-efa5-4905-8304-aa0654652b4f tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:35:25.541987 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c9ccbffe-efa5-4905-8304-aa0654652b4f tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:35:25.658382 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-c9ccbffe-efa5-4905-8304-aa0654652b4f tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:35:25.665618 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-c9ccbffe-efa5-4905-8304-aa0654652b4f tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1449 microversion: 2.1 time: 0.135681 Nov 01 01:35:25.666170 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 922/1754] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:35:25 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1449 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:35:26.427293 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-61b31fe2-e457-48aa-b41f-c9bd3452f66d tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:35:26.428202 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-61b31fe2-e457-48aa-b41f-c9bd3452f66d tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:35:26.434553 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-61b31fe2-e457-48aa-b41f-c9bd3452f66d tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:35:26.434999 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-61b31fe2-e457-48aa-b41f-c9bd3452f66d tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:35:26.435759 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-61b31fe2-e457-48aa-b41f-c9bd3452f66d tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:35:26.436186 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-61b31fe2-e457-48aa-b41f-c9bd3452f66d tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:35:26.464249 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-61b31fe2-e457-48aa-b41f-c9bd3452f66d tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041510 Nov 01 01:35:26.464792 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 833/1755] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:35:26 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:35:26.681884 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-fb33f7d7-5673-491f-b2cd-1f5dc1c5965c tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:35:26.682584 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-fb33f7d7-5673-491f-b2cd-1f5dc1c5965c tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:35:26.688827 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-fb33f7d7-5673-491f-b2cd-1f5dc1c5965c tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:35:26.689270 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-fb33f7d7-5673-491f-b2cd-1f5dc1c5965c tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:35:26.690039 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-fb33f7d7-5673-491f-b2cd-1f5dc1c5965c tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:35:26.690474 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-fb33f7d7-5673-491f-b2cd-1f5dc1c5965c tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:35:26.809934 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-fb33f7d7-5673-491f-b2cd-1f5dc1c5965c tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:35:26.817419 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-fb33f7d7-5673-491f-b2cd-1f5dc1c5965c tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1449 microversion: 2.1 time: 0.139825 Nov 01 01:35:26.817978 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 923/1756] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:35:26 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1449 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:35:27.476303 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-fbb244fe-e86f-46f8-82ba-5a722ca27ae6 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:35:27.477203 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-fbb244fe-e86f-46f8-82ba-5a722ca27ae6 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:35:27.483409 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-fbb244fe-e86f-46f8-82ba-5a722ca27ae6 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:35:27.483846 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-fbb244fe-e86f-46f8-82ba-5a722ca27ae6 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:35:27.484595 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-fbb244fe-e86f-46f8-82ba-5a722ca27ae6 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:35:27.485019 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-fbb244fe-e86f-46f8-82ba-5a722ca27ae6 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:35:27.514155 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-fbb244fe-e86f-46f8-82ba-5a722ca27ae6 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042122 Nov 01 01:35:27.514734 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 834/1757] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:35:27 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:35:27.834901 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-67b4d1ca-755d-423a-91fa-a42c1f860d09 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:35:27.835498 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-67b4d1ca-755d-423a-91fa-a42c1f860d09 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:35:27.841809 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-67b4d1ca-755d-423a-91fa-a42c1f860d09 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:35:27.842243 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-67b4d1ca-755d-423a-91fa-a42c1f860d09 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:35:27.843024 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-67b4d1ca-755d-423a-91fa-a42c1f860d09 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:35:27.843448 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-67b4d1ca-755d-423a-91fa-a42c1f860d09 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:35:27.966746 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-67b4d1ca-755d-423a-91fa-a42c1f860d09 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:35:27.974006 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-67b4d1ca-755d-423a-91fa-a42c1f860d09 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1449 microversion: 2.1 time: 0.143276 Nov 01 01:35:27.975198 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 924/1758] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:35:27 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1449 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:35:28.525572 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-bb2df352-56bd-496b-afa4-c896a63c431d tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:35:28.526500 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-bb2df352-56bd-496b-afa4-c896a63c431d tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:35:28.532714 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-bb2df352-56bd-496b-afa4-c896a63c431d tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:35:28.533160 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-bb2df352-56bd-496b-afa4-c896a63c431d tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:35:28.533920 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-bb2df352-56bd-496b-afa4-c896a63c431d tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:35:28.534349 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-bb2df352-56bd-496b-afa4-c896a63c431d tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:35:28.563806 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-bb2df352-56bd-496b-afa4-c896a63c431d tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041933 Nov 01 01:35:28.564354 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 835/1759] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:35:28 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:35:28.991611 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-92366be9-42e4-41ca-9fa0-58df22ad7a14 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:35:28.992215 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-92366be9-42e4-41ca-9fa0-58df22ad7a14 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:35:28.998468 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-92366be9-42e4-41ca-9fa0-58df22ad7a14 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:35:28.998904 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-92366be9-42e4-41ca-9fa0-58df22ad7a14 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:35:28.999648 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-92366be9-42e4-41ca-9fa0-58df22ad7a14 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:35:29.000068 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-92366be9-42e4-41ca-9fa0-58df22ad7a14 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:35:29.116703 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-92366be9-42e4-41ca-9fa0-58df22ad7a14 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:35:29.123859 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-92366be9-42e4-41ca-9fa0-58df22ad7a14 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1449 microversion: 2.1 time: 0.136428 Nov 01 01:35:29.124418 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 925/1760] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:35:28 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1449 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:35:29.574317 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-204cbefc-3519-4d47-8e4e-e8b95298131a tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:35:29.575242 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-204cbefc-3519-4d47-8e4e-e8b95298131a tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:35:29.581500 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-204cbefc-3519-4d47-8e4e-e8b95298131a tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:35:29.581942 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-204cbefc-3519-4d47-8e4e-e8b95298131a tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:35:29.582738 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-204cbefc-3519-4d47-8e4e-e8b95298131a tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:35:29.583166 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-204cbefc-3519-4d47-8e4e-e8b95298131a tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:35:29.612287 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-204cbefc-3519-4d47-8e4e-e8b95298131a tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041745 Nov 01 01:35:29.612825 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 836/1761] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:35:29 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:35:30.140753 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-89725c28-f03a-4a1d-aefc-cdc792384606 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:35:30.141363 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-89725c28-f03a-4a1d-aefc-cdc792384606 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:35:30.147629 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-89725c28-f03a-4a1d-aefc-cdc792384606 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:35:30.148069 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-89725c28-f03a-4a1d-aefc-cdc792384606 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:35:30.148828 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-89725c28-f03a-4a1d-aefc-cdc792384606 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:35:30.149257 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-89725c28-f03a-4a1d-aefc-cdc792384606 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:35:30.265883 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-89725c28-f03a-4a1d-aefc-cdc792384606 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:35:30.273499 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-89725c28-f03a-4a1d-aefc-cdc792384606 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1449 microversion: 2.1 time: 0.136471 Nov 01 01:35:30.273994 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 926/1762] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:35:30 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1449 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:35:30.623528 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-8a4100e4-dfc4-4965-900d-dcbfda370258 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:35:30.624354 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-8a4100e4-dfc4-4965-900d-dcbfda370258 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:35:30.630477 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8a4100e4-dfc4-4965-900d-dcbfda370258 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:35:30.630919 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8a4100e4-dfc4-4965-900d-dcbfda370258 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:35:30.631666 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8a4100e4-dfc4-4965-900d-dcbfda370258 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:35:30.632089 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8a4100e4-dfc4-4965-900d-dcbfda370258 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:35:30.659836 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-8a4100e4-dfc4-4965-900d-dcbfda370258 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040087 Nov 01 01:35:30.660382 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 837/1763] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:35:30 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:35:31.289959 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-675b0d95-2481-4e98-80f6-d71136509ea4 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:35:31.290700 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-675b0d95-2481-4e98-80f6-d71136509ea4 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:35:31.296727 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-675b0d95-2481-4e98-80f6-d71136509ea4 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:35:31.297162 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-675b0d95-2481-4e98-80f6-d71136509ea4 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:35:31.297916 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-675b0d95-2481-4e98-80f6-d71136509ea4 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:35:31.298340 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-675b0d95-2481-4e98-80f6-d71136509ea4 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:35:31.421021 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-675b0d95-2481-4e98-80f6-d71136509ea4 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:35:31.428392 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-675b0d95-2481-4e98-80f6-d71136509ea4 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1449 microversion: 2.1 time: 0.142125 Nov 01 01:35:31.428961 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 927/1764] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:35:31 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1449 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:35:31.677387 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-6f4199e6-8545-44c7-ab3d-a4fdc10f7bef tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:35:31.678331 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-6f4199e6-8545-44c7-ab3d-a4fdc10f7bef tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:35:31.685175 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6f4199e6-8545-44c7-ab3d-a4fdc10f7bef tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:35:31.685619 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6f4199e6-8545-44c7-ab3d-a4fdc10f7bef tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:35:31.686382 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6f4199e6-8545-44c7-ab3d-a4fdc10f7bef tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:35:31.686837 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6f4199e6-8545-44c7-ab3d-a4fdc10f7bef tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:35:31.715880 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-6f4199e6-8545-44c7-ab3d-a4fdc10f7bef tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042044 Nov 01 01:35:31.716442 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 838/1765] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:35:31 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:35:32.445166 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-8dd8286e-08b2-4f3d-a8c2-c9e3842eeb97 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:35:32.445772 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-8dd8286e-08b2-4f3d-a8c2-c9e3842eeb97 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:35:32.451922 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8dd8286e-08b2-4f3d-a8c2-c9e3842eeb97 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:35:32.452365 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8dd8286e-08b2-4f3d-a8c2-c9e3842eeb97 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:35:32.453118 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8dd8286e-08b2-4f3d-a8c2-c9e3842eeb97 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:35:32.453545 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8dd8286e-08b2-4f3d-a8c2-c9e3842eeb97 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:35:32.568838 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-8dd8286e-08b2-4f3d-a8c2-c9e3842eeb97 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:35:32.576502 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-8dd8286e-08b2-4f3d-a8c2-c9e3842eeb97 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1449 microversion: 2.1 time: 0.134947 Nov 01 01:35:32.577064 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 928/1766] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:35:32 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1449 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:35:32.614354 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 01 01:35:32.614533 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: Mon Nov 1 01:35:32 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 01 01:35:32.727146 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-1b84c746-9568-430a-8886-5c55f81c1de7 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:35:32.728144 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-1b84c746-9568-430a-8886-5c55f81c1de7 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:35:32.734312 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1b84c746-9568-430a-8886-5c55f81c1de7 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:35:32.734784 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1b84c746-9568-430a-8886-5c55f81c1de7 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:35:32.735536 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1b84c746-9568-430a-8886-5c55f81c1de7 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:35:32.735961 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1b84c746-9568-430a-8886-5c55f81c1de7 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:35:32.764749 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-1b84c746-9568-430a-8886-5c55f81c1de7 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041363 Nov 01 01:35:32.765294 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 839/1767] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:35:32 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:35:33.593808 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-103ca19e-305a-49e8-b11a-442eca53be71 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:35:33.594413 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-103ca19e-305a-49e8-b11a-442eca53be71 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:35:33.600673 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-103ca19e-305a-49e8-b11a-442eca53be71 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:35:33.601112 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-103ca19e-305a-49e8-b11a-442eca53be71 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:35:33.602365 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-103ca19e-305a-49e8-b11a-442eca53be71 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:35:33.602819 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-103ca19e-305a-49e8-b11a-442eca53be71 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:35:33.720221 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-103ca19e-305a-49e8-b11a-442eca53be71 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:35:33.728158 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-103ca19e-305a-49e8-b11a-442eca53be71 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1449 microversion: 2.1 time: 0.138299 Nov 01 01:35:33.728715 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 929/1768] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:35:33 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1449 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:35:33.776729 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-2a9f966d-b450-4201-bab7-60c7fc3a4ab8 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:35:33.777622 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-2a9f966d-b450-4201-bab7-60c7fc3a4ab8 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:35:33.783710 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2a9f966d-b450-4201-bab7-60c7fc3a4ab8 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:35:33.784148 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2a9f966d-b450-4201-bab7-60c7fc3a4ab8 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:35:33.784900 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2a9f966d-b450-4201-bab7-60c7fc3a4ab8 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:35:33.785320 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2a9f966d-b450-4201-bab7-60c7fc3a4ab8 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:35:33.813943 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-2a9f966d-b450-4201-bab7-60c7fc3a4ab8 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041442 Nov 01 01:35:33.814644 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 840/1769] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:35:33 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:35:34.744565 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-89584bec-8021-47e4-962b-7eb5b51e01ed tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:35:34.745170 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-89584bec-8021-47e4-962b-7eb5b51e01ed tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:35:34.751321 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-89584bec-8021-47e4-962b-7eb5b51e01ed tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:35:34.751759 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-89584bec-8021-47e4-962b-7eb5b51e01ed tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:35:34.752502 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-89584bec-8021-47e4-962b-7eb5b51e01ed tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:35:34.752922 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-89584bec-8021-47e4-962b-7eb5b51e01ed tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:35:34.826108 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-4e442f75-95b3-481e-809a-181fe1bce21f tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:35:34.827043 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-4e442f75-95b3-481e-809a-181fe1bce21f tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:35:34.833389 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4e442f75-95b3-481e-809a-181fe1bce21f tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:35:34.833832 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4e442f75-95b3-481e-809a-181fe1bce21f tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:35:34.834653 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4e442f75-95b3-481e-809a-181fe1bce21f tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:35:34.835083 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4e442f75-95b3-481e-809a-181fe1bce21f tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:35:34.864815 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-4e442f75-95b3-481e-809a-181fe1bce21f tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042454 Nov 01 01:35:34.865294 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 841/1770] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:35:34 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 01 01:35:34.873029 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-89584bec-8021-47e4-962b-7eb5b51e01ed tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:35:34.880228 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-89584bec-8021-47e4-962b-7eb5b51e01ed tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1449 microversion: 2.1 time: 0.139310 Nov 01 01:35:34.880780 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 930/1771] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:35:34 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1449 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:35:35.876050 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-400ca699-0e42-4117-87ed-658164f92a90 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:35:35.876994 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-400ca699-0e42-4117-87ed-658164f92a90 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:35:35.883170 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-400ca699-0e42-4117-87ed-658164f92a90 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:35:35.883620 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-400ca699-0e42-4117-87ed-658164f92a90 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:35:35.884381 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-400ca699-0e42-4117-87ed-658164f92a90 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:35:35.884814 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-400ca699-0e42-4117-87ed-658164f92a90 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:35:35.896719 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-dc98df75-ee1d-4fcc-9f8e-7ee73761d846 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:35:35.897321 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-dc98df75-ee1d-4fcc-9f8e-7ee73761d846 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:35:35.904072 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-dc98df75-ee1d-4fcc-9f8e-7ee73761d846 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:35:35.904512 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-dc98df75-ee1d-4fcc-9f8e-7ee73761d846 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:35:35.905269 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-dc98df75-ee1d-4fcc-9f8e-7ee73761d846 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:35:35.905693 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-dc98df75-ee1d-4fcc-9f8e-7ee73761d846 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:35:35.913619 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-400ca699-0e42-4117-87ed-658164f92a90 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041275 Nov 01 01:35:35.914189 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 842/1772] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:35:35 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:35:36.021556 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-dc98df75-ee1d-4fcc-9f8e-7ee73761d846 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:35:36.029547 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-dc98df75-ee1d-4fcc-9f8e-7ee73761d846 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1449 microversion: 2.1 time: 0.136420 Nov 01 01:35:36.030148 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 931/1773] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:35:35 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1449 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:35:36.925686 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-ec04261d-1c9f-4c82-a8dc-d11bb79141bf tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:35:36.926648 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-ec04261d-1c9f-4c82-a8dc-d11bb79141bf tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:35:36.932799 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ec04261d-1c9f-4c82-a8dc-d11bb79141bf tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:35:36.933237 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ec04261d-1c9f-4c82-a8dc-d11bb79141bf tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:35:36.933985 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ec04261d-1c9f-4c82-a8dc-d11bb79141bf tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:35:36.934410 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ec04261d-1c9f-4c82-a8dc-d11bb79141bf tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:35:36.962504 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-ec04261d-1c9f-4c82-a8dc-d11bb79141bf tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039986 Nov 01 01:35:36.963042 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 843/1774] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:35:36 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:35:37.046635 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-58842a33-7cb8-4815-87e9-62a6b046f654 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:35:37.047236 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-58842a33-7cb8-4815-87e9-62a6b046f654 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:35:37.053383 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-58842a33-7cb8-4815-87e9-62a6b046f654 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:35:37.053822 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-58842a33-7cb8-4815-87e9-62a6b046f654 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:35:37.054605 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-58842a33-7cb8-4815-87e9-62a6b046f654 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:35:37.055035 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-58842a33-7cb8-4815-87e9-62a6b046f654 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:35:37.170661 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-58842a33-7cb8-4815-87e9-62a6b046f654 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:35:37.177795 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-58842a33-7cb8-4815-87e9-62a6b046f654 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1449 microversion: 2.1 time: 0.134737 Nov 01 01:35:37.178296 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 932/1775] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:35:37 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1449 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:35:37.973979 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-929409a3-e4b9-4064-bd94-b5407a9a0307 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:35:37.974903 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-929409a3-e4b9-4064-bd94-b5407a9a0307 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:35:37.981588 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-929409a3-e4b9-4064-bd94-b5407a9a0307 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:35:37.982033 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-929409a3-e4b9-4064-bd94-b5407a9a0307 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:35:37.982819 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-929409a3-e4b9-4064-bd94-b5407a9a0307 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:35:37.983243 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-929409a3-e4b9-4064-bd94-b5407a9a0307 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:35:38.011036 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-929409a3-e4b9-4064-bd94-b5407a9a0307 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040851 Nov 01 01:35:38.011567 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 844/1776] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:35:37 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:35:38.194136 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-89101438-6535-4783-8abb-4ad42f7cf643 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:35:38.194769 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-89101438-6535-4783-8abb-4ad42f7cf643 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:35:38.200939 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-89101438-6535-4783-8abb-4ad42f7cf643 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:35:38.201380 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-89101438-6535-4783-8abb-4ad42f7cf643 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:35:38.202132 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-89101438-6535-4783-8abb-4ad42f7cf643 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:35:38.202594 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-89101438-6535-4783-8abb-4ad42f7cf643 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:35:38.323175 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-89101438-6535-4783-8abb-4ad42f7cf643 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:35:38.330341 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-89101438-6535-4783-8abb-4ad42f7cf643 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1449 microversion: 2.1 time: 0.139925 Nov 01 01:35:38.330961 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 933/1777] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:35:38 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1449 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:35:39.022100 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-716b8ff5-ac6f-44f6-8ebc-29245f508e67 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:35:39.023025 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-716b8ff5-ac6f-44f6-8ebc-29245f508e67 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:35:39.029218 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-716b8ff5-ac6f-44f6-8ebc-29245f508e67 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:35:39.029659 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-716b8ff5-ac6f-44f6-8ebc-29245f508e67 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:35:39.030414 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-716b8ff5-ac6f-44f6-8ebc-29245f508e67 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:35:39.030869 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-716b8ff5-ac6f-44f6-8ebc-29245f508e67 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:35:39.058666 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-716b8ff5-ac6f-44f6-8ebc-29245f508e67 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040260 Nov 01 01:35:39.059188 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 845/1778] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:35:39 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:35:39.347438 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-ba1269d1-f807-42c7-936a-5286b322061a tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:35:39.348062 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-ba1269d1-f807-42c7-936a-5286b322061a tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:35:39.354822 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ba1269d1-f807-42c7-936a-5286b322061a tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:35:39.355256 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ba1269d1-f807-42c7-936a-5286b322061a tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:35:39.356008 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ba1269d1-f807-42c7-936a-5286b322061a tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:35:39.356432 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ba1269d1-f807-42c7-936a-5286b322061a tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:35:39.474036 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-ba1269d1-f807-42c7-936a-5286b322061a tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:35:39.481814 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-ba1269d1-f807-42c7-936a-5286b322061a tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1449 microversion: 2.1 time: 0.138088 Nov 01 01:35:39.482378 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 934/1779] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:35:39 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1449 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:35:40.069671 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-8ebd65f2-7aab-493b-bfc5-4318987724a0 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:35:40.070643 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-8ebd65f2-7aab-493b-bfc5-4318987724a0 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:35:40.076894 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8ebd65f2-7aab-493b-bfc5-4318987724a0 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:35:40.077344 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8ebd65f2-7aab-493b-bfc5-4318987724a0 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:35:40.078110 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8ebd65f2-7aab-493b-bfc5-4318987724a0 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:35:40.078569 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8ebd65f2-7aab-493b-bfc5-4318987724a0 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:35:40.107775 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-8ebd65f2-7aab-493b-bfc5-4318987724a0 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041779 Nov 01 01:35:40.108329 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 846/1780] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:35:40 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:35:40.498257 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-40b30b73-9f73-4d1c-8198-7a8b0a5aebc5 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:35:40.498895 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-40b30b73-9f73-4d1c-8198-7a8b0a5aebc5 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:35:40.505140 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-40b30b73-9f73-4d1c-8198-7a8b0a5aebc5 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:35:40.505589 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-40b30b73-9f73-4d1c-8198-7a8b0a5aebc5 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:35:40.506352 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-40b30b73-9f73-4d1c-8198-7a8b0a5aebc5 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:35:40.506811 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-40b30b73-9f73-4d1c-8198-7a8b0a5aebc5 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:35:40.623053 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-40b30b73-9f73-4d1c-8198-7a8b0a5aebc5 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:35:40.630346 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-40b30b73-9f73-4d1c-8198-7a8b0a5aebc5 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1449 microversion: 2.1 time: 0.135728 Nov 01 01:35:40.630940 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 935/1781] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:35:40 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1449 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:35:41.118909 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-f8ca98bc-b2cc-4570-bf59-4e100e912802 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:35:41.119806 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-f8ca98bc-b2cc-4570-bf59-4e100e912802 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:35:41.125882 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f8ca98bc-b2cc-4570-bf59-4e100e912802 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:35:41.126323 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f8ca98bc-b2cc-4570-bf59-4e100e912802 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:35:41.127102 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f8ca98bc-b2cc-4570-bf59-4e100e912802 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:35:41.127523 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f8ca98bc-b2cc-4570-bf59-4e100e912802 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:35:41.155885 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-f8ca98bc-b2cc-4570-bf59-4e100e912802 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040720 Nov 01 01:35:41.156411 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 847/1782] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:35:41 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:35:41.646955 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-c4f2bfdb-0999-4887-87ae-852860af55e9 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:35:41.647570 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-c4f2bfdb-0999-4887-87ae-852860af55e9 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:35:41.653778 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c4f2bfdb-0999-4887-87ae-852860af55e9 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:35:41.654219 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c4f2bfdb-0999-4887-87ae-852860af55e9 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:35:41.655016 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c4f2bfdb-0999-4887-87ae-852860af55e9 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:35:41.655450 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c4f2bfdb-0999-4887-87ae-852860af55e9 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:35:41.782542 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-c4f2bfdb-0999-4887-87ae-852860af55e9 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:35:41.789754 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-c4f2bfdb-0999-4887-87ae-852860af55e9 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1449 microversion: 2.1 time: 0.146485 Nov 01 01:35:41.790313 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 936/1783] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:35:41 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1449 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:35:42.167950 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-91c0acdc-a462-4472-8364-13d917c19454 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:35:42.168847 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-91c0acdc-a462-4472-8364-13d917c19454 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:35:42.175294 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-91c0acdc-a462-4472-8364-13d917c19454 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:35:42.175735 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-91c0acdc-a462-4472-8364-13d917c19454 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:35:42.176484 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-91c0acdc-a462-4472-8364-13d917c19454 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:35:42.176910 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-91c0acdc-a462-4472-8364-13d917c19454 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:35:42.204380 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-91c0acdc-a462-4472-8364-13d917c19454 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040968 Nov 01 01:35:42.204907 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 848/1784] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:35:42 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:35:42.806835 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-769854e2-4b78-4288-9dfe-f0057a91ba86 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:35:42.807473 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-769854e2-4b78-4288-9dfe-f0057a91ba86 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:35:42.814130 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-769854e2-4b78-4288-9dfe-f0057a91ba86 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:35:42.814613 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-769854e2-4b78-4288-9dfe-f0057a91ba86 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:35:42.815375 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-769854e2-4b78-4288-9dfe-f0057a91ba86 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:35:42.815805 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-769854e2-4b78-4288-9dfe-f0057a91ba86 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:35:42.931383 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-769854e2-4b78-4288-9dfe-f0057a91ba86 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:35:42.939200 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-769854e2-4b78-4288-9dfe-f0057a91ba86 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1449 microversion: 2.1 time: 0.136081 Nov 01 01:35:42.939794 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 937/1785] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:35:42 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1449 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:35:43.215669 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-e486ab4d-a5d7-4d7c-800e-85761b81eab8 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:35:43.216609 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-e486ab4d-a5d7-4d7c-800e-85761b81eab8 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:35:43.222998 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e486ab4d-a5d7-4d7c-800e-85761b81eab8 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:35:43.223444 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e486ab4d-a5d7-4d7c-800e-85761b81eab8 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:35:43.224233 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e486ab4d-a5d7-4d7c-800e-85761b81eab8 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:35:43.224663 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e486ab4d-a5d7-4d7c-800e-85761b81eab8 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:35:43.253446 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-e486ab4d-a5d7-4d7c-800e-85761b81eab8 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041805 Nov 01 01:35:43.253981 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 849/1786] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:35:43 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:35:43.956787 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-8c4bc3fe-8c41-4444-9ecd-f2487e1aa5ca tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:35:43.957389 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-8c4bc3fe-8c41-4444-9ecd-f2487e1aa5ca tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:35:43.963532 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8c4bc3fe-8c41-4444-9ecd-f2487e1aa5ca tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:35:43.964584 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8c4bc3fe-8c41-4444-9ecd-f2487e1aa5ca tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:35:43.965592 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8c4bc3fe-8c41-4444-9ecd-f2487e1aa5ca tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:35:43.966013 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8c4bc3fe-8c41-4444-9ecd-f2487e1aa5ca tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:35:44.080697 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-8c4bc3fe-8c41-4444-9ecd-f2487e1aa5ca tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:35:44.087974 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-8c4bc3fe-8c41-4444-9ecd-f2487e1aa5ca tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1449 microversion: 2.1 time: 0.134828 Nov 01 01:35:44.088535 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 938/1787] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:35:43 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1449 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:35:44.265211 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-a33fc8d2-ade8-4206-aca3-ecc243079825 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:35:44.266042 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-a33fc8d2-ade8-4206-aca3-ecc243079825 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:35:44.271836 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a33fc8d2-ade8-4206-aca3-ecc243079825 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:35:44.272273 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a33fc8d2-ade8-4206-aca3-ecc243079825 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:35:44.273021 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a33fc8d2-ade8-4206-aca3-ecc243079825 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:35:44.273447 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a33fc8d2-ade8-4206-aca3-ecc243079825 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:35:44.301583 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-a33fc8d2-ade8-4206-aca3-ecc243079825 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040802 Nov 01 01:35:44.302173 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 850/1788] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:35:44 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:35:45.106072 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-8def044d-2dca-47c7-8599-186a5c12abde tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:35:45.106714 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-8def044d-2dca-47c7-8599-186a5c12abde tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:35:45.112875 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8def044d-2dca-47c7-8599-186a5c12abde tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:35:45.113321 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8def044d-2dca-47c7-8599-186a5c12abde tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:35:45.114071 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8def044d-2dca-47c7-8599-186a5c12abde tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:35:45.114526 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8def044d-2dca-47c7-8599-186a5c12abde tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:35:45.234788 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-8def044d-2dca-47c7-8599-186a5c12abde tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:35:45.241971 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-8def044d-2dca-47c7-8599-186a5c12abde tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1449 microversion: 2.1 time: 0.140243 Nov 01 01:35:45.242555 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 939/1789] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:35:45 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1449 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:35:45.314242 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-b20ddafd-739a-446e-80d5-f549ff136abf tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:35:45.315289 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-b20ddafd-739a-446e-80d5-f549ff136abf tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:35:45.322771 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b20ddafd-739a-446e-80d5-f549ff136abf tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:35:45.323224 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b20ddafd-739a-446e-80d5-f549ff136abf tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:35:45.324564 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b20ddafd-739a-446e-80d5-f549ff136abf tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:35:45.324995 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b20ddafd-739a-446e-80d5-f549ff136abf tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:35:45.355214 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-b20ddafd-739a-446e-80d5-f549ff136abf tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046136 Nov 01 01:35:45.355763 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 851/1790] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:35:45 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:35:46.258455 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-0507a2d4-ea5d-4cec-8604-f72840a7071c tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:35:46.259073 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-0507a2d4-ea5d-4cec-8604-f72840a7071c tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:35:46.265311 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0507a2d4-ea5d-4cec-8604-f72840a7071c tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:35:46.265754 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0507a2d4-ea5d-4cec-8604-f72840a7071c tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:35:46.266595 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0507a2d4-ea5d-4cec-8604-f72840a7071c tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:35:46.267027 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0507a2d4-ea5d-4cec-8604-f72840a7071c tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:35:46.366965 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-be4f22a9-e721-41ce-8dd4-317b85ff8311 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:35:46.367793 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-be4f22a9-e721-41ce-8dd4-317b85ff8311 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:35:46.373771 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-be4f22a9-e721-41ce-8dd4-317b85ff8311 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:35:46.374289 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-be4f22a9-e721-41ce-8dd4-317b85ff8311 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:35:46.375276 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-be4f22a9-e721-41ce-8dd4-317b85ff8311 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:35:46.375942 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-be4f22a9-e721-41ce-8dd4-317b85ff8311 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:35:46.392571 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-0507a2d4-ea5d-4cec-8604-f72840a7071c tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:35:46.400048 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-0507a2d4-ea5d-4cec-8604-f72840a7071c tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1449 microversion: 2.1 time: 0.145242 Nov 01 01:35:46.400640 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 940/1791] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:35:46 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1449 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:35:46.413985 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-be4f22a9-e721-41ce-8dd4-317b85ff8311 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051162 Nov 01 01:35:46.414581 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 852/1792] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:35:46 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 01 01:35:47.420131 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-01b1ff70-121e-4ebc-ac83-4bf63dae249f tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:35:47.420730 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-01b1ff70-121e-4ebc-ac83-4bf63dae249f tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:35:47.426015 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-7ef6ce09-241b-4ab7-8f3a-90ca17cd57f7 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:35:47.426674 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-01b1ff70-121e-4ebc-ac83-4bf63dae249f tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:35:47.426952 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-7ef6ce09-241b-4ab7-8f3a-90ca17cd57f7 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:35:47.427142 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-01b1ff70-121e-4ebc-ac83-4bf63dae249f tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:35:47.427899 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-01b1ff70-121e-4ebc-ac83-4bf63dae249f tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:35:47.428323 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-01b1ff70-121e-4ebc-ac83-4bf63dae249f tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:35:47.433663 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7ef6ce09-241b-4ab7-8f3a-90ca17cd57f7 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:35:47.434111 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7ef6ce09-241b-4ab7-8f3a-90ca17cd57f7 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:35:47.434907 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7ef6ce09-241b-4ab7-8f3a-90ca17cd57f7 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:35:47.435343 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7ef6ce09-241b-4ab7-8f3a-90ca17cd57f7 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:35:47.463986 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-7ef6ce09-241b-4ab7-8f3a-90ca17cd57f7 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041621 Nov 01 01:35:47.464550 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 853/1793] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:35:47 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 01 01:35:47.545656 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-01b1ff70-121e-4ebc-ac83-4bf63dae249f tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:35:47.552862 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-01b1ff70-121e-4ebc-ac83-4bf63dae249f tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1449 microversion: 2.1 time: 0.136333 Nov 01 01:35:47.553421 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 941/1794] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:35:47 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1449 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:35:48.475614 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-bc65bc3a-1076-46b0-b50a-a724140d0879 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:35:48.476518 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-bc65bc3a-1076-46b0-b50a-a724140d0879 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:35:48.482750 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-bc65bc3a-1076-46b0-b50a-a724140d0879 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:35:48.483194 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-bc65bc3a-1076-46b0-b50a-a724140d0879 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:35:48.483950 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-bc65bc3a-1076-46b0-b50a-a724140d0879 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:35:48.484375 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-bc65bc3a-1076-46b0-b50a-a724140d0879 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:35:48.512348 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-bc65bc3a-1076-46b0-b50a-a724140d0879 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040553 Nov 01 01:35:48.512884 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 854/1795] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:35:48 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:35:48.569636 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-4b6b0810-39b9-4de1-9070-1130cfc57c0b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:35:48.570260 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-4b6b0810-39b9-4de1-9070-1130cfc57c0b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:35:48.577212 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4b6b0810-39b9-4de1-9070-1130cfc57c0b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:35:48.577663 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4b6b0810-39b9-4de1-9070-1130cfc57c0b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:35:48.578451 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4b6b0810-39b9-4de1-9070-1130cfc57c0b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:35:48.578898 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4b6b0810-39b9-4de1-9070-1130cfc57c0b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:35:48.915875 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-4b6b0810-39b9-4de1-9070-1130cfc57c0b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:35:48.923148 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-4b6b0810-39b9-4de1-9070-1130cfc57c0b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1449 microversion: 2.1 time: 0.357201 Nov 01 01:35:48.923703 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 942/1796] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:35:48 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1449 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:35:49.522818 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-91cf3723-da9a-43c4-ba1b-b71f5ab40d88 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:35:49.523680 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-91cf3723-da9a-43c4-ba1b-b71f5ab40d88 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:35:49.530379 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-91cf3723-da9a-43c4-ba1b-b71f5ab40d88 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:35:49.530985 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-91cf3723-da9a-43c4-ba1b-b71f5ab40d88 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:35:49.531740 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-91cf3723-da9a-43c4-ba1b-b71f5ab40d88 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:35:49.532167 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-91cf3723-da9a-43c4-ba1b-b71f5ab40d88 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:35:49.560994 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-91cf3723-da9a-43c4-ba1b-b71f5ab40d88 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042076 Nov 01 01:35:49.561543 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 855/1797] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:35:49 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:35:49.939805 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-7ecc8c74-7599-4790-9e66-7de35729b9b9 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:35:49.940413 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-7ecc8c74-7599-4790-9e66-7de35729b9b9 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:35:49.946673 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-7ecc8c74-7599-4790-9e66-7de35729b9b9 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:35:49.947114 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-7ecc8c74-7599-4790-9e66-7de35729b9b9 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:35:49.947901 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-7ecc8c74-7599-4790-9e66-7de35729b9b9 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:35:49.948839 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-7ecc8c74-7599-4790-9e66-7de35729b9b9 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:35:50.064777 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-7ecc8c74-7599-4790-9e66-7de35729b9b9 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:35:50.071968 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-7ecc8c74-7599-4790-9e66-7de35729b9b9 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1449 microversion: 2.1 time: 0.135901 Nov 01 01:35:50.072532 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 943/1798] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:35:49 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1449 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:35:50.572118 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-8358c1a0-19a8-49b0-a18e-ced4aa652b97 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:35:50.573006 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-8358c1a0-19a8-49b0-a18e-ced4aa652b97 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:35:50.579168 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8358c1a0-19a8-49b0-a18e-ced4aa652b97 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:35:50.579605 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8358c1a0-19a8-49b0-a18e-ced4aa652b97 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:35:50.580351 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8358c1a0-19a8-49b0-a18e-ced4aa652b97 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:35:50.580773 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8358c1a0-19a8-49b0-a18e-ced4aa652b97 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:35:50.609033 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-8358c1a0-19a8-49b0-a18e-ced4aa652b97 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040678 Nov 01 01:35:50.609511 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 856/1799] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:35:50 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:35:51.088830 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-04ba7e03-f014-4c96-b369-1444a4670fb0 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:35:51.090178 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-04ba7e03-f014-4c96-b369-1444a4670fb0 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:35:51.096432 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-04ba7e03-f014-4c96-b369-1444a4670fb0 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:35:51.096870 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-04ba7e03-f014-4c96-b369-1444a4670fb0 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:35:51.097613 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-04ba7e03-f014-4c96-b369-1444a4670fb0 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:35:51.098034 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-04ba7e03-f014-4c96-b369-1444a4670fb0 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:35:51.213021 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-04ba7e03-f014-4c96-b369-1444a4670fb0 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:35:51.221092 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-04ba7e03-f014-4c96-b369-1444a4670fb0 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1449 microversion: 2.1 time: 0.135938 Nov 01 01:35:51.221670 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 944/1800] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:35:51 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1449 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:35:51.620261 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-11d2dac7-6544-48b4-87f7-e721e93aef16 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:35:51.621097 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-11d2dac7-6544-48b4-87f7-e721e93aef16 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:35:51.627250 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-11d2dac7-6544-48b4-87f7-e721e93aef16 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:35:51.627696 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-11d2dac7-6544-48b4-87f7-e721e93aef16 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:35:51.628454 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-11d2dac7-6544-48b4-87f7-e721e93aef16 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:35:51.628879 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-11d2dac7-6544-48b4-87f7-e721e93aef16 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:35:51.657015 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-11d2dac7-6544-48b4-87f7-e721e93aef16 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040629 Nov 01 01:35:51.657547 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 857/1801] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:35:51 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:35:52.236996 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-7038cfdb-4de9-4cc4-a852-5fc1f6accf2d tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:35:52.237918 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-7038cfdb-4de9-4cc4-a852-5fc1f6accf2d tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:35:52.244230 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-7038cfdb-4de9-4cc4-a852-5fc1f6accf2d tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:35:52.244748 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-7038cfdb-4de9-4cc4-a852-5fc1f6accf2d tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:35:52.245519 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-7038cfdb-4de9-4cc4-a852-5fc1f6accf2d tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:35:52.245954 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-7038cfdb-4de9-4cc4-a852-5fc1f6accf2d tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:35:52.365782 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-7038cfdb-4de9-4cc4-a852-5fc1f6accf2d tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:35:52.373737 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-7038cfdb-4de9-4cc4-a852-5fc1f6accf2d tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1449 microversion: 2.1 time: 0.140521 Nov 01 01:35:52.374296 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 945/1802] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:35:52 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1449 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:35:52.668329 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-f84e9447-032c-4089-a2ec-2775e9600662 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:35:52.669175 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-f84e9447-032c-4089-a2ec-2775e9600662 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:35:52.675382 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f84e9447-032c-4089-a2ec-2775e9600662 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:35:52.675822 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f84e9447-032c-4089-a2ec-2775e9600662 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:35:52.676575 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f84e9447-032c-4089-a2ec-2775e9600662 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:35:52.677002 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f84e9447-032c-4089-a2ec-2775e9600662 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:35:52.706383 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-f84e9447-032c-4089-a2ec-2775e9600662 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041967 Nov 01 01:35:52.706951 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 858/1803] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:35:52 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:35:53.390169 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-969080b3-0a62-4231-b097-23ed8648b595 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:35:53.390822 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-969080b3-0a62-4231-b097-23ed8648b595 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:35:53.397024 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-969080b3-0a62-4231-b097-23ed8648b595 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:35:53.397465 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-969080b3-0a62-4231-b097-23ed8648b595 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:35:53.398222 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-969080b3-0a62-4231-b097-23ed8648b595 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:35:53.398676 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-969080b3-0a62-4231-b097-23ed8648b595 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:35:53.514444 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-969080b3-0a62-4231-b097-23ed8648b595 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:35:53.521569 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-969080b3-0a62-4231-b097-23ed8648b595 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1449 microversion: 2.1 time: 0.135092 Nov 01 01:35:53.522125 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 946/1804] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:35:53 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1449 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:35:53.718227 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-091c8156-d381-46f7-ac50-c99672c41578 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:35:53.719161 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-091c8156-d381-46f7-ac50-c99672c41578 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:35:53.725329 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-091c8156-d381-46f7-ac50-c99672c41578 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:35:53.725773 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-091c8156-d381-46f7-ac50-c99672c41578 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:35:53.726578 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-091c8156-d381-46f7-ac50-c99672c41578 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:35:53.727007 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-091c8156-d381-46f7-ac50-c99672c41578 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:35:53.754626 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-091c8156-d381-46f7-ac50-c99672c41578 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040937 Nov 01 01:35:53.755170 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 859/1805] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:35:53 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:35:54.538821 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-4bb98998-2636-4939-abe3-f2044c524ac8 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:35:54.539431 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-4bb98998-2636-4939-abe3-f2044c524ac8 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:35:54.546189 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4bb98998-2636-4939-abe3-f2044c524ac8 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:35:54.546671 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4bb98998-2636-4939-abe3-f2044c524ac8 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:35:54.547436 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4bb98998-2636-4939-abe3-f2044c524ac8 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:35:54.547870 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4bb98998-2636-4939-abe3-f2044c524ac8 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:35:54.665528 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-4bb98998-2636-4939-abe3-f2044c524ac8 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:35:54.673319 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-4bb98998-2636-4939-abe3-f2044c524ac8 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1449 microversion: 2.1 time: 0.138185 Nov 01 01:35:54.673888 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 947/1806] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:35:54 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1449 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:35:54.765043 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-a35c5df0-6cbe-40a2-b872-bace59711433 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:35:54.765978 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-a35c5df0-6cbe-40a2-b872-bace59711433 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:35:54.772255 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a35c5df0-6cbe-40a2-b872-bace59711433 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:35:54.772698 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a35c5df0-6cbe-40a2-b872-bace59711433 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:35:54.773455 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a35c5df0-6cbe-40a2-b872-bace59711433 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:35:54.773912 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a35c5df0-6cbe-40a2-b872-bace59711433 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:35:54.802735 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-a35c5df0-6cbe-40a2-b872-bace59711433 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041464 Nov 01 01:35:54.803276 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 860/1807] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:35:54 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:35:55.690710 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-5e9c711c-bf85-4b0e-b5f7-53a807dc2ef9 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:35:55.691323 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-5e9c711c-bf85-4b0e-b5f7-53a807dc2ef9 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:35:55.697528 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-5e9c711c-bf85-4b0e-b5f7-53a807dc2ef9 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:35:55.697992 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-5e9c711c-bf85-4b0e-b5f7-53a807dc2ef9 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:35:55.698757 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-5e9c711c-bf85-4b0e-b5f7-53a807dc2ef9 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:35:55.699196 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-5e9c711c-bf85-4b0e-b5f7-53a807dc2ef9 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:35:55.813577 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-f91e89b6-d4d1-4f7a-93cc-560ff90feee4 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:35:55.814534 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-f91e89b6-d4d1-4f7a-93cc-560ff90feee4 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:35:55.820656 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f91e89b6-d4d1-4f7a-93cc-560ff90feee4 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:35:55.821094 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f91e89b6-d4d1-4f7a-93cc-560ff90feee4 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:35:55.821882 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f91e89b6-d4d1-4f7a-93cc-560ff90feee4 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:35:55.822308 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f91e89b6-d4d1-4f7a-93cc-560ff90feee4 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:35:55.826152 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-5e9c711c-bf85-4b0e-b5f7-53a807dc2ef9 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:35:55.833487 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-5e9c711c-bf85-4b0e-b5f7-53a807dc2ef9 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1449 microversion: 2.1 time: 0.146480 Nov 01 01:35:55.834054 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 948/1808] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:35:55 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1449 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:35:55.850718 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-f91e89b6-d4d1-4f7a-93cc-560ff90feee4 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041404 Nov 01 01:35:55.851255 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 861/1809] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:35:55 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 01 01:35:56.850449 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-59591ae2-aaec-440f-8ca8-22654082a7f1 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:35:56.851078 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-59591ae2-aaec-440f-8ca8-22654082a7f1 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:35:56.857409 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-59591ae2-aaec-440f-8ca8-22654082a7f1 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:35:56.857848 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-59591ae2-aaec-440f-8ca8-22654082a7f1 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:35:56.859243 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-59591ae2-aaec-440f-8ca8-22654082a7f1 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:35:56.859672 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-59591ae2-aaec-440f-8ca8-22654082a7f1 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:35:56.861329 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-2b5372ba-bfdc-4781-a6df-0562a1771749 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:35:56.862226 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-2b5372ba-bfdc-4781-a6df-0562a1771749 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:35:56.868179 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2b5372ba-bfdc-4781-a6df-0562a1771749 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:35:56.868620 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2b5372ba-bfdc-4781-a6df-0562a1771749 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:35:56.869372 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2b5372ba-bfdc-4781-a6df-0562a1771749 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:35:56.869795 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2b5372ba-bfdc-4781-a6df-0562a1771749 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:35:56.897620 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-2b5372ba-bfdc-4781-a6df-0562a1771749 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040467 Nov 01 01:35:56.898364 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 862/1810] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:35:56 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 01 01:35:56.977148 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-59591ae2-aaec-440f-8ca8-22654082a7f1 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:35:56.984986 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-59591ae2-aaec-440f-8ca8-22654082a7f1 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1449 microversion: 2.1 time: 0.138165 Nov 01 01:35:56.985568 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 949/1811] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:35:56 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1449 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:35:57.909041 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-6a052fdf-e88c-40d8-a9d6-0bb9b20a30bb tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:35:57.909940 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-6a052fdf-e88c-40d8-a9d6-0bb9b20a30bb tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:35:57.916135 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6a052fdf-e88c-40d8-a9d6-0bb9b20a30bb tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:35:57.916579 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6a052fdf-e88c-40d8-a9d6-0bb9b20a30bb tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:35:57.917337 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6a052fdf-e88c-40d8-a9d6-0bb9b20a30bb tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:35:57.917764 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6a052fdf-e88c-40d8-a9d6-0bb9b20a30bb tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:35:57.946461 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-6a052fdf-e88c-40d8-a9d6-0bb9b20a30bb tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041149 Nov 01 01:35:57.946996 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 863/1812] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:35:57 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:35:58.001060 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-8b3cb3f7-6752-44f7-843b-102f4a4cfff0 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:35:58.001675 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-8b3cb3f7-6752-44f7-843b-102f4a4cfff0 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:35:58.007856 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8b3cb3f7-6752-44f7-843b-102f4a4cfff0 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:35:58.008301 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8b3cb3f7-6752-44f7-843b-102f4a4cfff0 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:35:58.009053 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8b3cb3f7-6752-44f7-843b-102f4a4cfff0 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:35:58.009480 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8b3cb3f7-6752-44f7-843b-102f4a4cfff0 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:35:58.125029 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-8b3cb3f7-6752-44f7-843b-102f4a4cfff0 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:35:58.132826 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-8b3cb3f7-6752-44f7-843b-102f4a4cfff0 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1449 microversion: 2.1 time: 0.135982 Nov 01 01:35:58.133382 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 950/1813] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:35:57 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1449 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:35:58.958321 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-13c0276d-4caa-4468-a721-3da4fbef00ae tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:35:58.959274 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-13c0276d-4caa-4468-a721-3da4fbef00ae tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:35:58.965724 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-13c0276d-4caa-4468-a721-3da4fbef00ae tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:35:58.966167 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-13c0276d-4caa-4468-a721-3da4fbef00ae tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:35:58.966983 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-13c0276d-4caa-4468-a721-3da4fbef00ae tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:35:58.967417 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-13c0276d-4caa-4468-a721-3da4fbef00ae tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:35:58.994611 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-13c0276d-4caa-4468-a721-3da4fbef00ae tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040646 Nov 01 01:35:58.995150 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 864/1814] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:35:58 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:35:59.148739 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-35bea56b-91d4-4ac6-999a-5388eb7eb976 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:35:59.149332 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-35bea56b-91d4-4ac6-999a-5388eb7eb976 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:35:59.155614 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-35bea56b-91d4-4ac6-999a-5388eb7eb976 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:35:59.157140 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-35bea56b-91d4-4ac6-999a-5388eb7eb976 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:35:59.157140 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-35bea56b-91d4-4ac6-999a-5388eb7eb976 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:35:59.157349 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-35bea56b-91d4-4ac6-999a-5388eb7eb976 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:35:59.278750 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-35bea56b-91d4-4ac6-999a-5388eb7eb976 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:35:59.285945 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-35bea56b-91d4-4ac6-999a-5388eb7eb976 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1449 microversion: 2.1 time: 0.140877 Nov 01 01:35:59.286517 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 951/1815] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:35:59 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1449 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:36:00.004842 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-004218fe-0ada-466f-b82c-c557ff3398c6 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:36:00.005772 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-004218fe-0ada-466f-b82c-c557ff3398c6 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:36:00.011957 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-004218fe-0ada-466f-b82c-c557ff3398c6 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:36:00.012398 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-004218fe-0ada-466f-b82c-c557ff3398c6 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:36:00.013160 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-004218fe-0ada-466f-b82c-c557ff3398c6 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:36:00.013584 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-004218fe-0ada-466f-b82c-c557ff3398c6 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:36:00.042545 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-004218fe-0ada-466f-b82c-c557ff3398c6 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041406 Nov 01 01:36:00.043100 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 865/1816] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:35:59 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:36:00.302583 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-2b2b1b6b-4bac-449f-bdfb-54fe02e5fd9c tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:36:00.303192 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-2b2b1b6b-4bac-449f-bdfb-54fe02e5fd9c tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:36:00.309358 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-2b2b1b6b-4bac-449f-bdfb-54fe02e5fd9c tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:36:00.309794 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-2b2b1b6b-4bac-449f-bdfb-54fe02e5fd9c tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:36:00.310571 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-2b2b1b6b-4bac-449f-bdfb-54fe02e5fd9c tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:36:00.311027 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-2b2b1b6b-4bac-449f-bdfb-54fe02e5fd9c tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:36:00.450145 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-2b2b1b6b-4bac-449f-bdfb-54fe02e5fd9c tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:36:00.458095 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-2b2b1b6b-4bac-449f-bdfb-54fe02e5fd9c tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1449 microversion: 2.1 time: 0.159128 Nov 01 01:36:00.458692 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 952/1817] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:36:00 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1449 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:36:01.054158 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-19284f19-9be7-4bc1-b33e-2e5dd5e137e2 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:36:01.055094 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-19284f19-9be7-4bc1-b33e-2e5dd5e137e2 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:36:01.061305 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-19284f19-9be7-4bc1-b33e-2e5dd5e137e2 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:36:01.061756 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-19284f19-9be7-4bc1-b33e-2e5dd5e137e2 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:36:01.062556 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-19284f19-9be7-4bc1-b33e-2e5dd5e137e2 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:36:01.062997 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-19284f19-9be7-4bc1-b33e-2e5dd5e137e2 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:36:01.091583 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-19284f19-9be7-4bc1-b33e-2e5dd5e137e2 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041680 Nov 01 01:36:01.092120 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 866/1818] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:36:01 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:36:01.477017 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-d97284e7-a32c-4849-acaa-bd0a42ddf437 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:36:01.477622 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-d97284e7-a32c-4849-acaa-bd0a42ddf437 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:36:01.483997 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d97284e7-a32c-4849-acaa-bd0a42ddf437 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:36:01.484438 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d97284e7-a32c-4849-acaa-bd0a42ddf437 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:36:01.485201 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d97284e7-a32c-4849-acaa-bd0a42ddf437 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:36:01.485628 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d97284e7-a32c-4849-acaa-bd0a42ddf437 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:36:01.604133 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-d97284e7-a32c-4849-acaa-bd0a42ddf437 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:36:01.611433 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-d97284e7-a32c-4849-acaa-bd0a42ddf437 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1449 microversion: 2.1 time: 0.138127 Nov 01 01:36:01.612001 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 953/1819] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:36:01 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1449 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:36:02.102665 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-3ee0ec39-7659-4cf1-b472-943cb1260e42 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:36:02.103580 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-3ee0ec39-7659-4cf1-b472-943cb1260e42 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:36:02.110213 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3ee0ec39-7659-4cf1-b472-943cb1260e42 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:36:02.110688 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3ee0ec39-7659-4cf1-b472-943cb1260e42 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:36:02.111655 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3ee0ec39-7659-4cf1-b472-943cb1260e42 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:36:02.112141 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3ee0ec39-7659-4cf1-b472-943cb1260e42 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:36:02.142740 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-3ee0ec39-7659-4cf1-b472-943cb1260e42 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043833 Nov 01 01:36:02.143298 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 867/1820] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:36:02 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:36:02.629052 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-835e6a6d-2335-4e56-927b-ddab5a1d3188 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:36:02.629607 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-835e6a6d-2335-4e56-927b-ddab5a1d3188 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:36:02.635770 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-835e6a6d-2335-4e56-927b-ddab5a1d3188 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:36:02.636211 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-835e6a6d-2335-4e56-927b-ddab5a1d3188 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:36:02.636961 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-835e6a6d-2335-4e56-927b-ddab5a1d3188 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:36:02.637382 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-835e6a6d-2335-4e56-927b-ddab5a1d3188 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:36:02.763273 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-835e6a6d-2335-4e56-927b-ddab5a1d3188 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:36:02.771279 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-835e6a6d-2335-4e56-927b-ddab5a1d3188 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1449 microversion: 2.1 time: 0.146478 Nov 01 01:36:02.771842 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 954/1821] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:36:02 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1449 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:36:03.154823 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-98026d74-24e2-4f99-a9c5-fac447b5f62e tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:36:03.155754 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-98026d74-24e2-4f99-a9c5-fac447b5f62e tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:36:03.162028 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-98026d74-24e2-4f99-a9c5-fac447b5f62e tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:36:03.162510 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-98026d74-24e2-4f99-a9c5-fac447b5f62e tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:36:03.163279 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-98026d74-24e2-4f99-a9c5-fac447b5f62e tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:36:03.163714 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-98026d74-24e2-4f99-a9c5-fac447b5f62e tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:36:03.192373 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-98026d74-24e2-4f99-a9c5-fac447b5f62e tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041342 Nov 01 01:36:03.192942 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 868/1822] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:36:03 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:36:03.788009 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-23c23db7-c955-4aba-bc21-c3b66377a46a tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:36:03.799296 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-23c23db7-c955-4aba-bc21-c3b66377a46a tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:36:03.799296 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-23c23db7-c955-4aba-bc21-c3b66377a46a tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:36:03.799296 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-23c23db7-c955-4aba-bc21-c3b66377a46a tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:36:03.799296 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-23c23db7-c955-4aba-bc21-c3b66377a46a tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:36:03.799717 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-23c23db7-c955-4aba-bc21-c3b66377a46a tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:36:03.915910 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-23c23db7-c955-4aba-bc21-c3b66377a46a tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:36:03.923661 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-23c23db7-c955-4aba-bc21-c3b66377a46a tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1449 microversion: 2.1 time: 0.140160 Nov 01 01:36:03.924225 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 955/1823] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:36:03 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1449 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:36:04.203769 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-bf606617-3e28-4f62-b8a1-73e15b01a149 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:36:04.204678 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-bf606617-3e28-4f62-b8a1-73e15b01a149 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:36:04.211597 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-bf606617-3e28-4f62-b8a1-73e15b01a149 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:36:04.212044 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-bf606617-3e28-4f62-b8a1-73e15b01a149 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:36:04.212809 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-bf606617-3e28-4f62-b8a1-73e15b01a149 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:36:04.213236 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-bf606617-3e28-4f62-b8a1-73e15b01a149 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:36:04.245988 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-bf606617-3e28-4f62-b8a1-73e15b01a149 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045642 Nov 01 01:36:04.247079 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 869/1824] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:36:04 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:36:04.940784 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-390ebc64-e1e4-45a7-ab14-208286c66cbd tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:36:04.941395 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-390ebc64-e1e4-45a7-ab14-208286c66cbd tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:36:04.947808 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-390ebc64-e1e4-45a7-ab14-208286c66cbd tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:36:04.948252 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-390ebc64-e1e4-45a7-ab14-208286c66cbd tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:36:04.949012 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-390ebc64-e1e4-45a7-ab14-208286c66cbd tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:36:04.949439 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-390ebc64-e1e4-45a7-ab14-208286c66cbd tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:36:05.071213 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-390ebc64-e1e4-45a7-ab14-208286c66cbd tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:36:05.078318 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-390ebc64-e1e4-45a7-ab14-208286c66cbd tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1449 microversion: 2.1 time: 0.141774 Nov 01 01:36:05.078908 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 956/1825] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:36:04 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1449 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:36:05.257431 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-97ff67c3-b4ea-4d4b-8f80-96cf8b06fa1b tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:36:05.258521 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-97ff67c3-b4ea-4d4b-8f80-96cf8b06fa1b tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:36:05.264587 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-97ff67c3-b4ea-4d4b-8f80-96cf8b06fa1b tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:36:05.265030 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-97ff67c3-b4ea-4d4b-8f80-96cf8b06fa1b tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:36:05.265825 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-97ff67c3-b4ea-4d4b-8f80-96cf8b06fa1b tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:36:05.266255 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-97ff67c3-b4ea-4d4b-8f80-96cf8b06fa1b tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:36:05.295502 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-97ff67c3-b4ea-4d4b-8f80-96cf8b06fa1b tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041745 Nov 01 01:36:05.296068 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 870/1826] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:36:05 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:36:06.095626 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-88fafc64-7029-40fe-a49b-686173b5e3e2 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:36:06.096244 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-88fafc64-7029-40fe-a49b-686173b5e3e2 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:36:06.103094 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-88fafc64-7029-40fe-a49b-686173b5e3e2 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:36:06.103539 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-88fafc64-7029-40fe-a49b-686173b5e3e2 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:36:06.104296 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-88fafc64-7029-40fe-a49b-686173b5e3e2 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:36:06.104728 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-88fafc64-7029-40fe-a49b-686173b5e3e2 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:36:06.224582 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-88fafc64-7029-40fe-a49b-686173b5e3e2 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:36:06.231785 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-88fafc64-7029-40fe-a49b-686173b5e3e2 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1449 microversion: 2.1 time: 0.139774 Nov 01 01:36:06.232343 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 957/1827] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:36:06 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1449 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:36:06.306661 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-9feae5d2-9bc4-4936-a48c-15349b583012 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:36:06.307590 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-9feae5d2-9bc4-4936-a48c-15349b583012 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:36:06.313671 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9feae5d2-9bc4-4936-a48c-15349b583012 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:36:06.314114 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9feae5d2-9bc4-4936-a48c-15349b583012 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:36:06.314885 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9feae5d2-9bc4-4936-a48c-15349b583012 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:36:06.315342 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9feae5d2-9bc4-4936-a48c-15349b583012 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:36:06.343831 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-9feae5d2-9bc4-4936-a48c-15349b583012 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040910 Nov 01 01:36:06.344381 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 871/1828] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:36:06 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:36:07.248242 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-2162757c-0b31-4132-9d7a-66e3ad9ec9c2 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:36:07.248825 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-2162757c-0b31-4132-9d7a-66e3ad9ec9c2 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:36:07.255054 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-2162757c-0b31-4132-9d7a-66e3ad9ec9c2 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:36:07.255493 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-2162757c-0b31-4132-9d7a-66e3ad9ec9c2 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:36:07.256242 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-2162757c-0b31-4132-9d7a-66e3ad9ec9c2 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:36:07.256668 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-2162757c-0b31-4132-9d7a-66e3ad9ec9c2 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:36:07.355649 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-afbaf223-e3a1-4ddb-a1d7-9a4f11c6d003 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:36:07.356539 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-afbaf223-e3a1-4ddb-a1d7-9a4f11c6d003 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:36:07.363354 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-afbaf223-e3a1-4ddb-a1d7-9a4f11c6d003 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:36:07.363784 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-afbaf223-e3a1-4ddb-a1d7-9a4f11c6d003 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:36:07.364551 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-afbaf223-e3a1-4ddb-a1d7-9a4f11c6d003 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:36:07.364977 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-afbaf223-e3a1-4ddb-a1d7-9a4f11c6d003 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:36:07.375627 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-2162757c-0b31-4132-9d7a-66e3ad9ec9c2 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:36:07.382888 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-2162757c-0b31-4132-9d7a-66e3ad9ec9c2 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1449 microversion: 2.1 time: 0.138260 Nov 01 01:36:07.383456 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 958/1829] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:36:07 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1449 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:36:07.393869 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-afbaf223-e3a1-4ddb-a1d7-9a4f11c6d003 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041831 Nov 01 01:36:07.394410 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 872/1830] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:36:07 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 01 01:36:08.399907 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-f95edad5-b95a-4d71-97f9-87f002a6866c tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:36:08.400557 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-f95edad5-b95a-4d71-97f9-87f002a6866c tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:36:08.403793 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-64b23ae2-884d-4dcf-a3bd-679bd7826362 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:36:08.404694 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-64b23ae2-884d-4dcf-a3bd-679bd7826362 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:36:08.406784 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f95edad5-b95a-4d71-97f9-87f002a6866c tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:36:08.407232 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f95edad5-b95a-4d71-97f9-87f002a6866c tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:36:08.407991 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f95edad5-b95a-4d71-97f9-87f002a6866c tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:36:08.408417 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f95edad5-b95a-4d71-97f9-87f002a6866c tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:36:08.411103 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-64b23ae2-884d-4dcf-a3bd-679bd7826362 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:36:08.411544 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-64b23ae2-884d-4dcf-a3bd-679bd7826362 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:36:08.412297 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-64b23ae2-884d-4dcf-a3bd-679bd7826362 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:36:08.412720 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-64b23ae2-884d-4dcf-a3bd-679bd7826362 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:36:08.440419 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-64b23ae2-884d-4dcf-a3bd-679bd7826362 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040173 Nov 01 01:36:08.440976 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 873/1831] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:36:08 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 01 01:36:08.525539 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-f95edad5-b95a-4d71-97f9-87f002a6866c tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:36:08.532790 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-f95edad5-b95a-4d71-97f9-87f002a6866c tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1449 microversion: 2.1 time: 0.136567 Nov 01 01:36:08.533348 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 959/1832] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:36:08 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1449 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:36:09.452330 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-21eac878-b2fb-4727-923b-fe4c9bedd3bb tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:36:09.453233 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-21eac878-b2fb-4727-923b-fe4c9bedd3bb tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:36:09.459973 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-21eac878-b2fb-4727-923b-fe4c9bedd3bb tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:36:09.460418 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-21eac878-b2fb-4727-923b-fe4c9bedd3bb tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:36:09.461176 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-21eac878-b2fb-4727-923b-fe4c9bedd3bb tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:36:09.461605 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-21eac878-b2fb-4727-923b-fe4c9bedd3bb tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:36:09.489931 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-21eac878-b2fb-4727-923b-fe4c9bedd3bb tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041327 Nov 01 01:36:09.490538 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 874/1833] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:36:09 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:36:09.549484 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-9c8519a6-4000-471e-b0f8-636ae63e8c7d tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:36:09.550086 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-9c8519a6-4000-471e-b0f8-636ae63e8c7d tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:36:09.556251 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9c8519a6-4000-471e-b0f8-636ae63e8c7d tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:36:09.556685 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9c8519a6-4000-471e-b0f8-636ae63e8c7d tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:36:09.557433 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9c8519a6-4000-471e-b0f8-636ae63e8c7d tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:36:09.557852 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9c8519a6-4000-471e-b0f8-636ae63e8c7d tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:36:09.678454 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-9c8519a6-4000-471e-b0f8-636ae63e8c7d tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:36:09.685683 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-9c8519a6-4000-471e-b0f8-636ae63e8c7d tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1449 microversion: 2.1 time: 0.139744 Nov 01 01:36:09.686239 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 960/1834] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:36:09 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1449 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:36:10.501006 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-1f06e0ec-d9eb-4277-8342-d992c257029c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:36:10.501915 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-1f06e0ec-d9eb-4277-8342-d992c257029c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:36:10.508057 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1f06e0ec-d9eb-4277-8342-d992c257029c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:36:10.508499 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1f06e0ec-d9eb-4277-8342-d992c257029c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:36:10.509248 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1f06e0ec-d9eb-4277-8342-d992c257029c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:36:10.509671 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1f06e0ec-d9eb-4277-8342-d992c257029c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:36:10.538116 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-1f06e0ec-d9eb-4277-8342-d992c257029c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040870 Nov 01 01:36:10.538683 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 875/1835] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:36:10 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:36:10.702734 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-d909ae63-ae3e-401b-bdac-40a21ebce4d8 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:36:10.703339 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-d909ae63-ae3e-401b-bdac-40a21ebce4d8 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:36:10.710275 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d909ae63-ae3e-401b-bdac-40a21ebce4d8 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:36:10.710744 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d909ae63-ae3e-401b-bdac-40a21ebce4d8 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:36:10.711494 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d909ae63-ae3e-401b-bdac-40a21ebce4d8 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:36:10.711912 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d909ae63-ae3e-401b-bdac-40a21ebce4d8 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:36:10.831674 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-d909ae63-ae3e-401b-bdac-40a21ebce4d8 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:36:10.838961 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-d909ae63-ae3e-401b-bdac-40a21ebce4d8 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1449 microversion: 2.1 time: 0.139946 Nov 01 01:36:10.839773 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 961/1836] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:36:10 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1449 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:36:11.549284 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-df58ab91-6579-4d47-82d8-f5443e8a40b0 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:36:11.550742 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-df58ab91-6579-4d47-82d8-f5443e8a40b0 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:36:11.556969 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-df58ab91-6579-4d47-82d8-f5443e8a40b0 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:36:11.557415 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-df58ab91-6579-4d47-82d8-f5443e8a40b0 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:36:11.558169 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-df58ab91-6579-4d47-82d8-f5443e8a40b0 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:36:11.558635 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-df58ab91-6579-4d47-82d8-f5443e8a40b0 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:36:11.586735 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-df58ab91-6579-4d47-82d8-f5443e8a40b0 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041205 Nov 01 01:36:11.587274 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 876/1837] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:36:11 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:36:11.856193 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-1a55409b-0e47-4e7b-8b88-c37bd959e0d0 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:36:11.856804 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-1a55409b-0e47-4e7b-8b88-c37bd959e0d0 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:36:11.863639 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-1a55409b-0e47-4e7b-8b88-c37bd959e0d0 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:36:11.864086 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-1a55409b-0e47-4e7b-8b88-c37bd959e0d0 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:36:11.864838 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-1a55409b-0e47-4e7b-8b88-c37bd959e0d0 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:36:11.865263 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-1a55409b-0e47-4e7b-8b88-c37bd959e0d0 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:36:11.982232 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-1a55409b-0e47-4e7b-8b88-c37bd959e0d0 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:36:11.990163 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-1a55409b-0e47-4e7b-8b88-c37bd959e0d0 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1449 microversion: 2.1 time: 0.137497 Nov 01 01:36:11.990945 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 962/1838] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:36:11 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1449 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:36:12.598235 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-da361cee-c145-4ef7-b3c3-303f23e47902 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:36:12.599165 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-da361cee-c145-4ef7-b3c3-303f23e47902 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:36:12.605342 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-da361cee-c145-4ef7-b3c3-303f23e47902 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:36:12.605779 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-da361cee-c145-4ef7-b3c3-303f23e47902 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:36:12.606562 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-da361cee-c145-4ef7-b3c3-303f23e47902 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:36:12.606989 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-da361cee-c145-4ef7-b3c3-303f23e47902 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:36:12.635002 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-da361cee-c145-4ef7-b3c3-303f23e47902 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040516 Nov 01 01:36:12.635483 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 877/1839] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 01:36:12 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:36:13.007449 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-96597afc-e181-488c-bb6b-2c6c8cfc7069 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:36:13.008052 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-96597afc-e181-488c-bb6b-2c6c8cfc7069 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:36:13.014340 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-96597afc-e181-488c-bb6b-2c6c8cfc7069 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:36:13.014813 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-96597afc-e181-488c-bb6b-2c6c8cfc7069 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:36:13.015567 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-96597afc-e181-488c-bb6b-2c6c8cfc7069 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:36:13.015993 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-96597afc-e181-488c-bb6b-2c6c8cfc7069 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:36:13.141486 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-96597afc-e181-488c-bb6b-2c6c8cfc7069 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:36:13.148657 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-96597afc-e181-488c-bb6b-2c6c8cfc7069 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1449 microversion: 2.1 time: 0.144901 Nov 01 01:36:13.149209 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 963/1840] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:36:13 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1449 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:36:13.646864 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-2064b80a-cb6e-47a7-b8e2-62de71828bd3 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:36:13.647701 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-2064b80a-cb6e-47a7-b8e2-62de71828bd3 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:36:13.653923 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2064b80a-cb6e-47a7-b8e2-62de71828bd3 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:36:13.654367 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2064b80a-cb6e-47a7-b8e2-62de71828bd3 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:36:13.655171 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2064b80a-cb6e-47a7-b8e2-62de71828bd3 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:36:13.655599 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2064b80a-cb6e-47a7-b8e2-62de71828bd3 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:36:13.681014 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: ERROR oslo.messaging._drivers.impl_rabbit [None req-2064b80a-cb6e-47a7-b8e2-62de71828bd3 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [adb701d4-fc7b-46f9-af6c-59e38b773f8c] AMQP server on 10.222.0.47:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 01 01:36:14.165277 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-36633801-718a-459b-ac82-ea69c348111f tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:36:14.165891 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-36633801-718a-459b-ac82-ea69c348111f tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:36:14.172142 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-36633801-718a-459b-ac82-ea69c348111f tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:36:14.172591 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-36633801-718a-459b-ac82-ea69c348111f tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:36:14.173362 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-36633801-718a-459b-ac82-ea69c348111f tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:36:14.173795 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-36633801-718a-459b-ac82-ea69c348111f tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:36:14.292906 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-36633801-718a-459b-ac82-ea69c348111f tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:36:14.301220 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-36633801-718a-459b-ac82-ea69c348111f tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1449 microversion: 2.1 time: 0.139034 Nov 01 01:36:14.301822 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 964/1841] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:36:14 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1449 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:36:14.306360 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-ddd1586c-ac80-4d2f-a1e2-23442169863a tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:36:14.306887 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-ddd1586c-ac80-4d2f-a1e2-23442169863a tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] [instance: 947fe830-e3f1-4dcc-81ab-fd177af6c35f] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:36:14.312644 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ddd1586c-ac80-4d2f-a1e2-23442169863a tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:36:14.313090 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ddd1586c-ac80-4d2f-a1e2-23442169863a tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:36:14.313847 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ddd1586c-ac80-4d2f-a1e2-23442169863a tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:36:14.314273 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ddd1586c-ac80-4d2f-a1e2-23442169863a tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:36:14.342364 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-ddd1586c-ac80-4d2f-a1e2-23442169863a tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] [instance: 947fe830-e3f1-4dcc-81ab-fd177af6c35f] Going to try to terminate instance {{(pid=116267) delete /opt/stack/nova/nova/compute/api.py:2612}} Nov 01 01:36:14.698104 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO oslo.messaging._drivers.impl_rabbit [None req-2064b80a-cb6e-47a7-b8e2-62de71828bd3 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [adb701d4-fc7b-46f9-af6c-59e38b773f8c] Reconnected to AMQP server on 10.222.0.47:5672 via [amqp] client with port 49862. Nov 01 01:36:14.737067 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-ddd1586c-ac80-4d2f-a1e2-23442169863a tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] 10.222.0.47 "DELETE /compute/v2.1/servers/947fe830-e3f1-4dcc-81ab-fd177af6c35f" status: 204 len: 0 microversion: 2.1 time: 0.433988 Nov 01 01:36:14.737653 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 965/1842] 10.222.0.47 () {58 vars in 1238 bytes} [Mon Nov 1 01:36:14 2021] DELETE /compute/v2.1/servers/947fe830-e3f1-4dcc-81ab-fd177af6c35f => generated 0 bytes in 435 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 01 01:36:14.746676 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-b6a6c7bb-676f-405b-96ac-27ca6e3a26f6 tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:36:14.748673 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-b6a6c7bb-676f-405b-96ac-27ca6e3a26f6 tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] [instance: 947fe830-e3f1-4dcc-81ab-fd177af6c35f] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:36:14.754154 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b6a6c7bb-676f-405b-96ac-27ca6e3a26f6 tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:36:14.754647 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b6a6c7bb-676f-405b-96ac-27ca6e3a26f6 tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:36:14.755456 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b6a6c7bb-676f-405b-96ac-27ca6e3a26f6 tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:36:14.755887 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b6a6c7bb-676f-405b-96ac-27ca6e3a26f6 tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:36:14.769965 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-2064b80a-cb6e-47a7-b8e2-62de71828bd3 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "POST /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/action" status: 200 len: 76157 microversion: 2.1 time: 1.126652 Nov 01 01:36:14.770768 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 878/1843] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Nov 1 01:36:13 2021] POST /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8/action => generated 76157 bytes in 1129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 01 01:36:14.885317 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-b6a6c7bb-676f-405b-96ac-27ca6e3a26f6 tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec98ca6057d54c8caeac35ed360d8765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd454283e656c405f88ecb0b2ed70760a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:36:14.892745 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-b6a6c7bb-676f-405b-96ac-27ca6e3a26f6 tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] 10.222.0.47 "GET /compute/v2.1/servers/947fe830-e3f1-4dcc-81ab-fd177af6c35f" status: 200 len: 1554 microversion: 2.1 time: 0.150265 Nov 01 01:36:14.893494 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 966/1844] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:36:14 2021] GET /compute/v2.1/servers/947fe830-e3f1-4dcc-81ab-fd177af6c35f => generated 1554 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:36:15.319012 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [req-45ea0a25-8c82-49e5-a534-bb0859c1b403 req-5fa01945-86a5-40b5-a7b6-0f664a156879 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7554da88-1726-438a-bed5-4e30d999ba9d", "name": "network-vif-deleted", "tag": "bebb1bd2-6980-4bbb-a08e-ca30b1d8aac9"}]} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:36:15.319223 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-09511d58-ea1a-4528-aa1c-b065414e943b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:36:15.320668 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 01 01:36:15.320668 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: warnings.warn(msg) Nov 01 01:36:15.323257 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-09511d58-ea1a-4528-aa1c-b065414e943b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:36:15.329137 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [req-45ea0a25-8c82-49e5-a534-bb0859c1b403 req-5fa01945-86a5-40b5-a7b6-0f664a156879 service nova] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:36:15.329667 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [req-45ea0a25-8c82-49e5-a534-bb0859c1b403 req-5fa01945-86a5-40b5-a7b6-0f664a156879 service nova] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:36:15.329793 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-09511d58-ea1a-4528-aa1c-b065414e943b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:36:15.330192 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-09511d58-ea1a-4528-aa1c-b065414e943b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:36:15.330990 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-09511d58-ea1a-4528-aa1c-b065414e943b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:36:15.331425 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-09511d58-ea1a-4528-aa1c-b065414e943b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:36:15.342301 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.compute.server_external_events [req-45ea0a25-8c82-49e5-a534-bb0859c1b403 req-5fa01945-86a5-40b5-a7b6-0f664a156879 service nova] Creating event network-vif-deleted:bebb1bd2-6980-4bbb-a08e-ca30b1d8aac9 for instance 7554da88-1726-438a-bed5-4e30d999ba9d on hv-cinder-81561 Nov 01 01:36:15.349497 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [req-45ea0a25-8c82-49e5-a534-bb0859c1b403 req-5fa01945-86a5-40b5-a7b6-0f664a156879 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037452 Nov 01 01:36:15.351115 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 879/1845] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Nov 1 01:36:15 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:36:15.415208 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-09511d58-ea1a-4528-aa1c-b065414e943b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:36:15.423309 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-09511d58-ea1a-4528-aa1c-b065414e943b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1375 microversion: 2.1 time: 0.108979 Nov 01 01:36:15.425066 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 967/1846] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:36:15 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1375 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:36:15.911771 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-6746bab2-736d-4cc5-b332-c26f9301f4ef tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:36:15.912467 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-6746bab2-736d-4cc5-b332-c26f9301f4ef tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] [instance: 947fe830-e3f1-4dcc-81ab-fd177af6c35f] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:36:15.918802 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6746bab2-736d-4cc5-b332-c26f9301f4ef tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:36:15.919246 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6746bab2-736d-4cc5-b332-c26f9301f4ef tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:36:15.920011 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6746bab2-736d-4cc5-b332-c26f9301f4ef tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:36:15.920439 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6746bab2-736d-4cc5-b332-c26f9301f4ef tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:36:16.040929 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-6746bab2-736d-4cc5-b332-c26f9301f4ef tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec98ca6057d54c8caeac35ed360d8765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd454283e656c405f88ecb0b2ed70760a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:36:16.048426 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-6746bab2-736d-4cc5-b332-c26f9301f4ef tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] 10.222.0.47 "GET /compute/v2.1/servers/947fe830-e3f1-4dcc-81ab-fd177af6c35f" status: 200 len: 1554 microversion: 2.1 time: 0.141056 Nov 01 01:36:16.048995 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 880/1847] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:36:15 2021] GET /compute/v2.1/servers/947fe830-e3f1-4dcc-81ab-fd177af6c35f => generated 1554 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:36:16.441095 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-b1c8ced0-7e8a-4b60-b661-0b17700b49f0 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:36:16.441710 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-b1c8ced0-7e8a-4b60-b661-0b17700b49f0 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:36:16.448237 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b1c8ced0-7e8a-4b60-b661-0b17700b49f0 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:36:16.453689 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b1c8ced0-7e8a-4b60-b661-0b17700b49f0 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:36:16.453689 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b1c8ced0-7e8a-4b60-b661-0b17700b49f0 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:36:16.453689 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b1c8ced0-7e8a-4b60-b661-0b17700b49f0 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:36:16.513226 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-b1c8ced0-7e8a-4b60-b661-0b17700b49f0 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:36:16.521163 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-b1c8ced0-7e8a-4b60-b661-0b17700b49f0 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1212 microversion: 2.1 time: 0.083714 Nov 01 01:36:16.523775 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 968/1848] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:36:16 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1212 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:36:17.064930 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-2504de19-97bd-4c7e-b626-4652c5f33e4e tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:36:17.065536 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-2504de19-97bd-4c7e-b626-4652c5f33e4e tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] [instance: 947fe830-e3f1-4dcc-81ab-fd177af6c35f] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:36:17.072161 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2504de19-97bd-4c7e-b626-4652c5f33e4e tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:36:17.072605 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2504de19-97bd-4c7e-b626-4652c5f33e4e tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:36:17.073381 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2504de19-97bd-4c7e-b626-4652c5f33e4e tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:36:17.073813 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2504de19-97bd-4c7e-b626-4652c5f33e4e tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:36:17.106380 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2504de19-97bd-4c7e-b626-4652c5f33e4e tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:36:17.106863 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2504de19-97bd-4c7e-b626-4652c5f33e4e tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:36:17.107312 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.objects.instance [None req-2504de19-97bd-4c7e-b626-4652c5f33e4e tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Lazy-loading 'fault' on Instance uuid 947fe830-e3f1-4dcc-81ab-fd177af6c35f {{(pid=116266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 01 01:36:17.149923 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-2504de19-97bd-4c7e-b626-4652c5f33e4e tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec98ca6057d54c8caeac35ed360d8765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd454283e656c405f88ecb0b2ed70760a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:36:17.157804 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-2504de19-97bd-4c7e-b626-4652c5f33e4e tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] 10.222.0.47 "GET /compute/v2.1/servers/947fe830-e3f1-4dcc-81ab-fd177af6c35f" status: 200 len: 1347 microversion: 2.1 time: 0.096485 Nov 01 01:36:17.158398 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 881/1849] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:36:17 2021] GET /compute/v2.1/servers/947fe830-e3f1-4dcc-81ab-fd177af6c35f => generated 1347 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:36:17.365548 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [req-0b7643a0-e39c-45d7-afe5-d05f4214213b req-47308dec-0306-4a36-8278-8822d46bda49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "947fe830-e3f1-4dcc-81ab-fd177af6c35f", "name": "network-vif-deleted", "tag": "dcc542d2-302c-4d52-bd3e-404d021f3507"}]} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:36:17.367180 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 01 01:36:17.367180 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: warnings.warn(msg) Nov 01 01:36:17.374312 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [req-0b7643a0-e39c-45d7-afe5-d05f4214213b req-47308dec-0306-4a36-8278-8822d46bda49 service nova] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:36:17.375172 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [req-0b7643a0-e39c-45d7-afe5-d05f4214213b req-47308dec-0306-4a36-8278-8822d46bda49 service nova] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:36:17.386254 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.compute.server_external_events [req-0b7643a0-e39c-45d7-afe5-d05f4214213b req-47308dec-0306-4a36-8278-8822d46bda49 service nova] Creating event network-vif-deleted:dcc542d2-302c-4d52-bd3e-404d021f3507 for instance 947fe830-e3f1-4dcc-81ab-fd177af6c35f on hv-cinder-81561 Nov 01 01:36:17.391585 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [req-0b7643a0-e39c-45d7-afe5-d05f4214213b req-47308dec-0306-4a36-8278-8822d46bda49 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030198 Nov 01 01:36:17.392569 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 969/1850] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Nov 1 01:36:17 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:36:17.537075 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-d7a7b3a1-7609-4c12-b608-17d4dd432410 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:36:17.537669 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-d7a7b3a1-7609-4c12-b608-17d4dd432410 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:36:17.544088 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d7a7b3a1-7609-4c12-b608-17d4dd432410 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:36:17.544538 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d7a7b3a1-7609-4c12-b608-17d4dd432410 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:36:17.545309 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d7a7b3a1-7609-4c12-b608-17d4dd432410 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:36:17.545786 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d7a7b3a1-7609-4c12-b608-17d4dd432410 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:36:17.605931 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-d7a7b3a1-7609-4c12-b608-17d4dd432410 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:36:17.613388 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-d7a7b3a1-7609-4c12-b608-17d4dd432410 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1212 microversion: 2.1 time: 0.079943 Nov 01 01:36:17.614509 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 882/1851] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:36:17 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1212 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:36:18.179245 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-379a04e7-7f12-4f94-a4c1-f070e3f9392a tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:36:18.179989 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-379a04e7-7f12-4f94-a4c1-f070e3f9392a tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] [instance: 947fe830-e3f1-4dcc-81ab-fd177af6c35f] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:36:18.186055 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-379a04e7-7f12-4f94-a4c1-f070e3f9392a tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:36:18.186546 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-379a04e7-7f12-4f94-a4c1-f070e3f9392a tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:36:18.187313 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-379a04e7-7f12-4f94-a4c1-f070e3f9392a tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:36:18.187731 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-379a04e7-7f12-4f94-a4c1-f070e3f9392a tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:36:18.205332 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.wsgi [None req-379a04e7-7f12-4f94-a4c1-f070e3f9392a tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] HTTP exception thrown: Instance 947fe830-e3f1-4dcc-81ab-fd177af6c35f could not be found. Nov 01 01:36:18.205332 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-379a04e7-7f12-4f94-a4c1-f070e3f9392a tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Returning 404 to user: Instance 947fe830-e3f1-4dcc-81ab-fd177af6c35f could not be found. {{(pid=116267) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 01 01:36:18.205332 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-379a04e7-7f12-4f94-a4c1-f070e3f9392a tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] 10.222.0.47 "GET /compute/v2.1/servers/947fe830-e3f1-4dcc-81ab-fd177af6c35f" status: 404 len: 111 microversion: 2.1 time: 0.028365 Nov 01 01:36:18.205332 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 970/1852] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:36:18 2021] GET /compute/v2.1/servers/947fe830-e3f1-4dcc-81ab-fd177af6c35f => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 01:36:18.211709 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-4720730f-4ede-4190-b8c2-3459d1c918db tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] Calling method '.version_select at 0x7fccf6b0bf70>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:36:18.360665 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-4720730f-4ede-4190-b8c2-3459d1c918db tempest-TestMinimumBasicScenario-1566978845 tempest-TestMinimumBasicScenario-1566978845-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1281802673" status: 202 len: 0 microversion: 2.1 time: 0.152450 Nov 01 01:36:18.362699 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 883/1853] 10.222.0.47 () {58 vars in 1271 bytes} [Mon Nov 1 01:36:18 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1281802673 => generated 0 bytes in 155 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 01 01:36:18.630105 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-0aa69c6d-42ab-415f-a76d-bae646664734 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:36:18.637369 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-0aa69c6d-42ab-415f-a76d-bae646664734 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:36:18.637369 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0aa69c6d-42ab-415f-a76d-bae646664734 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:36:18.637709 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0aa69c6d-42ab-415f-a76d-bae646664734 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:36:18.638516 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0aa69c6d-42ab-415f-a76d-bae646664734 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:36:18.638949 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0aa69c6d-42ab-415f-a76d-bae646664734 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:36:18.710595 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-0aa69c6d-42ab-415f-a76d-bae646664734 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:36:18.718655 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-0aa69c6d-42ab-415f-a76d-bae646664734 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1212 microversion: 2.1 time: 0.092462 Nov 01 01:36:18.719222 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 971/1854] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:36:18 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1212 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:36:19.736143 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-eca0cda1-b675-4983-880e-c7e50c469824 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:36:19.737366 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-eca0cda1-b675-4983-880e-c7e50c469824 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:36:19.743972 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-eca0cda1-b675-4983-880e-c7e50c469824 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:36:19.744424 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-eca0cda1-b675-4983-880e-c7e50c469824 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:36:19.745194 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-eca0cda1-b675-4983-880e-c7e50c469824 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:36:19.745628 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-eca0cda1-b675-4983-880e-c7e50c469824 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:36:19.803988 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-eca0cda1-b675-4983-880e-c7e50c469824 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:36:19.811697 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-eca0cda1-b675-4983-880e-c7e50c469824 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1212 microversion: 2.1 time: 0.079604 Nov 01 01:36:19.812287 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 884/1855] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:36:19 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1212 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:36:20.828940 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-b23685e3-edd9-4534-946b-3a9f76a5252f tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:36:20.830621 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-b23685e3-edd9-4534-946b-3a9f76a5252f tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:36:20.836656 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b23685e3-edd9-4534-946b-3a9f76a5252f tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:36:20.837099 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b23685e3-edd9-4534-946b-3a9f76a5252f tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:36:20.837865 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b23685e3-edd9-4534-946b-3a9f76a5252f tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:36:20.838516 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b23685e3-edd9-4534-946b-3a9f76a5252f tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:36:20.901441 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-b23685e3-edd9-4534-946b-3a9f76a5252f tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:36:20.908951 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-b23685e3-edd9-4534-946b-3a9f76a5252f tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1212 microversion: 2.1 time: 0.083624 Nov 01 01:36:20.909531 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 972/1856] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:36:20 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1212 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:36:21.925136 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-a8f19ec3-4b84-47a3-8a99-d806ed1c8e65 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:36:21.926017 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-a8f19ec3-4b84-47a3-8a99-d806ed1c8e65 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:36:21.932896 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a8f19ec3-4b84-47a3-8a99-d806ed1c8e65 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:36:21.933374 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a8f19ec3-4b84-47a3-8a99-d806ed1c8e65 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:36:21.934215 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a8f19ec3-4b84-47a3-8a99-d806ed1c8e65 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:36:21.934755 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a8f19ec3-4b84-47a3-8a99-d806ed1c8e65 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:36:21.995109 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-a8f19ec3-4b84-47a3-8a99-d806ed1c8e65 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:36:22.002492 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-a8f19ec3-4b84-47a3-8a99-d806ed1c8e65 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1212 microversion: 2.1 time: 0.081042 Nov 01 01:36:22.003169 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 885/1857] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:36:21 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1212 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:36:23.030821 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-bcc20fb1-457a-4111-b8ed-001b9cd4adef tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:36:23.031681 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-bcc20fb1-457a-4111-b8ed-001b9cd4adef tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:36:23.039129 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-bcc20fb1-457a-4111-b8ed-001b9cd4adef tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:36:23.039899 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-bcc20fb1-457a-4111-b8ed-001b9cd4adef tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:36:23.040775 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-bcc20fb1-457a-4111-b8ed-001b9cd4adef tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:36:23.041279 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-bcc20fb1-457a-4111-b8ed-001b9cd4adef tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:36:23.119655 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-bcc20fb1-457a-4111-b8ed-001b9cd4adef tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:36:23.128379 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-bcc20fb1-457a-4111-b8ed-001b9cd4adef tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1212 microversion: 2.1 time: 0.110003 Nov 01 01:36:23.132241 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 973/1858] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:36:23 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1212 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:36:24.148294 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-50d1bcf6-0887-4468-a884-68fa8115cb5b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:36:24.148893 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-50d1bcf6-0887-4468-a884-68fa8115cb5b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:36:24.155510 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-50d1bcf6-0887-4468-a884-68fa8115cb5b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:36:24.155954 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-50d1bcf6-0887-4468-a884-68fa8115cb5b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:36:24.156728 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-50d1bcf6-0887-4468-a884-68fa8115cb5b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:36:24.157166 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-50d1bcf6-0887-4468-a884-68fa8115cb5b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:36:24.226321 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-50d1bcf6-0887-4468-a884-68fa8115cb5b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:36:24.233485 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-50d1bcf6-0887-4468-a884-68fa8115cb5b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1212 microversion: 2.1 time: 0.089449 Nov 01 01:36:24.234057 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 886/1859] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:36:24 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1212 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:36:25.250056 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-fed843a3-0b37-4765-b538-bb2b052b0fd3 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:36:25.250831 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-fed843a3-0b37-4765-b538-bb2b052b0fd3 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:36:25.257080 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-fed843a3-0b37-4765-b538-bb2b052b0fd3 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:36:25.257622 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-fed843a3-0b37-4765-b538-bb2b052b0fd3 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:36:25.258478 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-fed843a3-0b37-4765-b538-bb2b052b0fd3 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:36:25.258906 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-fed843a3-0b37-4765-b538-bb2b052b0fd3 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:36:25.329451 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-fed843a3-0b37-4765-b538-bb2b052b0fd3 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:36:25.337224 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-fed843a3-0b37-4765-b538-bb2b052b0fd3 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1212 microversion: 2.1 time: 0.090851 Nov 01 01:36:25.337785 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 974/1860] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:36:25 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1212 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:36:26.352970 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-498dce79-8948-4737-8203-557d4e06ab00 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:36:26.353579 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-498dce79-8948-4737-8203-557d4e06ab00 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:36:26.359759 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-498dce79-8948-4737-8203-557d4e06ab00 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:36:26.360209 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-498dce79-8948-4737-8203-557d4e06ab00 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:36:26.360986 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-498dce79-8948-4737-8203-557d4e06ab00 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:36:26.361419 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-498dce79-8948-4737-8203-557d4e06ab00 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:36:26.428871 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-498dce79-8948-4737-8203-557d4e06ab00 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:36:26.436202 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-498dce79-8948-4737-8203-557d4e06ab00 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1212 microversion: 2.1 time: 0.086861 Nov 01 01:36:26.436772 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 887/1861] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:36:26 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1212 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:36:27.453036 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-46dd5c12-cf36-4920-98fd-d50bb7946dc9 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:36:27.453649 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-46dd5c12-cf36-4920-98fd-d50bb7946dc9 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:36:27.460093 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-46dd5c12-cf36-4920-98fd-d50bb7946dc9 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:36:27.460534 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-46dd5c12-cf36-4920-98fd-d50bb7946dc9 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:36:27.461289 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-46dd5c12-cf36-4920-98fd-d50bb7946dc9 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:36:27.461715 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-46dd5c12-cf36-4920-98fd-d50bb7946dc9 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:36:27.522027 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-46dd5c12-cf36-4920-98fd-d50bb7946dc9 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:36:27.529748 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-46dd5c12-cf36-4920-98fd-d50bb7946dc9 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1212 microversion: 2.1 time: 0.080409 Nov 01 01:36:27.530317 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 975/1862] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:36:27 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1212 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:36:28.547083 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-a0e29d4d-3802-43a8-a0e3-23705c3bfa0b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:36:28.547669 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-a0e29d4d-3802-43a8-a0e3-23705c3bfa0b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:36:28.554250 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a0e29d4d-3802-43a8-a0e3-23705c3bfa0b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:36:28.554760 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a0e29d4d-3802-43a8-a0e3-23705c3bfa0b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:36:28.555714 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a0e29d4d-3802-43a8-a0e3-23705c3bfa0b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:36:28.555931 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a0e29d4d-3802-43a8-a0e3-23705c3bfa0b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:36:28.621649 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-a0e29d4d-3802-43a8-a0e3-23705c3bfa0b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:36:28.628968 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-a0e29d4d-3802-43a8-a0e3-23705c3bfa0b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1212 microversion: 2.1 time: 0.085648 Nov 01 01:36:28.629528 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 888/1863] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:36:28 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1212 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:36:29.644909 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-27e79cba-b09f-477e-a0db-fed57d743a81 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:36:29.645435 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-27e79cba-b09f-477e-a0db-fed57d743a81 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:36:29.652163 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-27e79cba-b09f-477e-a0db-fed57d743a81 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:36:29.652603 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-27e79cba-b09f-477e-a0db-fed57d743a81 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:36:29.653362 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-27e79cba-b09f-477e-a0db-fed57d743a81 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:36:29.653785 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-27e79cba-b09f-477e-a0db-fed57d743a81 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:36:29.712134 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-27e79cba-b09f-477e-a0db-fed57d743a81 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:36:29.719578 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-27e79cba-b09f-477e-a0db-fed57d743a81 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1212 microversion: 2.1 time: 0.078387 Nov 01 01:36:29.720142 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 976/1864] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:36:29 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1212 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:36:30.736524 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-e4e5f09a-730f-46c8-b653-bbc2cfdd3716 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:36:30.737225 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-e4e5f09a-730f-46c8-b653-bbc2cfdd3716 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:36:30.744096 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e4e5f09a-730f-46c8-b653-bbc2cfdd3716 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:36:30.744536 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e4e5f09a-730f-46c8-b653-bbc2cfdd3716 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:36:30.745293 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e4e5f09a-730f-46c8-b653-bbc2cfdd3716 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:36:30.745717 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e4e5f09a-730f-46c8-b653-bbc2cfdd3716 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:36:30.803343 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-e4e5f09a-730f-46c8-b653-bbc2cfdd3716 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:36:30.811260 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-e4e5f09a-730f-46c8-b653-bbc2cfdd3716 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1212 microversion: 2.1 time: 0.078372 Nov 01 01:36:30.811821 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 889/1865] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:36:30 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1212 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:36:31.827736 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-86976e5c-7b8b-45fe-9683-ed6d8bde451d tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:36:31.828352 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-86976e5c-7b8b-45fe-9683-ed6d8bde451d tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:36:31.834710 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-86976e5c-7b8b-45fe-9683-ed6d8bde451d tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:36:31.835648 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-86976e5c-7b8b-45fe-9683-ed6d8bde451d tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:36:31.836410 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-86976e5c-7b8b-45fe-9683-ed6d8bde451d tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:36:31.836838 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-86976e5c-7b8b-45fe-9683-ed6d8bde451d tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:36:31.894520 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-86976e5c-7b8b-45fe-9683-ed6d8bde451d tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:36:31.902190 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-86976e5c-7b8b-45fe-9683-ed6d8bde451d tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1212 microversion: 2.1 time: 0.078169 Nov 01 01:36:31.902782 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 977/1866] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:36:31 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1212 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:36:32.918922 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-9b9d59da-3dcb-4a27-bcb4-d2a14574bc1d tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:36:32.919522 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-9b9d59da-3dcb-4a27-bcb4-d2a14574bc1d tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:36:32.925621 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9b9d59da-3dcb-4a27-bcb4-d2a14574bc1d tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:36:32.926054 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9b9d59da-3dcb-4a27-bcb4-d2a14574bc1d tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:36:32.926846 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9b9d59da-3dcb-4a27-bcb4-d2a14574bc1d tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:36:32.927265 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9b9d59da-3dcb-4a27-bcb4-d2a14574bc1d tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:36:32.984617 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-9b9d59da-3dcb-4a27-bcb4-d2a14574bc1d tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:36:32.992313 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-9b9d59da-3dcb-4a27-bcb4-d2a14574bc1d tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1212 microversion: 2.1 time: 0.076544 Nov 01 01:36:32.992867 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 890/1867] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:36:32 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1212 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:36:34.009155 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-830dcb80-9303-4ee2-8a82-a23ebdce6c17 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:36:34.009951 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-830dcb80-9303-4ee2-8a82-a23ebdce6c17 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:36:34.016235 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-830dcb80-9303-4ee2-8a82-a23ebdce6c17 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:36:34.016688 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-830dcb80-9303-4ee2-8a82-a23ebdce6c17 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:36:34.017451 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-830dcb80-9303-4ee2-8a82-a23ebdce6c17 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:36:34.017896 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-830dcb80-9303-4ee2-8a82-a23ebdce6c17 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:36:34.076493 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-830dcb80-9303-4ee2-8a82-a23ebdce6c17 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:36:34.083843 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-830dcb80-9303-4ee2-8a82-a23ebdce6c17 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1212 microversion: 2.1 time: 0.078841 Nov 01 01:36:34.084333 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 978/1868] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:36:34 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1212 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:36:35.100985 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-bf2f125d-3fd9-4139-8c9f-0528e50931d4 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:36:35.101602 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-bf2f125d-3fd9-4139-8c9f-0528e50931d4 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:36:35.109264 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-bf2f125d-3fd9-4139-8c9f-0528e50931d4 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:36:35.110278 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-bf2f125d-3fd9-4139-8c9f-0528e50931d4 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:36:35.111070 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-bf2f125d-3fd9-4139-8c9f-0528e50931d4 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:36:35.111496 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-bf2f125d-3fd9-4139-8c9f-0528e50931d4 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:36:35.172985 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-bf2f125d-3fd9-4139-8c9f-0528e50931d4 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:36:35.181145 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-bf2f125d-3fd9-4139-8c9f-0528e50931d4 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1212 microversion: 2.1 time: 0.083810 Nov 01 01:36:35.181692 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 891/1869] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:36:35 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1212 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:36:36.197094 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-247b6032-4828-4473-9585-eba6962ed71e tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:36:36.197704 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-247b6032-4828-4473-9585-eba6962ed71e tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:36:36.203903 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-247b6032-4828-4473-9585-eba6962ed71e tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:36:36.204347 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-247b6032-4828-4473-9585-eba6962ed71e tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:36:36.205098 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-247b6032-4828-4473-9585-eba6962ed71e tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:36:36.205525 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-247b6032-4828-4473-9585-eba6962ed71e tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:36:36.263262 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-247b6032-4828-4473-9585-eba6962ed71e tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:36:36.270267 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-247b6032-4828-4473-9585-eba6962ed71e tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1212 microversion: 2.1 time: 0.077348 Nov 01 01:36:36.270866 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 979/1870] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:36:36 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1212 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:36:37.287089 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-1b81c208-4e20-41c6-a1b0-50ef6872595a tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:36:37.287690 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-1b81c208-4e20-41c6-a1b0-50ef6872595a tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:36:37.294409 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1b81c208-4e20-41c6-a1b0-50ef6872595a tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:36:37.294875 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1b81c208-4e20-41c6-a1b0-50ef6872595a tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:36:37.295627 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1b81c208-4e20-41c6-a1b0-50ef6872595a tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:36:37.296052 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1b81c208-4e20-41c6-a1b0-50ef6872595a tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:36:37.353826 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-1b81c208-4e20-41c6-a1b0-50ef6872595a tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:36:37.361058 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-1b81c208-4e20-41c6-a1b0-50ef6872595a tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1212 microversion: 2.1 time: 0.077572 Nov 01 01:36:37.361618 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 892/1871] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:36:37 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1212 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:36:38.376840 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-d2ae2494-def2-4b29-bc24-7da786909252 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:36:38.377453 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-d2ae2494-def2-4b29-bc24-7da786909252 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:36:38.384215 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d2ae2494-def2-4b29-bc24-7da786909252 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:36:38.384663 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d2ae2494-def2-4b29-bc24-7da786909252 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:36:38.385423 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d2ae2494-def2-4b29-bc24-7da786909252 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:36:38.385850 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d2ae2494-def2-4b29-bc24-7da786909252 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:36:38.443373 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-d2ae2494-def2-4b29-bc24-7da786909252 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:36:38.451254 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-d2ae2494-def2-4b29-bc24-7da786909252 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1212 microversion: 2.1 time: 0.077989 Nov 01 01:36:38.452194 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 980/1872] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:36:38 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1212 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:36:39.472852 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-51cb0b7d-dd4f-4167-b231-8b80a7422581 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:36:39.473463 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-51cb0b7d-dd4f-4167-b231-8b80a7422581 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:36:39.479828 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-51cb0b7d-dd4f-4167-b231-8b80a7422581 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:36:39.480284 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-51cb0b7d-dd4f-4167-b231-8b80a7422581 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:36:39.481045 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-51cb0b7d-dd4f-4167-b231-8b80a7422581 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:36:39.481478 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-51cb0b7d-dd4f-4167-b231-8b80a7422581 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:36:39.539374 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-51cb0b7d-dd4f-4167-b231-8b80a7422581 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:36:39.546666 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-51cb0b7d-dd4f-4167-b231-8b80a7422581 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1212 microversion: 2.1 time: 0.077449 Nov 01 01:36:39.547253 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 893/1873] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:36:39 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1212 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:36:40.562794 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-014a2f04-8599-436e-b741-583308ec1e98 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:36:40.563433 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-014a2f04-8599-436e-b741-583308ec1e98 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:36:40.569733 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-014a2f04-8599-436e-b741-583308ec1e98 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:36:40.570171 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-014a2f04-8599-436e-b741-583308ec1e98 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:36:40.570949 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-014a2f04-8599-436e-b741-583308ec1e98 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:36:40.571376 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-014a2f04-8599-436e-b741-583308ec1e98 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:36:40.630700 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-014a2f04-8599-436e-b741-583308ec1e98 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:36:40.637855 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-014a2f04-8599-436e-b741-583308ec1e98 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1212 microversion: 2.1 time: 0.078727 Nov 01 01:36:40.638408 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 981/1874] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:36:40 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1212 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:36:41.654469 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-689bdb39-cc6b-4e02-8a48-13c76c82135d tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:36:41.654992 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-689bdb39-cc6b-4e02-8a48-13c76c82135d tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:36:41.661285 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-689bdb39-cc6b-4e02-8a48-13c76c82135d tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:36:41.661735 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-689bdb39-cc6b-4e02-8a48-13c76c82135d tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:36:41.662520 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-689bdb39-cc6b-4e02-8a48-13c76c82135d tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:36:41.662949 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-689bdb39-cc6b-4e02-8a48-13c76c82135d tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:36:41.725507 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-689bdb39-cc6b-4e02-8a48-13c76c82135d tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:36:41.732778 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-689bdb39-cc6b-4e02-8a48-13c76c82135d tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1212 microversion: 2.1 time: 0.082114 Nov 01 01:36:41.733333 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 894/1875] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:36:41 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1212 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:36:42.749564 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-4ef020ab-552b-43b6-b78c-5fbdfd1238ce tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:36:42.750177 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-4ef020ab-552b-43b6-b78c-5fbdfd1238ce tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:36:42.756421 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4ef020ab-552b-43b6-b78c-5fbdfd1238ce tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:36:42.756929 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4ef020ab-552b-43b6-b78c-5fbdfd1238ce tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:36:42.757687 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4ef020ab-552b-43b6-b78c-5fbdfd1238ce tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:36:42.758119 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4ef020ab-552b-43b6-b78c-5fbdfd1238ce tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:36:42.816229 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-4ef020ab-552b-43b6-b78c-5fbdfd1238ce tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:36:42.823375 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-4ef020ab-552b-43b6-b78c-5fbdfd1238ce tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1212 microversion: 2.1 time: 0.077519 Nov 01 01:36:42.823938 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 982/1876] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:36:42 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1212 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:36:43.840002 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-91658a1d-e822-4f2f-951b-f2224b4cb311 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:36:43.840629 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-91658a1d-e822-4f2f-951b-f2224b4cb311 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:36:43.846939 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-91658a1d-e822-4f2f-951b-f2224b4cb311 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:36:43.847384 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-91658a1d-e822-4f2f-951b-f2224b4cb311 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:36:43.848146 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-91658a1d-e822-4f2f-951b-f2224b4cb311 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:36:43.848578 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-91658a1d-e822-4f2f-951b-f2224b4cb311 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:36:43.907526 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-91658a1d-e822-4f2f-951b-f2224b4cb311 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:36:43.914862 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-91658a1d-e822-4f2f-951b-f2224b4cb311 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1212 microversion: 2.1 time: 0.078788 Nov 01 01:36:43.915420 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 895/1877] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:36:43 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1212 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:36:44.931718 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-fafa75bd-9315-4284-9e9e-6d44a8e04331 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:36:44.932347 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-fafa75bd-9315-4284-9e9e-6d44a8e04331 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:36:44.938615 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-fafa75bd-9315-4284-9e9e-6d44a8e04331 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:36:44.939056 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-fafa75bd-9315-4284-9e9e-6d44a8e04331 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:36:44.939802 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-fafa75bd-9315-4284-9e9e-6d44a8e04331 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:36:44.940223 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-fafa75bd-9315-4284-9e9e-6d44a8e04331 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:36:44.997935 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-fafa75bd-9315-4284-9e9e-6d44a8e04331 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:36:45.005074 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-fafa75bd-9315-4284-9e9e-6d44a8e04331 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1212 microversion: 2.1 time: 0.077423 Nov 01 01:36:45.005630 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 983/1878] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:36:44 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1212 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:36:46.022569 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-ba138861-6858-403f-b7ea-73e0c5dd22a1 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:36:46.023177 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-ba138861-6858-403f-b7ea-73e0c5dd22a1 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:36:46.029373 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ba138861-6858-403f-b7ea-73e0c5dd22a1 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:36:46.029825 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ba138861-6858-403f-b7ea-73e0c5dd22a1 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:36:46.030619 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ba138861-6858-403f-b7ea-73e0c5dd22a1 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:36:46.031049 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ba138861-6858-403f-b7ea-73e0c5dd22a1 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:36:46.088959 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-ba138861-6858-403f-b7ea-73e0c5dd22a1 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:36:46.096070 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-ba138861-6858-403f-b7ea-73e0c5dd22a1 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1212 microversion: 2.1 time: 0.077717 Nov 01 01:36:46.096629 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 896/1879] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:36:46 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1212 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:36:47.113377 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-6e12482e-0f4f-48a0-a94f-023cf4ccb7e2 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:36:47.113972 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-6e12482e-0f4f-48a0-a94f-023cf4ccb7e2 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:36:47.120179 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-6e12482e-0f4f-48a0-a94f-023cf4ccb7e2 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:36:47.120687 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-6e12482e-0f4f-48a0-a94f-023cf4ccb7e2 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:36:47.121523 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-6e12482e-0f4f-48a0-a94f-023cf4ccb7e2 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:36:47.121940 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-6e12482e-0f4f-48a0-a94f-023cf4ccb7e2 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:36:47.179806 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-6e12482e-0f4f-48a0-a94f-023cf4ccb7e2 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:36:47.187068 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-6e12482e-0f4f-48a0-a94f-023cf4ccb7e2 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1212 microversion: 2.1 time: 0.077655 Nov 01 01:36:47.187609 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 984/1880] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:36:47 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1212 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:36:48.204223 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-00d96701-346e-41c2-b471-572913da09c4 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:36:48.204834 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-00d96701-346e-41c2-b471-572913da09c4 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:36:48.211095 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-00d96701-346e-41c2-b471-572913da09c4 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:36:48.211542 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-00d96701-346e-41c2-b471-572913da09c4 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:36:48.212304 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-00d96701-346e-41c2-b471-572913da09c4 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:36:48.212736 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-00d96701-346e-41c2-b471-572913da09c4 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:36:48.276762 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-00d96701-346e-41c2-b471-572913da09c4 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:36:48.284025 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-00d96701-346e-41c2-b471-572913da09c4 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1212 microversion: 2.1 time: 0.083512 Nov 01 01:36:48.284578 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 897/1881] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:36:48 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1212 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:36:49.300830 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-b67dfbc4-0eb5-4499-ab29-2b735df45886 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:36:49.301488 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-b67dfbc4-0eb5-4499-ab29-2b735df45886 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:36:49.307808 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b67dfbc4-0eb5-4499-ab29-2b735df45886 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:36:49.308303 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b67dfbc4-0eb5-4499-ab29-2b735df45886 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:36:49.309057 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b67dfbc4-0eb5-4499-ab29-2b735df45886 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:36:49.309476 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b67dfbc4-0eb5-4499-ab29-2b735df45886 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:36:49.370000 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-b67dfbc4-0eb5-4499-ab29-2b735df45886 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:36:49.377338 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-b67dfbc4-0eb5-4499-ab29-2b735df45886 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1212 microversion: 2.1 time: 0.080230 Nov 01 01:36:49.377892 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 985/1882] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:36:49 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1212 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:36:50.394142 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-d1e1b653-24a5-4abe-ac2b-79be0255762b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:36:50.394780 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-d1e1b653-24a5-4abe-ac2b-79be0255762b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:36:50.400956 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d1e1b653-24a5-4abe-ac2b-79be0255762b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:36:50.401402 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d1e1b653-24a5-4abe-ac2b-79be0255762b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:36:50.402152 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d1e1b653-24a5-4abe-ac2b-79be0255762b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:36:50.402617 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d1e1b653-24a5-4abe-ac2b-79be0255762b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:36:50.459845 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-d1e1b653-24a5-4abe-ac2b-79be0255762b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:36:50.467751 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-d1e1b653-24a5-4abe-ac2b-79be0255762b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1212 microversion: 2.1 time: 0.077257 Nov 01 01:36:50.468301 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 898/1883] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:36:50 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1212 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:36:51.484698 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-39e16f4b-2e17-4c5f-adf5-4a036bee1ed4 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:36:51.485298 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-39e16f4b-2e17-4c5f-adf5-4a036bee1ed4 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:36:51.491504 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-39e16f4b-2e17-4c5f-adf5-4a036bee1ed4 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:36:51.491942 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-39e16f4b-2e17-4c5f-adf5-4a036bee1ed4 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:36:51.492688 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-39e16f4b-2e17-4c5f-adf5-4a036bee1ed4 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:36:51.493108 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-39e16f4b-2e17-4c5f-adf5-4a036bee1ed4 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:36:51.550634 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-39e16f4b-2e17-4c5f-adf5-4a036bee1ed4 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:36:51.557670 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-39e16f4b-2e17-4c5f-adf5-4a036bee1ed4 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1212 microversion: 2.1 time: 0.076651 Nov 01 01:36:51.558219 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 986/1884] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:36:51 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1212 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:36:52.573742 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-650672c8-7809-445a-b417-c1e907216e84 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:36:52.574360 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-650672c8-7809-445a-b417-c1e907216e84 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:36:52.580538 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-650672c8-7809-445a-b417-c1e907216e84 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:36:52.580979 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-650672c8-7809-445a-b417-c1e907216e84 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:36:52.581726 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-650672c8-7809-445a-b417-c1e907216e84 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:36:52.582156 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-650672c8-7809-445a-b417-c1e907216e84 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:36:52.640084 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-650672c8-7809-445a-b417-c1e907216e84 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:36:52.647186 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-650672c8-7809-445a-b417-c1e907216e84 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1212 microversion: 2.1 time: 0.077117 Nov 01 01:36:52.647738 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 899/1885] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:36:52 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1212 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:36:53.663626 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-4ec509da-b13c-4d82-9b84-f8da4cf8b451 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:36:53.664191 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-4ec509da-b13c-4d82-9b84-f8da4cf8b451 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:36:53.670386 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4ec509da-b13c-4d82-9b84-f8da4cf8b451 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:36:53.670855 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4ec509da-b13c-4d82-9b84-f8da4cf8b451 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:36:53.671608 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4ec509da-b13c-4d82-9b84-f8da4cf8b451 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:36:53.672033 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4ec509da-b13c-4d82-9b84-f8da4cf8b451 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:36:53.732122 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-4ec509da-b13c-4d82-9b84-f8da4cf8b451 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:36:53.739437 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-4ec509da-b13c-4d82-9b84-f8da4cf8b451 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1212 microversion: 2.1 time: 0.079530 Nov 01 01:36:53.739994 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 987/1886] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:36:53 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1212 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:36:54.756252 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-a1433783-34a5-4d72-a408-50da9589bc64 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:36:54.756852 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-a1433783-34a5-4d72-a408-50da9589bc64 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:36:54.763554 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a1433783-34a5-4d72-a408-50da9589bc64 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:36:54.763989 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a1433783-34a5-4d72-a408-50da9589bc64 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:36:54.764740 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a1433783-34a5-4d72-a408-50da9589bc64 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:36:54.765163 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a1433783-34a5-4d72-a408-50da9589bc64 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:36:54.826134 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-a1433783-34a5-4d72-a408-50da9589bc64 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:36:54.833289 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-a1433783-34a5-4d72-a408-50da9589bc64 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1212 microversion: 2.1 time: 0.080677 Nov 01 01:36:54.833896 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 900/1887] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:36:54 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1212 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:36:55.850541 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-3ab638fc-0809-429c-993e-00249a74c288 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:36:55.851140 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-3ab638fc-0809-429c-993e-00249a74c288 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:36:55.857977 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3ab638fc-0809-429c-993e-00249a74c288 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:36:55.858412 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3ab638fc-0809-429c-993e-00249a74c288 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:36:55.859182 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3ab638fc-0809-429c-993e-00249a74c288 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:36:55.859601 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3ab638fc-0809-429c-993e-00249a74c288 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:36:55.917572 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-3ab638fc-0809-429c-993e-00249a74c288 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:36:55.926667 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-3ab638fc-0809-429c-993e-00249a74c288 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1212 microversion: 2.1 time: 0.079768 Nov 01 01:36:55.927231 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 988/1888] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:36:55 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1212 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:36:56.943070 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-6031b710-4662-4746-b1df-de9a107bfef7 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:36:56.943681 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-6031b710-4662-4746-b1df-de9a107bfef7 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:36:56.949948 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6031b710-4662-4746-b1df-de9a107bfef7 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:36:56.950407 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6031b710-4662-4746-b1df-de9a107bfef7 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:36:56.951188 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6031b710-4662-4746-b1df-de9a107bfef7 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:36:56.951188 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6031b710-4662-4746-b1df-de9a107bfef7 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:36:57.013155 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-6031b710-4662-4746-b1df-de9a107bfef7 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:36:57.020376 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-6031b710-4662-4746-b1df-de9a107bfef7 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1212 microversion: 2.1 time: 0.081035 Nov 01 01:36:57.020931 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 901/1889] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:36:56 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1212 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:36:58.036511 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-72448c1b-d498-4de9-beba-a1737422dc9b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:36:58.037123 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-72448c1b-d498-4de9-beba-a1737422dc9b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:36:58.044081 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-72448c1b-d498-4de9-beba-a1737422dc9b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:36:58.044512 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-72448c1b-d498-4de9-beba-a1737422dc9b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:36:58.045266 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-72448c1b-d498-4de9-beba-a1737422dc9b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:36:58.045693 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-72448c1b-d498-4de9-beba-a1737422dc9b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:36:58.104108 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-72448c1b-d498-4de9-beba-a1737422dc9b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:36:58.111278 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-72448c1b-d498-4de9-beba-a1737422dc9b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1212 microversion: 2.1 time: 0.078455 Nov 01 01:36:58.111838 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 989/1890] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:36:58 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1212 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:36:59.127663 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-7b1deaba-c00c-483e-bbbd-9ebf3c6a88dd tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:36:59.128272 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-7b1deaba-c00c-483e-bbbd-9ebf3c6a88dd tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:36:59.135140 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7b1deaba-c00c-483e-bbbd-9ebf3c6a88dd tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:36:59.135580 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7b1deaba-c00c-483e-bbbd-9ebf3c6a88dd tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:36:59.136346 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7b1deaba-c00c-483e-bbbd-9ebf3c6a88dd tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:36:59.136825 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7b1deaba-c00c-483e-bbbd-9ebf3c6a88dd tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:36:59.194092 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-7b1deaba-c00c-483e-bbbd-9ebf3c6a88dd tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:36:59.201721 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-7b1deaba-c00c-483e-bbbd-9ebf3c6a88dd tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1212 microversion: 2.1 time: 0.077786 Nov 01 01:36:59.202291 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 902/1891] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:36:59 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1212 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:37:00.218909 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-312a65c4-dd14-40fa-b642-f44cc709fdba tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:37:00.219512 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-312a65c4-dd14-40fa-b642-f44cc709fdba tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:37:00.225789 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-312a65c4-dd14-40fa-b642-f44cc709fdba tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:37:00.226229 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-312a65c4-dd14-40fa-b642-f44cc709fdba tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:37:00.227014 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-312a65c4-dd14-40fa-b642-f44cc709fdba tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:37:00.227440 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-312a65c4-dd14-40fa-b642-f44cc709fdba tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:37:00.284944 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-312a65c4-dd14-40fa-b642-f44cc709fdba tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:37:00.292642 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-312a65c4-dd14-40fa-b642-f44cc709fdba tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1212 microversion: 2.1 time: 0.077440 Nov 01 01:37:00.293194 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 990/1892] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:37:00 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1212 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:37:01.309014 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-8e8ceeff-45ef-4883-8562-e670bffc4e81 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:37:01.309615 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-8e8ceeff-45ef-4883-8562-e670bffc4e81 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:37:01.315895 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8e8ceeff-45ef-4883-8562-e670bffc4e81 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:37:01.316335 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8e8ceeff-45ef-4883-8562-e670bffc4e81 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:37:01.317093 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8e8ceeff-45ef-4883-8562-e670bffc4e81 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:37:01.317521 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8e8ceeff-45ef-4883-8562-e670bffc4e81 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:37:01.379979 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-8e8ceeff-45ef-4883-8562-e670bffc4e81 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:37:01.387855 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-8e8ceeff-45ef-4883-8562-e670bffc4e81 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1212 microversion: 2.1 time: 0.082565 Nov 01 01:37:01.388419 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 903/1893] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:37:01 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1212 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:37:02.404790 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-da1f14c1-382a-4a48-8ee0-f631a79f3b98 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:37:02.405407 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-da1f14c1-382a-4a48-8ee0-f631a79f3b98 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:37:02.411723 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-da1f14c1-382a-4a48-8ee0-f631a79f3b98 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:37:02.412170 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-da1f14c1-382a-4a48-8ee0-f631a79f3b98 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:37:02.412933 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-da1f14c1-382a-4a48-8ee0-f631a79f3b98 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:37:02.413361 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-da1f14c1-382a-4a48-8ee0-f631a79f3b98 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:37:02.471337 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-da1f14c1-382a-4a48-8ee0-f631a79f3b98 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:37:02.478615 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-da1f14c1-382a-4a48-8ee0-f631a79f3b98 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1212 microversion: 2.1 time: 0.078108 Nov 01 01:37:02.479179 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 991/1894] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:37:02 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1212 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:37:03.495466 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-7510139c-db4f-4ef1-a442-fec752ffa779 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:37:03.496063 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-7510139c-db4f-4ef1-a442-fec752ffa779 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:37:03.502191 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7510139c-db4f-4ef1-a442-fec752ffa779 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:37:03.502660 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7510139c-db4f-4ef1-a442-fec752ffa779 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:37:03.503409 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7510139c-db4f-4ef1-a442-fec752ffa779 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:37:03.503836 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7510139c-db4f-4ef1-a442-fec752ffa779 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:37:03.561231 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-7510139c-db4f-4ef1-a442-fec752ffa779 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:37:03.568261 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-7510139c-db4f-4ef1-a442-fec752ffa779 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1212 microversion: 2.1 time: 0.076957 Nov 01 01:37:03.568808 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 904/1895] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:37:03 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1212 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:37:04.585492 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-bfd14c87-49f3-44fc-a869-57a62b54945b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:37:04.586098 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-bfd14c87-49f3-44fc-a869-57a62b54945b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:37:04.593267 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-bfd14c87-49f3-44fc-a869-57a62b54945b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:37:04.593708 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-bfd14c87-49f3-44fc-a869-57a62b54945b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:37:04.594486 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-bfd14c87-49f3-44fc-a869-57a62b54945b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:37:04.594920 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-bfd14c87-49f3-44fc-a869-57a62b54945b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:37:04.653107 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-bfd14c87-49f3-44fc-a869-57a62b54945b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:37:04.660276 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-bfd14c87-49f3-44fc-a869-57a62b54945b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1212 microversion: 2.1 time: 0.078507 Nov 01 01:37:04.660835 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 992/1896] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:37:04 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1212 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:37:05.677008 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-11bfc3f9-d947-499d-89bd-5b9fc5e49fb3 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:37:05.677619 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-11bfc3f9-d947-499d-89bd-5b9fc5e49fb3 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:37:05.683952 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-11bfc3f9-d947-499d-89bd-5b9fc5e49fb3 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:37:05.684400 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-11bfc3f9-d947-499d-89bd-5b9fc5e49fb3 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:37:05.685164 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-11bfc3f9-d947-499d-89bd-5b9fc5e49fb3 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:37:05.685610 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-11bfc3f9-d947-499d-89bd-5b9fc5e49fb3 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:37:05.744115 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-11bfc3f9-d947-499d-89bd-5b9fc5e49fb3 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:37:05.751461 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-11bfc3f9-d947-499d-89bd-5b9fc5e49fb3 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1212 microversion: 2.1 time: 0.078179 Nov 01 01:37:05.752032 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 905/1897] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:37:05 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1212 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:37:06.767256 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-2bffb2b3-688d-4d6c-8f53-3bcf68086993 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:37:06.767859 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-2bffb2b3-688d-4d6c-8f53-3bcf68086993 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:37:06.774004 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-2bffb2b3-688d-4d6c-8f53-3bcf68086993 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:37:06.774451 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-2bffb2b3-688d-4d6c-8f53-3bcf68086993 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:37:06.775834 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-2bffb2b3-688d-4d6c-8f53-3bcf68086993 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:37:06.776257 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-2bffb2b3-688d-4d6c-8f53-3bcf68086993 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:37:06.832873 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-2bffb2b3-688d-4d6c-8f53-3bcf68086993 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:37:06.840759 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-2bffb2b3-688d-4d6c-8f53-3bcf68086993 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1212 microversion: 2.1 time: 0.077125 Nov 01 01:37:06.841315 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 993/1898] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:37:06 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1212 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:37:07.856789 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-5c731b8e-e730-499e-bd77-da547e39337d tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:37:07.857391 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-5c731b8e-e730-499e-bd77-da547e39337d tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:37:07.863583 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5c731b8e-e730-499e-bd77-da547e39337d tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:37:07.864030 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5c731b8e-e730-499e-bd77-da547e39337d tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:37:07.864781 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5c731b8e-e730-499e-bd77-da547e39337d tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:37:07.865222 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5c731b8e-e730-499e-bd77-da547e39337d tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:37:07.925756 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-5c731b8e-e730-499e-bd77-da547e39337d tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:37:07.932927 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-5c731b8e-e730-499e-bd77-da547e39337d tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1212 microversion: 2.1 time: 0.080400 Nov 01 01:37:07.933480 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 906/1899] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:37:07 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1212 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:37:08.948890 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-13162df6-638e-4af0-9fc3-bfce5280c46e tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:37:08.949479 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-13162df6-638e-4af0-9fc3-bfce5280c46e tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:37:08.955716 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-13162df6-638e-4af0-9fc3-bfce5280c46e tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:37:08.956160 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-13162df6-638e-4af0-9fc3-bfce5280c46e tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:37:08.956915 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-13162df6-638e-4af0-9fc3-bfce5280c46e tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:37:08.957343 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-13162df6-638e-4af0-9fc3-bfce5280c46e tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:37:09.020706 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-13162df6-638e-4af0-9fc3-bfce5280c46e tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:37:09.027868 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-13162df6-638e-4af0-9fc3-bfce5280c46e tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1212 microversion: 2.1 time: 0.082671 Nov 01 01:37:09.028440 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 994/1900] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:37:08 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1212 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:37:10.044199 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-f1355c38-2896-4882-b564-54a099fcd614 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:37:10.044789 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-f1355c38-2896-4882-b564-54a099fcd614 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:37:10.051035 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f1355c38-2896-4882-b564-54a099fcd614 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:37:10.051475 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f1355c38-2896-4882-b564-54a099fcd614 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:37:10.052226 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f1355c38-2896-4882-b564-54a099fcd614 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:37:10.052650 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f1355c38-2896-4882-b564-54a099fcd614 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:37:10.112347 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-f1355c38-2896-4882-b564-54a099fcd614 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:37:10.120005 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-f1355c38-2896-4882-b564-54a099fcd614 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1212 microversion: 2.1 time: 0.079433 Nov 01 01:37:10.120560 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 907/1901] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:37:10 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1212 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:37:11.136795 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-b4f7f09d-7a2b-4dea-a568-c685c14d9317 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:37:11.137388 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-b4f7f09d-7a2b-4dea-a568-c685c14d9317 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:37:11.143590 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b4f7f09d-7a2b-4dea-a568-c685c14d9317 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:37:11.144032 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b4f7f09d-7a2b-4dea-a568-c685c14d9317 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:37:11.144782 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b4f7f09d-7a2b-4dea-a568-c685c14d9317 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:37:11.145209 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b4f7f09d-7a2b-4dea-a568-c685c14d9317 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:37:11.203082 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-b4f7f09d-7a2b-4dea-a568-c685c14d9317 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:37:11.210237 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-b4f7f09d-7a2b-4dea-a568-c685c14d9317 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1212 microversion: 2.1 time: 0.077641 Nov 01 01:37:11.210831 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 995/1902] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:37:11 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1212 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:37:12.228187 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-31da8b9a-75a8-45ee-99de-1df572daf60c tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:37:12.228814 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-31da8b9a-75a8-45ee-99de-1df572daf60c tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:37:12.235891 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-31da8b9a-75a8-45ee-99de-1df572daf60c tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:37:12.236366 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-31da8b9a-75a8-45ee-99de-1df572daf60c tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:37:12.237125 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-31da8b9a-75a8-45ee-99de-1df572daf60c tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:37:12.237575 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-31da8b9a-75a8-45ee-99de-1df572daf60c tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:37:12.295308 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-31da8b9a-75a8-45ee-99de-1df572daf60c tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:37:12.302568 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-31da8b9a-75a8-45ee-99de-1df572daf60c tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1212 microversion: 2.1 time: 0.078692 Nov 01 01:37:12.303125 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 908/1903] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:37:12 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1212 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:37:13.536375 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-16a1acbd-e056-44ab-bbad-6ec4995a4dd2 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:37:13.537043 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-16a1acbd-e056-44ab-bbad-6ec4995a4dd2 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:37:13.542759 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-16a1acbd-e056-44ab-bbad-6ec4995a4dd2 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:37:13.543201 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-16a1acbd-e056-44ab-bbad-6ec4995a4dd2 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:37:13.543954 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-16a1acbd-e056-44ab-bbad-6ec4995a4dd2 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:37:13.544378 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-16a1acbd-e056-44ab-bbad-6ec4995a4dd2 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:37:13.601929 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-16a1acbd-e056-44ab-bbad-6ec4995a4dd2 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:37:13.609138 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-16a1acbd-e056-44ab-bbad-6ec4995a4dd2 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1212 microversion: 2.1 time: 0.293946 Nov 01 01:37:13.609704 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 996/1904] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:37:13 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1212 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:37:14.266755 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 01 01:37:14.267010 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: Mon Nov 1 01:37:14 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 01 01:37:14.625921 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-842e74c2-78ae-4adb-ac01-78fa7a8faa69 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:37:14.626547 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-842e74c2-78ae-4adb-ac01-78fa7a8faa69 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:37:14.632386 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-842e74c2-78ae-4adb-ac01-78fa7a8faa69 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:37:14.632820 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-842e74c2-78ae-4adb-ac01-78fa7a8faa69 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:37:14.633569 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-842e74c2-78ae-4adb-ac01-78fa7a8faa69 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:37:14.633992 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-842e74c2-78ae-4adb-ac01-78fa7a8faa69 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:37:14.791771 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-842e74c2-78ae-4adb-ac01-78fa7a8faa69 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:37:14.798983 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-842e74c2-78ae-4adb-ac01-78fa7a8faa69 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1212 microversion: 2.1 time: 0.176787 Nov 01 01:37:14.799537 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 909/1905] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:37:14 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1212 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:37:15.815296 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-072580fa-309a-41e3-a91e-0b6ef066a15f tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:37:15.815902 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-072580fa-309a-41e3-a91e-0b6ef066a15f tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:37:15.822159 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-072580fa-309a-41e3-a91e-0b6ef066a15f tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:37:15.822634 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-072580fa-309a-41e3-a91e-0b6ef066a15f tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:37:15.823391 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-072580fa-309a-41e3-a91e-0b6ef066a15f tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:37:15.823815 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-072580fa-309a-41e3-a91e-0b6ef066a15f tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:37:15.881426 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-072580fa-309a-41e3-a91e-0b6ef066a15f tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:37:15.888627 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-072580fa-309a-41e3-a91e-0b6ef066a15f tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1212 microversion: 2.1 time: 0.076993 Nov 01 01:37:15.889174 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 997/1906] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:37:15 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1212 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:37:16.904840 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-a1bbad0a-ef42-4bc1-90f7-073b29a12bbb tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:37:16.905426 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-a1bbad0a-ef42-4bc1-90f7-073b29a12bbb tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:37:16.911953 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a1bbad0a-ef42-4bc1-90f7-073b29a12bbb tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:37:16.912398 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a1bbad0a-ef42-4bc1-90f7-073b29a12bbb tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:37:16.913150 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a1bbad0a-ef42-4bc1-90f7-073b29a12bbb tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:37:16.913572 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a1bbad0a-ef42-4bc1-90f7-073b29a12bbb tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:37:16.974511 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-a1bbad0a-ef42-4bc1-90f7-073b29a12bbb tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:37:16.981809 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-a1bbad0a-ef42-4bc1-90f7-073b29a12bbb tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1212 microversion: 2.1 time: 0.080648 Nov 01 01:37:16.982357 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 910/1907] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:37:16 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1212 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:37:17.998229 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-6060ed29-c547-4415-aeb8-7899d42bc2b8 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:37:17.998864 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-6060ed29-c547-4415-aeb8-7899d42bc2b8 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:37:18.004744 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-6060ed29-c547-4415-aeb8-7899d42bc2b8 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:37:18.005188 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-6060ed29-c547-4415-aeb8-7899d42bc2b8 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:37:18.005944 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-6060ed29-c547-4415-aeb8-7899d42bc2b8 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:37:18.006369 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-6060ed29-c547-4415-aeb8-7899d42bc2b8 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:37:18.063901 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-6060ed29-c547-4415-aeb8-7899d42bc2b8 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:37:18.071090 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-6060ed29-c547-4415-aeb8-7899d42bc2b8 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1212 microversion: 2.1 time: 0.076668 Nov 01 01:37:18.071650 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 998/1908] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:37:17 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1212 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:37:19.088188 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-cfec83e3-8d3d-4206-859f-4fd738423ff1 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:37:19.088820 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-cfec83e3-8d3d-4206-859f-4fd738423ff1 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:37:19.095512 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-cfec83e3-8d3d-4206-859f-4fd738423ff1 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:37:19.095954 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-cfec83e3-8d3d-4206-859f-4fd738423ff1 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:37:19.096707 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-cfec83e3-8d3d-4206-859f-4fd738423ff1 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:37:19.097133 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-cfec83e3-8d3d-4206-859f-4fd738423ff1 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:37:19.154569 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-cfec83e3-8d3d-4206-859f-4fd738423ff1 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:37:19.161661 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-cfec83e3-8d3d-4206-859f-4fd738423ff1 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1212 microversion: 2.1 time: 0.077404 Nov 01 01:37:19.162213 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 911/1909] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:37:19 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1212 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:37:20.041205 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 01 01:37:20.041532 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: Mon Nov 1 01:37:20 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 01 01:37:20.180093 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-fbfa691d-7366-4a01-937f-47737d1671ed tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:37:20.180697 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-fbfa691d-7366-4a01-937f-47737d1671ed tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:37:20.187727 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-fbfa691d-7366-4a01-937f-47737d1671ed tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:37:20.188176 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-fbfa691d-7366-4a01-937f-47737d1671ed tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:37:20.188989 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-fbfa691d-7366-4a01-937f-47737d1671ed tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:37:20.189418 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-fbfa691d-7366-4a01-937f-47737d1671ed tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:37:20.247907 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-fbfa691d-7366-4a01-937f-47737d1671ed tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:37:20.255105 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-fbfa691d-7366-4a01-937f-47737d1671ed tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1212 microversion: 2.1 time: 0.078703 Nov 01 01:37:20.255666 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 999/1910] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:37:20 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1212 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:37:21.273190 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-403f91fc-5217-40bf-b005-a07b4b785e90 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:37:21.274317 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-403f91fc-5217-40bf-b005-a07b4b785e90 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:37:21.281011 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-403f91fc-5217-40bf-b005-a07b4b785e90 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:37:21.281376 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-403f91fc-5217-40bf-b005-a07b4b785e90 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:37:21.282140 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-403f91fc-5217-40bf-b005-a07b4b785e90 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:37:21.282612 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-403f91fc-5217-40bf-b005-a07b4b785e90 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:37:21.343653 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-403f91fc-5217-40bf-b005-a07b4b785e90 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:37:21.351008 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-403f91fc-5217-40bf-b005-a07b4b785e90 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1212 microversion: 2.1 time: 0.083311 Nov 01 01:37:21.351562 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 912/1911] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:37:21 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1212 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:37:22.367571 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-9f2cf556-ce9c-44dc-821c-f11ee097760c tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:37:22.368172 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-9f2cf556-ce9c-44dc-821c-f11ee097760c tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:37:22.374490 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9f2cf556-ce9c-44dc-821c-f11ee097760c tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:37:22.374935 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9f2cf556-ce9c-44dc-821c-f11ee097760c tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:37:22.375678 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9f2cf556-ce9c-44dc-821c-f11ee097760c tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:37:22.376098 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9f2cf556-ce9c-44dc-821c-f11ee097760c tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:37:22.433834 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-9f2cf556-ce9c-44dc-821c-f11ee097760c tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:37:22.440966 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-9f2cf556-ce9c-44dc-821c-f11ee097760c tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1212 microversion: 2.1 time: 0.077123 Nov 01 01:37:22.441517 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1000/1912] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:37:22 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1212 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:37:23.456927 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-a0e32f2c-77c2-4988-81e6-9b8748a208d5 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:37:23.458189 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-a0e32f2c-77c2-4988-81e6-9b8748a208d5 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:37:23.464780 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a0e32f2c-77c2-4988-81e6-9b8748a208d5 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:37:23.465808 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a0e32f2c-77c2-4988-81e6-9b8748a208d5 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:37:23.466522 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a0e32f2c-77c2-4988-81e6-9b8748a208d5 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:37:23.466953 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a0e32f2c-77c2-4988-81e6-9b8748a208d5 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:37:23.525384 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-a0e32f2c-77c2-4988-81e6-9b8748a208d5 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:37:23.533535 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-a0e32f2c-77c2-4988-81e6-9b8748a208d5 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1212 microversion: 2.1 time: 0.080194 Nov 01 01:37:23.534736 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 913/1913] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:37:23 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1212 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:37:24.550140 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-066dd0a3-4ed0-4e82-9ff6-ac922c4f04f8 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:37:24.550771 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-066dd0a3-4ed0-4e82-9ff6-ac922c4f04f8 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:37:24.556915 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-066dd0a3-4ed0-4e82-9ff6-ac922c4f04f8 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:37:24.557349 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-066dd0a3-4ed0-4e82-9ff6-ac922c4f04f8 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:37:24.558096 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-066dd0a3-4ed0-4e82-9ff6-ac922c4f04f8 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:37:24.558546 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-066dd0a3-4ed0-4e82-9ff6-ac922c4f04f8 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:37:24.617744 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-066dd0a3-4ed0-4e82-9ff6-ac922c4f04f8 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:37:24.625517 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-066dd0a3-4ed0-4e82-9ff6-ac922c4f04f8 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1212 microversion: 2.1 time: 0.079067 Nov 01 01:37:24.626351 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1001/1914] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:37:24 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1212 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:37:25.647166 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-94377f2c-bcb3-4cd7-964f-3e92e02b3c2a tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:37:25.647686 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-94377f2c-bcb3-4cd7-964f-3e92e02b3c2a tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:37:25.653815 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-94377f2c-bcb3-4cd7-964f-3e92e02b3c2a tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:37:25.654254 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-94377f2c-bcb3-4cd7-964f-3e92e02b3c2a tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:37:25.655034 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-94377f2c-bcb3-4cd7-964f-3e92e02b3c2a tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:37:25.655458 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-94377f2c-bcb3-4cd7-964f-3e92e02b3c2a tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:37:25.715280 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-94377f2c-bcb3-4cd7-964f-3e92e02b3c2a tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:37:25.722328 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-94377f2c-bcb3-4cd7-964f-3e92e02b3c2a tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1212 microversion: 2.1 time: 0.078892 Nov 01 01:37:25.722916 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 914/1915] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:37:25 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1212 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:37:26.738504 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-919e2924-e175-419e-ba72-5121929aee0d tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:37:26.739111 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-919e2924-e175-419e-ba72-5121929aee0d tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:37:26.745549 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-919e2924-e175-419e-ba72-5121929aee0d tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:37:26.745992 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-919e2924-e175-419e-ba72-5121929aee0d tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:37:26.746795 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-919e2924-e175-419e-ba72-5121929aee0d tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:37:26.747252 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-919e2924-e175-419e-ba72-5121929aee0d tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:37:26.805819 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-919e2924-e175-419e-ba72-5121929aee0d tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:37:26.812988 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-919e2924-e175-419e-ba72-5121929aee0d tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1212 microversion: 2.1 time: 0.078174 Nov 01 01:37:26.813541 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1002/1916] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:37:26 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1212 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:37:27.829332 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-90d5b3ca-3d52-4198-9178-e29bb5966eed tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:37:27.829932 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-90d5b3ca-3d52-4198-9178-e29bb5966eed tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:37:27.836150 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-90d5b3ca-3d52-4198-9178-e29bb5966eed tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:37:27.836883 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-90d5b3ca-3d52-4198-9178-e29bb5966eed tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:37:27.837630 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-90d5b3ca-3d52-4198-9178-e29bb5966eed tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:37:27.838053 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-90d5b3ca-3d52-4198-9178-e29bb5966eed tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:37:27.898588 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-90d5b3ca-3d52-4198-9178-e29bb5966eed tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:37:27.906256 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-90d5b3ca-3d52-4198-9178-e29bb5966eed tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1212 microversion: 2.1 time: 0.080673 Nov 01 01:37:27.906846 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 915/1917] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:37:27 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1212 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:37:28.922311 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-72454e12-12bf-4b7d-8bd1-009d94bd57ca tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:37:28.923072 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-72454e12-12bf-4b7d-8bd1-009d94bd57ca tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:37:28.929293 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-72454e12-12bf-4b7d-8bd1-009d94bd57ca tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:37:28.929736 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-72454e12-12bf-4b7d-8bd1-009d94bd57ca tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:37:28.930511 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-72454e12-12bf-4b7d-8bd1-009d94bd57ca tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:37:28.930940 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-72454e12-12bf-4b7d-8bd1-009d94bd57ca tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:37:28.989436 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-72454e12-12bf-4b7d-8bd1-009d94bd57ca tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:37:28.997492 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-72454e12-12bf-4b7d-8bd1-009d94bd57ca tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1212 microversion: 2.1 time: 0.078019 Nov 01 01:37:28.998495 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1003/1918] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:37:28 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1212 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:37:30.016298 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-86e34120-364d-4f69-bafc-de834f193f11 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:37:30.016940 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-86e34120-364d-4f69-bafc-de834f193f11 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:37:30.023101 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-86e34120-364d-4f69-bafc-de834f193f11 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:37:30.023544 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-86e34120-364d-4f69-bafc-de834f193f11 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:37:30.024430 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-86e34120-364d-4f69-bafc-de834f193f11 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:37:30.024859 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-86e34120-364d-4f69-bafc-de834f193f11 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:37:30.085963 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-86e34120-364d-4f69-bafc-de834f193f11 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:37:30.094063 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-86e34120-364d-4f69-bafc-de834f193f11 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1212 microversion: 2.1 time: 0.081617 Nov 01 01:37:30.094661 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 916/1919] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:37:30 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1212 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:37:31.110564 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-cd9efbf7-5bd6-4acf-a051-9a37266d83da tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:37:31.111152 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-cd9efbf7-5bd6-4acf-a051-9a37266d83da tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:37:31.117314 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-cd9efbf7-5bd6-4acf-a051-9a37266d83da tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:37:31.117760 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-cd9efbf7-5bd6-4acf-a051-9a37266d83da tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:37:31.118541 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-cd9efbf7-5bd6-4acf-a051-9a37266d83da tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:37:31.119004 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-cd9efbf7-5bd6-4acf-a051-9a37266d83da tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:37:31.177265 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-cd9efbf7-5bd6-4acf-a051-9a37266d83da tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:37:31.185273 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-cd9efbf7-5bd6-4acf-a051-9a37266d83da tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1212 microversion: 2.1 time: 0.078341 Nov 01 01:37:31.185839 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1004/1920] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:37:31 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1212 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:37:32.201327 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-aa69b8a6-5b66-4b48-8c03-38099383926e tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:37:32.201928 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-aa69b8a6-5b66-4b48-8c03-38099383926e tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:37:32.208182 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-aa69b8a6-5b66-4b48-8c03-38099383926e tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:37:32.208620 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-aa69b8a6-5b66-4b48-8c03-38099383926e tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:37:32.209368 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-aa69b8a6-5b66-4b48-8c03-38099383926e tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:37:32.209790 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-aa69b8a6-5b66-4b48-8c03-38099383926e tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:37:32.269022 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-aa69b8a6-5b66-4b48-8c03-38099383926e tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:37:32.276297 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-aa69b8a6-5b66-4b48-8c03-38099383926e tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1212 microversion: 2.1 time: 0.078861 Nov 01 01:37:32.276841 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 917/1921] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:37:32 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1212 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:37:33.292823 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-4a7a1d27-6042-4bc4-939c-de47ef296a84 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:37:33.293437 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-4a7a1d27-6042-4bc4-939c-de47ef296a84 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:37:33.300186 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4a7a1d27-6042-4bc4-939c-de47ef296a84 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:37:33.300636 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4a7a1d27-6042-4bc4-939c-de47ef296a84 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:37:33.301394 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4a7a1d27-6042-4bc4-939c-de47ef296a84 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:37:33.301826 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4a7a1d27-6042-4bc4-939c-de47ef296a84 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:37:33.360363 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-4a7a1d27-6042-4bc4-939c-de47ef296a84 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:37:33.368030 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-4a7a1d27-6042-4bc4-939c-de47ef296a84 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1212 microversion: 2.1 time: 0.078811 Nov 01 01:37:33.368845 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1005/1922] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:37:33 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1212 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:37:34.385160 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-8cddd8c1-9adb-4bb7-b522-98f4406175f8 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:37:34.385764 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-8cddd8c1-9adb-4bb7-b522-98f4406175f8 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:37:34.392666 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8cddd8c1-9adb-4bb7-b522-98f4406175f8 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:37:34.393103 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8cddd8c1-9adb-4bb7-b522-98f4406175f8 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:37:34.393858 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8cddd8c1-9adb-4bb7-b522-98f4406175f8 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:37:34.394284 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8cddd8c1-9adb-4bb7-b522-98f4406175f8 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:37:34.455317 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-8cddd8c1-9adb-4bb7-b522-98f4406175f8 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:37:34.462680 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-8cddd8c1-9adb-4bb7-b522-98f4406175f8 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1212 microversion: 2.1 time: 0.081173 Nov 01 01:37:34.463235 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 918/1923] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:37:34 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1212 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:37:35.479105 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-71700302-d7a3-42b3-bee4-5e226d204bbc tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:37:35.479719 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-71700302-d7a3-42b3-bee4-5e226d204bbc tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:37:35.486192 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-71700302-d7a3-42b3-bee4-5e226d204bbc tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:37:35.486654 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-71700302-d7a3-42b3-bee4-5e226d204bbc tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:37:35.487406 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-71700302-d7a3-42b3-bee4-5e226d204bbc tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:37:35.487827 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-71700302-d7a3-42b3-bee4-5e226d204bbc tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:37:35.545588 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-71700302-d7a3-42b3-bee4-5e226d204bbc tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:37:35.552650 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-71700302-d7a3-42b3-bee4-5e226d204bbc tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1212 microversion: 2.1 time: 0.077299 Nov 01 01:37:35.553200 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1006/1924] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:37:35 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1212 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:37:36.568882 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-102fcefc-8b2f-47af-92b3-f152ce4b4970 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:37:36.569529 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-102fcefc-8b2f-47af-92b3-f152ce4b4970 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:37:36.575994 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-102fcefc-8b2f-47af-92b3-f152ce4b4970 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:37:36.576438 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-102fcefc-8b2f-47af-92b3-f152ce4b4970 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:37:36.577201 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-102fcefc-8b2f-47af-92b3-f152ce4b4970 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:37:36.577634 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-102fcefc-8b2f-47af-92b3-f152ce4b4970 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:37:36.635405 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-102fcefc-8b2f-47af-92b3-f152ce4b4970 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:37:36.643166 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-102fcefc-8b2f-47af-92b3-f152ce4b4970 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1212 microversion: 2.1 time: 0.077961 Nov 01 01:37:36.643728 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 919/1925] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:37:36 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1212 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:37:37.660169 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-3658401b-bafd-4a0d-be7c-03401db9d97e tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:37:37.660710 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-3658401b-bafd-4a0d-be7c-03401db9d97e tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:37:37.667014 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3658401b-bafd-4a0d-be7c-03401db9d97e tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:37:37.667455 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3658401b-bafd-4a0d-be7c-03401db9d97e tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:37:37.668210 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3658401b-bafd-4a0d-be7c-03401db9d97e tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:37:37.668635 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3658401b-bafd-4a0d-be7c-03401db9d97e tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:37:37.728352 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-3658401b-bafd-4a0d-be7c-03401db9d97e tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:37:37.735651 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-3658401b-bafd-4a0d-be7c-03401db9d97e tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1212 microversion: 2.1 time: 0.079857 Nov 01 01:37:37.736207 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1007/1926] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:37:37 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1212 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:37:38.752724 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-ce3e95f4-7284-43a9-8352-a623f868f196 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:37:38.753390 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-ce3e95f4-7284-43a9-8352-a623f868f196 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:37:38.759720 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ce3e95f4-7284-43a9-8352-a623f868f196 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:37:38.760157 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ce3e95f4-7284-43a9-8352-a623f868f196 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:37:38.760906 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ce3e95f4-7284-43a9-8352-a623f868f196 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:37:38.761332 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ce3e95f4-7284-43a9-8352-a623f868f196 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:37:38.820112 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-ce3e95f4-7284-43a9-8352-a623f868f196 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:37:38.827299 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-ce3e95f4-7284-43a9-8352-a623f868f196 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1212 microversion: 2.1 time: 0.078950 Nov 01 01:37:38.828019 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 920/1927] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:37:38 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1212 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:37:39.844293 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-09282ffc-d58b-4beb-9d35-729af26e905e tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:37:39.844904 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-09282ffc-d58b-4beb-9d35-729af26e905e tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:37:39.851167 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-09282ffc-d58b-4beb-9d35-729af26e905e tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:37:39.851611 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-09282ffc-d58b-4beb-9d35-729af26e905e tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:37:39.852376 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-09282ffc-d58b-4beb-9d35-729af26e905e tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:37:39.852807 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-09282ffc-d58b-4beb-9d35-729af26e905e tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:37:39.910135 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-09282ffc-d58b-4beb-9d35-729af26e905e tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:37:39.917311 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-09282ffc-d58b-4beb-9d35-729af26e905e tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1212 microversion: 2.1 time: 0.076736 Nov 01 01:37:39.917868 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1008/1928] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:37:39 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1212 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:37:40.934365 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-ae7b202b-0ef8-4557-aa33-763550ca22c4 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:37:40.934995 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-ae7b202b-0ef8-4557-aa33-763550ca22c4 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:37:40.941228 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ae7b202b-0ef8-4557-aa33-763550ca22c4 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:37:40.941675 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ae7b202b-0ef8-4557-aa33-763550ca22c4 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:37:40.942449 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ae7b202b-0ef8-4557-aa33-763550ca22c4 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:37:40.942880 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ae7b202b-0ef8-4557-aa33-763550ca22c4 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:37:41.004886 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-ae7b202b-0ef8-4557-aa33-763550ca22c4 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:37:41.012049 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-ae7b202b-0ef8-4557-aa33-763550ca22c4 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1212 microversion: 2.1 time: 0.081366 Nov 01 01:37:41.012605 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 921/1929] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:37:40 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1212 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:37:42.029017 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-51df5e8d-4381-4405-9c0d-9b8b360af6b5 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:37:42.029610 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-51df5e8d-4381-4405-9c0d-9b8b360af6b5 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:37:42.036402 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-51df5e8d-4381-4405-9c0d-9b8b360af6b5 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:37:42.036841 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-51df5e8d-4381-4405-9c0d-9b8b360af6b5 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:37:42.037603 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-51df5e8d-4381-4405-9c0d-9b8b360af6b5 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:37:42.038028 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-51df5e8d-4381-4405-9c0d-9b8b360af6b5 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:37:42.095425 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-51df5e8d-4381-4405-9c0d-9b8b360af6b5 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:37:42.103179 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-51df5e8d-4381-4405-9c0d-9b8b360af6b5 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1212 microversion: 2.1 time: 0.077793 Nov 01 01:37:42.103742 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1009/1930] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:37:42 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1212 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:37:43.120120 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-bcf8a563-108e-4ece-8c5d-9a8e329bbf35 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:37:43.120710 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-bcf8a563-108e-4ece-8c5d-9a8e329bbf35 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:37:43.126936 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-bcf8a563-108e-4ece-8c5d-9a8e329bbf35 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:37:43.127393 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-bcf8a563-108e-4ece-8c5d-9a8e329bbf35 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:37:43.128145 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-bcf8a563-108e-4ece-8c5d-9a8e329bbf35 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:37:43.128574 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-bcf8a563-108e-4ece-8c5d-9a8e329bbf35 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:37:43.189688 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-bcf8a563-108e-4ece-8c5d-9a8e329bbf35 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:37:43.196990 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-bcf8a563-108e-4ece-8c5d-9a8e329bbf35 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1212 microversion: 2.1 time: 0.080492 Nov 01 01:37:43.197545 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 922/1931] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:37:43 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1212 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:37:44.214394 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-e54770ce-2626-4ca5-af56-a1e9ba85cfed tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:37:44.215054 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-e54770ce-2626-4ca5-af56-a1e9ba85cfed tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:37:44.221338 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e54770ce-2626-4ca5-af56-a1e9ba85cfed tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:37:44.221783 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e54770ce-2626-4ca5-af56-a1e9ba85cfed tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:37:44.222618 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e54770ce-2626-4ca5-af56-a1e9ba85cfed tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:37:44.223050 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e54770ce-2626-4ca5-af56-a1e9ba85cfed tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:37:44.280405 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-e54770ce-2626-4ca5-af56-a1e9ba85cfed tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:37:44.288008 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-e54770ce-2626-4ca5-af56-a1e9ba85cfed tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1212 microversion: 2.1 time: 0.077512 Nov 01 01:37:44.288559 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1010/1932] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:37:44 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1212 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:37:45.304580 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-7b89a3e4-bdfa-42c5-9909-a4e84c8dd7ea tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:37:45.305165 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-7b89a3e4-bdfa-42c5-9909-a4e84c8dd7ea tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:37:45.311161 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7b89a3e4-bdfa-42c5-9909-a4e84c8dd7ea tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:37:45.311599 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7b89a3e4-bdfa-42c5-9909-a4e84c8dd7ea tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:37:45.312351 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7b89a3e4-bdfa-42c5-9909-a4e84c8dd7ea tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:37:45.312775 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7b89a3e4-bdfa-42c5-9909-a4e84c8dd7ea tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:37:45.371195 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-7b89a3e4-bdfa-42c5-9909-a4e84c8dd7ea tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:37:45.379093 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-7b89a3e4-bdfa-42c5-9909-a4e84c8dd7ea tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1212 microversion: 2.1 time: 0.078131 Nov 01 01:37:45.379646 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 923/1933] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:37:45 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1212 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:37:46.395232 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-a4092047-852a-4ad3-9fd8-6193d81ac6a4 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:37:46.395845 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-a4092047-852a-4ad3-9fd8-6193d81ac6a4 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:37:46.402197 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a4092047-852a-4ad3-9fd8-6193d81ac6a4 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:37:46.402684 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a4092047-852a-4ad3-9fd8-6193d81ac6a4 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:37:46.403477 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a4092047-852a-4ad3-9fd8-6193d81ac6a4 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:37:46.403909 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a4092047-852a-4ad3-9fd8-6193d81ac6a4 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:37:46.462551 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-a4092047-852a-4ad3-9fd8-6193d81ac6a4 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:37:46.469728 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-a4092047-852a-4ad3-9fd8-6193d81ac6a4 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1212 microversion: 2.1 time: 0.078697 Nov 01 01:37:46.470287 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1011/1934] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:37:46 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1212 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:37:47.487533 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-6065ab7a-c79f-4b4b-ad8f-aa656fc04281 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:37:47.488166 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-6065ab7a-c79f-4b4b-ad8f-aa656fc04281 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:37:47.494337 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6065ab7a-c79f-4b4b-ad8f-aa656fc04281 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:37:47.494822 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6065ab7a-c79f-4b4b-ad8f-aa656fc04281 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:37:47.495582 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6065ab7a-c79f-4b4b-ad8f-aa656fc04281 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:37:47.496011 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6065ab7a-c79f-4b4b-ad8f-aa656fc04281 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:37:47.557373 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-6065ab7a-c79f-4b4b-ad8f-aa656fc04281 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:37:47.564670 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-6065ab7a-c79f-4b4b-ad8f-aa656fc04281 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1212 microversion: 2.1 time: 0.081441 Nov 01 01:37:47.565355 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 924/1935] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:37:47 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1212 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:37:48.581327 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-b3f18ba8-bf23-406e-9633-52a5166d9f37 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:37:48.581927 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-b3f18ba8-bf23-406e-9633-52a5166d9f37 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:37:48.588065 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b3f18ba8-bf23-406e-9633-52a5166d9f37 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:37:48.588505 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b3f18ba8-bf23-406e-9633-52a5166d9f37 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:37:48.589249 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b3f18ba8-bf23-406e-9633-52a5166d9f37 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:37:48.589668 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b3f18ba8-bf23-406e-9633-52a5166d9f37 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:37:48.647576 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-b3f18ba8-bf23-406e-9633-52a5166d9f37 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:37:48.654753 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-b3f18ba8-bf23-406e-9633-52a5166d9f37 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1212 microversion: 2.1 time: 0.077289 Nov 01 01:37:48.655301 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1012/1936] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:37:48 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1212 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:37:49.671265 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-cc984312-1664-4b1b-85a2-e89d47713c04 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:37:49.672424 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-cc984312-1664-4b1b-85a2-e89d47713c04 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:37:49.678761 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-cc984312-1664-4b1b-85a2-e89d47713c04 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:37:49.679212 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-cc984312-1664-4b1b-85a2-e89d47713c04 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:37:49.679979 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-cc984312-1664-4b1b-85a2-e89d47713c04 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:37:49.680412 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-cc984312-1664-4b1b-85a2-e89d47713c04 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:37:49.738751 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-cc984312-1664-4b1b-85a2-e89d47713c04 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:37:49.745974 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-cc984312-1664-4b1b-85a2-e89d47713c04 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1212 microversion: 2.1 time: 0.078471 Nov 01 01:37:49.746557 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 925/1937] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:37:49 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1212 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:37:50.762907 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-1a711a95-a098-4491-bca8-dc9e559d881b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:37:50.763517 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-1a711a95-a098-4491-bca8-dc9e559d881b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:37:50.770159 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-1a711a95-a098-4491-bca8-dc9e559d881b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:37:50.770626 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-1a711a95-a098-4491-bca8-dc9e559d881b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:37:50.771387 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-1a711a95-a098-4491-bca8-dc9e559d881b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:37:50.771810 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-1a711a95-a098-4491-bca8-dc9e559d881b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:37:50.829162 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-1a711a95-a098-4491-bca8-dc9e559d881b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:37:50.837117 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-1a711a95-a098-4491-bca8-dc9e559d881b tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1212 microversion: 2.1 time: 0.077858 Nov 01 01:37:50.837670 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1013/1938] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:37:50 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1212 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:37:51.853730 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-71e840ea-2198-46db-9899-ce6b8ff65d6a tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:37:51.854331 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-71e840ea-2198-46db-9899-ce6b8ff65d6a tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:37:51.860624 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-71e840ea-2198-46db-9899-ce6b8ff65d6a tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:37:51.861073 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-71e840ea-2198-46db-9899-ce6b8ff65d6a tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:37:51.861851 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-71e840ea-2198-46db-9899-ce6b8ff65d6a tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:37:51.862278 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-71e840ea-2198-46db-9899-ce6b8ff65d6a tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:37:51.919998 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-71e840ea-2198-46db-9899-ce6b8ff65d6a tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:37:51.927590 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-71e840ea-2198-46db-9899-ce6b8ff65d6a tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1212 microversion: 2.1 time: 0.077506 Nov 01 01:37:51.928143 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 926/1939] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:37:51 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1212 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:37:52.944600 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-81c5bd11-ea8d-46d8-9450-078f8ab20008 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:37:52.945208 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-81c5bd11-ea8d-46d8-9450-078f8ab20008 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:37:52.951467 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-81c5bd11-ea8d-46d8-9450-078f8ab20008 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:37:52.951935 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-81c5bd11-ea8d-46d8-9450-078f8ab20008 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:37:52.952689 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-81c5bd11-ea8d-46d8-9450-078f8ab20008 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:37:52.953115 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-81c5bd11-ea8d-46d8-9450-078f8ab20008 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:37:53.012498 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-81c5bd11-ea8d-46d8-9450-078f8ab20008 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:37:53.019686 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-81c5bd11-ea8d-46d8-9450-078f8ab20008 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1212 microversion: 2.1 time: 0.079353 Nov 01 01:37:53.020244 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1014/1940] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:37:52 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1212 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:37:54.036545 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-23430e6a-e250-4555-8663-47f5ad791ed0 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:37:54.037155 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-23430e6a-e250-4555-8663-47f5ad791ed0 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:37:54.043356 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-23430e6a-e250-4555-8663-47f5ad791ed0 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:37:54.043802 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-23430e6a-e250-4555-8663-47f5ad791ed0 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:37:54.044558 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-23430e6a-e250-4555-8663-47f5ad791ed0 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:37:54.044986 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-23430e6a-e250-4555-8663-47f5ad791ed0 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:37:54.107140 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-23430e6a-e250-4555-8663-47f5ad791ed0 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:37:54.114460 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-23430e6a-e250-4555-8663-47f5ad791ed0 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1212 microversion: 2.1 time: 0.081756 Nov 01 01:37:54.115013 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 927/1941] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:37:54 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1212 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:37:55.130875 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-991a0d11-329f-4968-b1aa-a120282b3650 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:37:55.131477 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-991a0d11-329f-4968-b1aa-a120282b3650 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:37:55.137696 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-991a0d11-329f-4968-b1aa-a120282b3650 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:37:55.138142 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-991a0d11-329f-4968-b1aa-a120282b3650 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:37:55.138972 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-991a0d11-329f-4968-b1aa-a120282b3650 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:37:55.139399 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-991a0d11-329f-4968-b1aa-a120282b3650 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:37:55.196928 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-991a0d11-329f-4968-b1aa-a120282b3650 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:37:55.204218 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-991a0d11-329f-4968-b1aa-a120282b3650 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1212 microversion: 2.1 time: 0.077111 Nov 01 01:37:55.211270 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1015/1942] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:37:55 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1212 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:37:56.221427 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-bcc2ae71-0eee-4f15-8e20-161473f21ebb tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:37:56.222037 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-bcc2ae71-0eee-4f15-8e20-161473f21ebb tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:37:56.228258 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-bcc2ae71-0eee-4f15-8e20-161473f21ebb tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:37:56.228708 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-bcc2ae71-0eee-4f15-8e20-161473f21ebb tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:37:56.229472 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-bcc2ae71-0eee-4f15-8e20-161473f21ebb tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:37:56.229905 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-bcc2ae71-0eee-4f15-8e20-161473f21ebb tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:37:56.288619 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-bcc2ae71-0eee-4f15-8e20-161473f21ebb tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:37:56.295726 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-bcc2ae71-0eee-4f15-8e20-161473f21ebb tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1212 microversion: 2.1 time: 0.078056 Nov 01 01:37:56.296295 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 928/1943] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:37:56 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1212 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:37:57.312829 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-67a3aa30-8306-402b-ba62-e9a78c857503 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:37:57.313468 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-67a3aa30-8306-402b-ba62-e9a78c857503 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:37:57.319599 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-67a3aa30-8306-402b-ba62-e9a78c857503 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:37:57.320041 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-67a3aa30-8306-402b-ba62-e9a78c857503 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:37:57.320796 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-67a3aa30-8306-402b-ba62-e9a78c857503 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:37:57.321219 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-67a3aa30-8306-402b-ba62-e9a78c857503 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:37:57.380450 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-67a3aa30-8306-402b-ba62-e9a78c857503 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:37:57.387652 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-67a3aa30-8306-402b-ba62-e9a78c857503 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1212 microversion: 2.1 time: 0.078534 Nov 01 01:37:57.388206 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1016/1944] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:37:57 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1212 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:37:58.404623 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-4a35025e-a784-4c8f-a5aa-1a02683813fa tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:37:58.405225 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-4a35025e-a784-4c8f-a5aa-1a02683813fa tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:37:58.411453 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4a35025e-a784-4c8f-a5aa-1a02683813fa tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:37:58.411896 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4a35025e-a784-4c8f-a5aa-1a02683813fa tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:37:58.412654 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4a35025e-a784-4c8f-a5aa-1a02683813fa tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:37:58.413115 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4a35025e-a784-4c8f-a5aa-1a02683813fa tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:37:58.471321 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-4a35025e-a784-4c8f-a5aa-1a02683813fa tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:37:58.478408 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-4a35025e-a784-4c8f-a5aa-1a02683813fa tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1212 microversion: 2.1 time: 0.077444 Nov 01 01:37:58.478981 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 929/1945] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:37:58 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1212 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:37:59.494778 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-7adcb7c3-1d62-4f6d-bef6-6649719c494d tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:37:59.495383 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-7adcb7c3-1d62-4f6d-bef6-6649719c494d tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:37:59.501517 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-7adcb7c3-1d62-4f6d-bef6-6649719c494d tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:37:59.501956 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-7adcb7c3-1d62-4f6d-bef6-6649719c494d tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:37:59.502734 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-7adcb7c3-1d62-4f6d-bef6-6649719c494d tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:37:59.503196 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-7adcb7c3-1d62-4f6d-bef6-6649719c494d tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:37:59.560932 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-7adcb7c3-1d62-4f6d-bef6-6649719c494d tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:37:59.568169 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-7adcb7c3-1d62-4f6d-bef6-6649719c494d tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1212 microversion: 2.1 time: 0.077138 Nov 01 01:37:59.568724 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1017/1946] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:37:59 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1212 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:38:00.584465 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-1a30425b-2350-4ca0-a82c-c2f79e4994da tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:38:00.585069 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-1a30425b-2350-4ca0-a82c-c2f79e4994da tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:38:00.591510 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1a30425b-2350-4ca0-a82c-c2f79e4994da tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:38:00.591950 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1a30425b-2350-4ca0-a82c-c2f79e4994da tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:38:00.592729 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1a30425b-2350-4ca0-a82c-c2f79e4994da tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:38:00.593154 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1a30425b-2350-4ca0-a82c-c2f79e4994da tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:38:00.653716 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-1a30425b-2350-4ca0-a82c-c2f79e4994da tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:38:00.661365 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-1a30425b-2350-4ca0-a82c-c2f79e4994da tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1212 microversion: 2.1 time: 0.080532 Nov 01 01:38:00.661919 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 930/1947] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:38:00 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1212 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:38:01.677302 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-3a384a47-9ad9-443a-a365-b194108aff1a tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:38:01.677915 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-3a384a47-9ad9-443a-a365-b194108aff1a tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:38:01.684123 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3a384a47-9ad9-443a-a365-b194108aff1a tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:38:01.684558 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3a384a47-9ad9-443a-a365-b194108aff1a tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:38:01.685301 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3a384a47-9ad9-443a-a365-b194108aff1a tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:38:01.685723 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3a384a47-9ad9-443a-a365-b194108aff1a tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:38:01.743884 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-3a384a47-9ad9-443a-a365-b194108aff1a tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:38:01.750983 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-3a384a47-9ad9-443a-a365-b194108aff1a tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1212 microversion: 2.1 time: 0.077817 Nov 01 01:38:01.751541 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1018/1948] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:38:01 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1212 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:38:02.768037 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-6ba165f8-20d5-4f0c-89f8-f4a4cd267a14 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:38:02.768705 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-6ba165f8-20d5-4f0c-89f8-f4a4cd267a14 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:38:02.775664 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6ba165f8-20d5-4f0c-89f8-f4a4cd267a14 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:38:02.776100 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6ba165f8-20d5-4f0c-89f8-f4a4cd267a14 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:38:02.776844 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6ba165f8-20d5-4f0c-89f8-f4a4cd267a14 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:38:02.777263 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6ba165f8-20d5-4f0c-89f8-f4a4cd267a14 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:38:02.834999 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-6ba165f8-20d5-4f0c-89f8-f4a4cd267a14 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:38:02.842292 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-6ba165f8-20d5-4f0c-89f8-f4a4cd267a14 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1212 microversion: 2.1 time: 0.077999 Nov 01 01:38:02.842878 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 931/1949] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:38:02 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1212 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:38:03.858223 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-1716e2a9-cfe2-4be0-8c4f-ebbdf7ba228e tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:38:03.860656 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-1716e2a9-cfe2-4be0-8c4f-ebbdf7ba228e tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:38:03.865611 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-1716e2a9-cfe2-4be0-8c4f-ebbdf7ba228e tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:38:03.866057 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-1716e2a9-cfe2-4be0-8c4f-ebbdf7ba228e tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:38:03.866873 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-1716e2a9-cfe2-4be0-8c4f-ebbdf7ba228e tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:38:03.867306 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-1716e2a9-cfe2-4be0-8c4f-ebbdf7ba228e tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:38:03.925642 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-1716e2a9-cfe2-4be0-8c4f-ebbdf7ba228e tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:38:03.932969 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-1716e2a9-cfe2-4be0-8c4f-ebbdf7ba228e tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1212 microversion: 2.1 time: 0.078422 Nov 01 01:38:03.933535 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1019/1950] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:38:03 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1212 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:38:04.949309 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-17a188d8-b3cc-4d50-8184-bb0e65502c4c tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:38:04.949931 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-17a188d8-b3cc-4d50-8184-bb0e65502c4c tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:38:04.956732 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-17a188d8-b3cc-4d50-8184-bb0e65502c4c tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:38:04.957187 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-17a188d8-b3cc-4d50-8184-bb0e65502c4c tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:38:04.957933 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-17a188d8-b3cc-4d50-8184-bb0e65502c4c tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:38:04.958355 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-17a188d8-b3cc-4d50-8184-bb0e65502c4c tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:38:05.015491 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-17a188d8-b3cc-4d50-8184-bb0e65502c4c tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:38:05.023051 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-17a188d8-b3cc-4d50-8184-bb0e65502c4c tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1212 microversion: 2.1 time: 0.077390 Nov 01 01:38:05.023609 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 932/1951] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:38:04 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1212 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:38:06.040138 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-01984eba-67be-455f-a0f4-7c1c613a208c tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:38:06.040744 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-01984eba-67be-455f-a0f4-7c1c613a208c tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:38:06.047401 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-01984eba-67be-455f-a0f4-7c1c613a208c tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:38:06.047836 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-01984eba-67be-455f-a0f4-7c1c613a208c tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:38:06.048583 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-01984eba-67be-455f-a0f4-7c1c613a208c tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:38:06.049002 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-01984eba-67be-455f-a0f4-7c1c613a208c tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:38:06.109923 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-01984eba-67be-455f-a0f4-7c1c613a208c tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:38:06.117363 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-01984eba-67be-455f-a0f4-7c1c613a208c tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1212 microversion: 2.1 time: 0.080833 Nov 01 01:38:06.117920 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1020/1952] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:38:06 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1212 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:38:07.134992 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-39df1ebf-8b75-4cf2-9d49-2f8040f28cd9 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:38:07.135576 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-39df1ebf-8b75-4cf2-9d49-2f8040f28cd9 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:38:07.141697 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-39df1ebf-8b75-4cf2-9d49-2f8040f28cd9 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:38:07.142143 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-39df1ebf-8b75-4cf2-9d49-2f8040f28cd9 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:38:07.142929 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-39df1ebf-8b75-4cf2-9d49-2f8040f28cd9 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:38:07.143354 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-39df1ebf-8b75-4cf2-9d49-2f8040f28cd9 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:38:07.204317 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-39df1ebf-8b75-4cf2-9d49-2f8040f28cd9 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:38:07.212450 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-39df1ebf-8b75-4cf2-9d49-2f8040f28cd9 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1212 microversion: 2.1 time: 0.081074 Nov 01 01:38:07.213014 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 933/1953] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:38:07 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1212 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:38:08.228997 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-f4211b7b-4df7-4df4-a046-405eee1e8c0e tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:38:08.229633 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-f4211b7b-4df7-4df4-a046-405eee1e8c0e tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:38:08.235876 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f4211b7b-4df7-4df4-a046-405eee1e8c0e tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:38:08.236311 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f4211b7b-4df7-4df4-a046-405eee1e8c0e tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:38:08.237063 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f4211b7b-4df7-4df4-a046-405eee1e8c0e tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:38:08.237488 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f4211b7b-4df7-4df4-a046-405eee1e8c0e tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:38:08.417497 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-f4211b7b-4df7-4df4-a046-405eee1e8c0e tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:38:08.417497 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-f4211b7b-4df7-4df4-a046-405eee1e8c0e tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1212 microversion: 2.1 time: 0.078648 Nov 01 01:38:08.417497 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1021/1954] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:38:08 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1212 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:38:09.322055 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-e390db75-181a-49a5-97f5-d1f0c43c62e7 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:38:09.322716 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-e390db75-181a-49a5-97f5-d1f0c43c62e7 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:38:09.329197 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e390db75-181a-49a5-97f5-d1f0c43c62e7 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:38:09.329755 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e390db75-181a-49a5-97f5-d1f0c43c62e7 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:38:09.330679 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e390db75-181a-49a5-97f5-d1f0c43c62e7 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:38:09.331131 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e390db75-181a-49a5-97f5-d1f0c43c62e7 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:38:09.392089 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-e390db75-181a-49a5-97f5-d1f0c43c62e7 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:38:09.399517 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-e390db75-181a-49a5-97f5-d1f0c43c62e7 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1212 microversion: 2.1 time: 0.081073 Nov 01 01:38:09.400072 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 934/1955] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:38:09 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1212 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:38:10.415908 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-cbf7f2a5-2f63-4408-9feb-00d60146c681 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:38:10.416514 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-cbf7f2a5-2f63-4408-9feb-00d60146c681 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:38:10.422892 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-cbf7f2a5-2f63-4408-9feb-00d60146c681 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:38:10.423336 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-cbf7f2a5-2f63-4408-9feb-00d60146c681 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:38:10.424092 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-cbf7f2a5-2f63-4408-9feb-00d60146c681 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:38:10.424520 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-cbf7f2a5-2f63-4408-9feb-00d60146c681 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:38:10.483072 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-cbf7f2a5-2f63-4408-9feb-00d60146c681 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:38:10.490794 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-cbf7f2a5-2f63-4408-9feb-00d60146c681 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1212 microversion: 2.1 time: 0.078482 Nov 01 01:38:10.491361 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1022/1956] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:38:10 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1212 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:38:11.507184 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-331203ae-e82f-4ab1-80f2-0f5431a8fda3 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:38:11.507791 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-331203ae-e82f-4ab1-80f2-0f5431a8fda3 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:38:11.514018 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-331203ae-e82f-4ab1-80f2-0f5431a8fda3 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:38:11.514485 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-331203ae-e82f-4ab1-80f2-0f5431a8fda3 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:38:11.515251 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-331203ae-e82f-4ab1-80f2-0f5431a8fda3 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:38:11.515684 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-331203ae-e82f-4ab1-80f2-0f5431a8fda3 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:38:11.572772 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-331203ae-e82f-4ab1-80f2-0f5431a8fda3 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:38:11.582327 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-331203ae-e82f-4ab1-80f2-0f5431a8fda3 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1212 microversion: 2.1 time: 0.078842 Nov 01 01:38:11.582922 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 935/1957] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:38:11 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1212 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:38:12.599449 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-0d95524d-2287-4e35-b463-4ce0a370c277 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:38:12.600063 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-0d95524d-2287-4e35-b463-4ce0a370c277 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:38:12.606321 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0d95524d-2287-4e35-b463-4ce0a370c277 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:38:12.606797 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0d95524d-2287-4e35-b463-4ce0a370c277 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:38:12.607556 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0d95524d-2287-4e35-b463-4ce0a370c277 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:38:12.607992 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0d95524d-2287-4e35-b463-4ce0a370c277 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:38:12.665935 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-0d95524d-2287-4e35-b463-4ce0a370c277 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:38:12.673156 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-0d95524d-2287-4e35-b463-4ce0a370c277 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1212 microversion: 2.1 time: 0.077387 Nov 01 01:38:12.673716 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1023/1958] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:38:12 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1212 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:38:13.689069 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-234339f2-f04e-4276-93f2-3f60a0a2044a tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:38:13.689666 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-234339f2-f04e-4276-93f2-3f60a0a2044a tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:38:13.695846 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-234339f2-f04e-4276-93f2-3f60a0a2044a tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:38:13.696282 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-234339f2-f04e-4276-93f2-3f60a0a2044a tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:38:13.697024 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-234339f2-f04e-4276-93f2-3f60a0a2044a tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:38:13.697444 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-234339f2-f04e-4276-93f2-3f60a0a2044a tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:38:13.759390 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-234339f2-f04e-4276-93f2-3f60a0a2044a tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:38:13.766687 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-234339f2-f04e-4276-93f2-3f60a0a2044a tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1212 microversion: 2.1 time: 0.081206 Nov 01 01:38:13.767250 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 936/1959] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:38:13 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1212 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:38:14.783379 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-847baa00-fcb1-46c7-895a-2b66f178a3dc tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:38:14.784010 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-847baa00-fcb1-46c7-895a-2b66f178a3dc tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:38:14.790736 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-847baa00-fcb1-46c7-895a-2b66f178a3dc tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:38:14.791175 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-847baa00-fcb1-46c7-895a-2b66f178a3dc tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:38:14.791926 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-847baa00-fcb1-46c7-895a-2b66f178a3dc tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:38:14.792346 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-847baa00-fcb1-46c7-895a-2b66f178a3dc tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:38:14.849624 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-847baa00-fcb1-46c7-895a-2b66f178a3dc tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:38:14.856693 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-847baa00-fcb1-46c7-895a-2b66f178a3dc tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1212 microversion: 2.1 time: 0.077368 Nov 01 01:38:14.857276 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1024/1960] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:38:14 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1212 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:38:15.872762 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-df7c5446-65f7-4e93-b24c-38901371d164 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:38:15.873300 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-df7c5446-65f7-4e93-b24c-38901371d164 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:38:15.879237 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-df7c5446-65f7-4e93-b24c-38901371d164 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:38:15.879686 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-df7c5446-65f7-4e93-b24c-38901371d164 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:38:15.880440 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-df7c5446-65f7-4e93-b24c-38901371d164 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:38:15.880863 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-df7c5446-65f7-4e93-b24c-38901371d164 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:38:15.938639 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-df7c5446-65f7-4e93-b24c-38901371d164 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:38:15.946151 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-df7c5446-65f7-4e93-b24c-38901371d164 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1212 microversion: 2.1 time: 0.076995 Nov 01 01:38:15.946772 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 937/1961] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:38:15 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1212 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:38:16.962710 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-9833529a-a3e9-4dbe-bf53-9081a76a97f9 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:38:16.963339 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-9833529a-a3e9-4dbe-bf53-9081a76a97f9 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] [instance: 7554da88-1726-438a-bed5-4e30d999ba9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:38:16.969480 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9833529a-a3e9-4dbe-bf53-9081a76a97f9 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:38:16.969915 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9833529a-a3e9-4dbe-bf53-9081a76a97f9 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:38:16.970684 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9833529a-a3e9-4dbe-bf53-9081a76a97f9 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:38:16.971107 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9833529a-a3e9-4dbe-bf53-9081a76a97f9 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:38:17.028629 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-9833529a-a3e9-4dbe-bf53-9081a76a97f9 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67e821884b248a99caf956b7f3de189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ba2f03280e45b4ad8deab41fffe14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:38:17.035687 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-9833529a-a3e9-4dbe-bf53-9081a76a97f9 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d" status: 200 len: 1212 microversion: 2.1 time: 0.076901 Nov 01 01:38:17.036784 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1025/1962] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:38:16 2021] GET /compute/v2.1/servers/7554da88-1726-438a-bed5-4e30d999ba9d => generated 1212 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:38:17.278944 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-49f513c4-48d1-4d59-9e40-8c4cb8be9017 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] Calling method '.version_select at 0x7fccf6e1b040>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:38:17.369816 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-49f513c4-48d1-4d59-9e40-8c4cb8be9017 tempest-TestShelveInstance-2063883507 tempest-TestShelveInstance-2063883507-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2122604351" status: 202 len: 0 microversion: 2.1 time: 0.097348 Nov 01 01:38:17.370396 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 938/1963] 10.222.0.47 () {58 vars in 1253 bytes} [Mon Nov 1 01:38:17 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2122604351 => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 01 01:38:52.631583 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 01 01:38:52.632159 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: Mon Nov 1 01:38:52 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 01 01:40:34.283957 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 01 01:40:34.284657 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: Mon Nov 1 01:40:34 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 01 01:40:40.059177 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 01 01:40:40.059771 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: Mon Nov 1 01:40:40 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 01 01:41:18.236693 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 01 01:41:18.237395 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: Mon Nov 1 01:41:18 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 01 01:41:24.348909 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: ERROR oslo.messaging._drivers.impl_rabbit [-] [7e1bda63-fde5-4b21-ba6b-b276700f2913] AMQP server on 10.222.0.47:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 01 01:41:24.353583 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-8fedaaee-4410-44d4-b486-de5e0e4a9493 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:41:24.354079 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-8fedaaee-4410-44d4-b486-de5e0e4a9493 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:41:24.360148 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8fedaaee-4410-44d4-b486-de5e0e4a9493 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:41:24.360586 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8fedaaee-4410-44d4-b486-de5e0e4a9493 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:41:24.361348 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8fedaaee-4410-44d4-b486-de5e0e4a9493 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:41:24.361774 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8fedaaee-4410-44d4-b486-de5e0e4a9493 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:41:24.391053 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-8fedaaee-4410-44d4-b486-de5e0e4a9493 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Going to try to terminate instance {{(pid=116267) delete /opt/stack/nova/nova/compute/api.py:2612}} Nov 01 01:41:24.470650 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6dc26ce5-d736-4826-9bc2-997e4285c77e] AMQP server on 10.222.0.47:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 01 01:41:24.474393 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-47d066f1-9ea0-4e0b-b8a4-0933eb8a00b0 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] Calling method '.version_select at 0x7fccf6a67c10>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:41:24.570572 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-47d066f1-9ea0-4e0b-b8a4-0933eb8a00b0 tempest-TestVolumeBootPattern-1363324123 tempest-TestVolumeBootPattern-1363324123-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-36728570" status: 202 len: 0 microversion: 2.1 time: 0.101408 Nov 01 01:41:24.571183 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 939/1964] 10.222.0.47 () {58 vars in 1256 bytes} [Mon Nov 1 01:41:24 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-36728570 => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 01 01:41:24.622436 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: ERROR oslo.messaging._drivers.impl_rabbit [None req-8fedaaee-4410-44d4-b486-de5e0e4a9493 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [d6748a1e-8370-493e-b3b5-ff17386f722d] AMQP server on 10.222.0.47:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 01 01:41:25.169005 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 01 01:41:25.169228 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: Mon Nov 1 01:41:25 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 01 01:41:25.367244 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO oslo.messaging._drivers.impl_rabbit [-] [7e1bda63-fde5-4b21-ba6b-b276700f2913] Reconnected to AMQP server on 10.222.0.47:5672 via [amqp] client with port 50390. Nov 01 01:41:25.640071 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO oslo.messaging._drivers.impl_rabbit [None req-8fedaaee-4410-44d4-b486-de5e0e4a9493 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [d6748a1e-8370-493e-b3b5-ff17386f722d] Reconnected to AMQP server on 10.222.0.47:5672 via [amqp] client with port 50392. Nov 01 01:41:25.718418 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-8fedaaee-4410-44d4-b486-de5e0e4a9493 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "DELETE /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 204 len: 0 microversion: 2.1 time: 1.377683 Nov 01 01:41:25.719024 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1026/1965] 10.222.0.47 () {58 vars in 1238 bytes} [Mon Nov 1 01:41:24 2021] DELETE /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 0 bytes in 1379 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 01 01:41:25.737048 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-396eb8f4-4e8f-434a-b8f8-3ffeb15e7ca4 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:41:25.738145 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-396eb8f4-4e8f-434a-b8f8-3ffeb15e7ca4 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:41:25.745014 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-396eb8f4-4e8f-434a-b8f8-3ffeb15e7ca4 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:41:25.745470 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-396eb8f4-4e8f-434a-b8f8-3ffeb15e7ca4 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:41:25.746231 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-396eb8f4-4e8f-434a-b8f8-3ffeb15e7ca4 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:41:25.747037 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-396eb8f4-4e8f-434a-b8f8-3ffeb15e7ca4 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:41:25.762653 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO oslo.messaging._drivers.impl_rabbit [-] [6dc26ce5-d736-4826-9bc2-997e4285c77e] Reconnected to AMQP server on 10.222.0.47:5672 via [amqp] client with port 50396. Nov 01 01:41:25.876694 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-396eb8f4-4e8f-434a-b8f8-3ffeb15e7ca4 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:41:25.885032 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-396eb8f4-4e8f-434a-b8f8-3ffeb15e7ca4 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.161420 Nov 01 01:41:25.885590 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 940/1966] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:41:25 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:41:26.901534 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-3b0b13c3-baf2-499b-98bc-bfd17c85a8aa tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:41:26.902466 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-3b0b13c3-baf2-499b-98bc-bfd17c85a8aa tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:41:26.912270 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3b0b13c3-baf2-499b-98bc-bfd17c85a8aa tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:41:26.912869 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3b0b13c3-baf2-499b-98bc-bfd17c85a8aa tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:41:26.913744 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3b0b13c3-baf2-499b-98bc-bfd17c85a8aa tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:41:26.914405 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3b0b13c3-baf2-499b-98bc-bfd17c85a8aa tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:41:27.344159 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-3b0b13c3-baf2-499b-98bc-bfd17c85a8aa tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:41:27.353129 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-3b0b13c3-baf2-499b-98bc-bfd17c85a8aa tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.455624 Nov 01 01:41:27.353693 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1027/1967] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:41:26 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:41:28.369573 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-3b710766-d90e-4af8-9f7f-982541408154 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:41:28.370221 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-3b710766-d90e-4af8-9f7f-982541408154 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:41:28.376543 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3b710766-d90e-4af8-9f7f-982541408154 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:41:28.376994 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3b710766-d90e-4af8-9f7f-982541408154 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:41:28.377788 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3b710766-d90e-4af8-9f7f-982541408154 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:41:28.378226 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3b710766-d90e-4af8-9f7f-982541408154 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:41:28.639443 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-3b710766-d90e-4af8-9f7f-982541408154 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:41:28.647194 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-3b710766-d90e-4af8-9f7f-982541408154 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.281346 Nov 01 01:41:28.647763 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 941/1968] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:41:28 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:41:29.664030 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-c2e3c395-a077-4d5f-8f64-2528926c4b64 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:41:29.664697 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-c2e3c395-a077-4d5f-8f64-2528926c4b64 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:41:29.671374 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c2e3c395-a077-4d5f-8f64-2528926c4b64 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:41:29.671811 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c2e3c395-a077-4d5f-8f64-2528926c4b64 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:41:29.672576 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c2e3c395-a077-4d5f-8f64-2528926c4b64 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:41:29.672996 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c2e3c395-a077-4d5f-8f64-2528926c4b64 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:41:29.881678 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-c2e3c395-a077-4d5f-8f64-2528926c4b64 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:41:29.890290 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-c2e3c395-a077-4d5f-8f64-2528926c4b64 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.230079 Nov 01 01:41:29.891950 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1028/1969] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:41:29 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:41:30.907012 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-999c7abf-c57d-4265-a7b3-9026f0eb0983 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:41:30.907617 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-999c7abf-c57d-4265-a7b3-9026f0eb0983 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:41:30.914081 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-999c7abf-c57d-4265-a7b3-9026f0eb0983 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:41:30.914583 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-999c7abf-c57d-4265-a7b3-9026f0eb0983 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:41:30.915340 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-999c7abf-c57d-4265-a7b3-9026f0eb0983 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:41:30.915765 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-999c7abf-c57d-4265-a7b3-9026f0eb0983 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:41:31.196322 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-999c7abf-c57d-4265-a7b3-9026f0eb0983 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:41:31.199904 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-999c7abf-c57d-4265-a7b3-9026f0eb0983 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.296632 Nov 01 01:41:31.200676 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 942/1970] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:41:30 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:41:32.216694 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-2d46261f-afdf-41ef-b7f9-d89585409166 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:41:32.217302 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-2d46261f-afdf-41ef-b7f9-d89585409166 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:41:32.223415 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-2d46261f-afdf-41ef-b7f9-d89585409166 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:41:32.223862 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-2d46261f-afdf-41ef-b7f9-d89585409166 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:41:32.224623 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-2d46261f-afdf-41ef-b7f9-d89585409166 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:41:32.225050 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-2d46261f-afdf-41ef-b7f9-d89585409166 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:41:32.370494 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-2d46261f-afdf-41ef-b7f9-d89585409166 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:41:32.377294 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-2d46261f-afdf-41ef-b7f9-d89585409166 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.164244 Nov 01 01:41:32.377840 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1029/1971] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:41:32 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:41:33.394218 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-ceb40ba4-b975-48b6-b42b-25397a6577a8 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:41:33.394865 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-ceb40ba4-b975-48b6-b42b-25397a6577a8 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:41:33.404605 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ceb40ba4-b975-48b6-b42b-25397a6577a8 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:41:33.404605 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ceb40ba4-b975-48b6-b42b-25397a6577a8 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:41:33.404605 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ceb40ba4-b975-48b6-b42b-25397a6577a8 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:41:33.404605 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ceb40ba4-b975-48b6-b42b-25397a6577a8 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:41:33.529303 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-ceb40ba4-b975-48b6-b42b-25397a6577a8 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:41:33.537058 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-ceb40ba4-b975-48b6-b42b-25397a6577a8 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.146428 Nov 01 01:41:33.537609 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 943/1972] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:41:33 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:41:34.553847 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-b17ae757-7416-48b7-8754-e11926e96b75 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:41:34.554496 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-b17ae757-7416-48b7-8754-e11926e96b75 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:41:34.560711 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b17ae757-7416-48b7-8754-e11926e96b75 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:41:34.561158 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b17ae757-7416-48b7-8754-e11926e96b75 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:41:34.561924 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b17ae757-7416-48b7-8754-e11926e96b75 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:41:34.562356 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b17ae757-7416-48b7-8754-e11926e96b75 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:41:34.684113 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-b17ae757-7416-48b7-8754-e11926e96b75 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:41:34.691863 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-b17ae757-7416-48b7-8754-e11926e96b75 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.142334 Nov 01 01:41:34.692418 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1030/1973] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:41:34 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:41:35.708961 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-04751337-85da-4a2d-9ef5-8b5b707a29e4 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:41:35.709571 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-04751337-85da-4a2d-9ef5-8b5b707a29e4 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:41:35.715816 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-04751337-85da-4a2d-9ef5-8b5b707a29e4 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:41:35.716260 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-04751337-85da-4a2d-9ef5-8b5b707a29e4 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:41:35.717021 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-04751337-85da-4a2d-9ef5-8b5b707a29e4 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:41:35.717450 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-04751337-85da-4a2d-9ef5-8b5b707a29e4 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:41:35.840268 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-04751337-85da-4a2d-9ef5-8b5b707a29e4 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:41:35.848368 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-04751337-85da-4a2d-9ef5-8b5b707a29e4 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.143149 Nov 01 01:41:35.848929 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 944/1974] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:41:35 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:41:36.864771 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-bf218f2d-9a53-4325-80e9-954ab84285fa tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:41:36.865407 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-bf218f2d-9a53-4325-80e9-954ab84285fa tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:41:36.871586 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-bf218f2d-9a53-4325-80e9-954ab84285fa tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:41:36.872020 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-bf218f2d-9a53-4325-80e9-954ab84285fa tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:41:36.872769 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-bf218f2d-9a53-4325-80e9-954ab84285fa tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:41:36.873187 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-bf218f2d-9a53-4325-80e9-954ab84285fa tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:41:36.990057 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-bf218f2d-9a53-4325-80e9-954ab84285fa tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:41:36.997725 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-bf218f2d-9a53-4325-80e9-954ab84285fa tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.136590 Nov 01 01:41:36.998282 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1031/1975] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:41:36 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:41:38.014850 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-d76bd3a3-5693-49c1-9daa-9fe9a875ccec tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:41:38.015456 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-d76bd3a3-5693-49c1-9daa-9fe9a875ccec tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:41:38.022118 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d76bd3a3-5693-49c1-9daa-9fe9a875ccec tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:41:38.022600 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d76bd3a3-5693-49c1-9daa-9fe9a875ccec tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:41:38.023359 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d76bd3a3-5693-49c1-9daa-9fe9a875ccec tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:41:38.023788 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d76bd3a3-5693-49c1-9daa-9fe9a875ccec tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:41:38.143128 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-d76bd3a3-5693-49c1-9daa-9fe9a875ccec tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:41:38.151406 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-d76bd3a3-5693-49c1-9daa-9fe9a875ccec tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.140185 Nov 01 01:41:38.151972 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 945/1976] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:41:38 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:41:39.167728 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-11ef1bec-8f14-4940-80dc-3ab65d5f8399 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:41:39.168351 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-11ef1bec-8f14-4940-80dc-3ab65d5f8399 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:41:39.174454 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-11ef1bec-8f14-4940-80dc-3ab65d5f8399 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:41:39.174898 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-11ef1bec-8f14-4940-80dc-3ab65d5f8399 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:41:39.176274 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-11ef1bec-8f14-4940-80dc-3ab65d5f8399 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:41:39.176692 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-11ef1bec-8f14-4940-80dc-3ab65d5f8399 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:41:39.292840 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-11ef1bec-8f14-4940-80dc-3ab65d5f8399 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:41:39.300455 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-11ef1bec-8f14-4940-80dc-3ab65d5f8399 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.136427 Nov 01 01:41:39.301010 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1032/1977] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:41:39 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:41:40.316934 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-a99f1d40-8811-454a-bf18-00917053b8c1 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:41:40.317538 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-a99f1d40-8811-454a-bf18-00917053b8c1 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:41:40.323825 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a99f1d40-8811-454a-bf18-00917053b8c1 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:41:40.324269 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a99f1d40-8811-454a-bf18-00917053b8c1 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:41:40.325024 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a99f1d40-8811-454a-bf18-00917053b8c1 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:41:40.325451 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a99f1d40-8811-454a-bf18-00917053b8c1 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:41:40.442762 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-a99f1d40-8811-454a-bf18-00917053b8c1 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:41:40.450389 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-a99f1d40-8811-454a-bf18-00917053b8c1 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.137150 Nov 01 01:41:40.450973 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 946/1978] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:41:40 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:41:41.468129 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-2b595c8f-56fe-4c80-b35c-8967591ba0c1 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:41:41.468735 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-2b595c8f-56fe-4c80-b35c-8967591ba0c1 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:41:41.475354 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-2b595c8f-56fe-4c80-b35c-8967591ba0c1 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:41:41.475790 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-2b595c8f-56fe-4c80-b35c-8967591ba0c1 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:41:41.476544 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-2b595c8f-56fe-4c80-b35c-8967591ba0c1 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:41:41.476963 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-2b595c8f-56fe-4c80-b35c-8967591ba0c1 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:41:41.599291 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-2b595c8f-56fe-4c80-b35c-8967591ba0c1 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:41:41.606984 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-2b595c8f-56fe-4c80-b35c-8967591ba0c1 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.142510 Nov 01 01:41:41.607538 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1033/1979] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:41:41 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:41:42.624205 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-5ae5939c-ee6b-4d2d-a085-f2484f9b5f3c tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:41:42.624751 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-5ae5939c-ee6b-4d2d-a085-f2484f9b5f3c tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:41:42.631497 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5ae5939c-ee6b-4d2d-a085-f2484f9b5f3c tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:41:42.631942 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5ae5939c-ee6b-4d2d-a085-f2484f9b5f3c tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:41:42.632702 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5ae5939c-ee6b-4d2d-a085-f2484f9b5f3c tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:41:42.633134 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5ae5939c-ee6b-4d2d-a085-f2484f9b5f3c tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:41:42.750245 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-5ae5939c-ee6b-4d2d-a085-f2484f9b5f3c tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:41:42.758444 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-5ae5939c-ee6b-4d2d-a085-f2484f9b5f3c tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.138014 Nov 01 01:41:42.759003 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 947/1980] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:41:42 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:41:43.775294 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-c2b7870f-5e43-4c0d-9cb0-c76431970e25 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:41:43.775905 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-c2b7870f-5e43-4c0d-9cb0-c76431970e25 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:41:43.782066 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c2b7870f-5e43-4c0d-9cb0-c76431970e25 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:41:43.782538 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c2b7870f-5e43-4c0d-9cb0-c76431970e25 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:41:43.783299 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c2b7870f-5e43-4c0d-9cb0-c76431970e25 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:41:43.783722 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c2b7870f-5e43-4c0d-9cb0-c76431970e25 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:41:43.906303 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-c2b7870f-5e43-4c0d-9cb0-c76431970e25 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:41:43.914682 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-c2b7870f-5e43-4c0d-9cb0-c76431970e25 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.143036 Nov 01 01:41:43.915234 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1034/1981] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:41:43 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:41:44.931994 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-7e35c422-0ed4-40fb-b9f4-a5936d4dff53 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:41:44.932610 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-7e35c422-0ed4-40fb-b9f4-a5936d4dff53 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:41:44.938834 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7e35c422-0ed4-40fb-b9f4-a5936d4dff53 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:41:44.939280 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7e35c422-0ed4-40fb-b9f4-a5936d4dff53 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:41:44.940051 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7e35c422-0ed4-40fb-b9f4-a5936d4dff53 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:41:44.940484 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7e35c422-0ed4-40fb-b9f4-a5936d4dff53 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:41:45.059604 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-7e35c422-0ed4-40fb-b9f4-a5936d4dff53 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:41:45.067205 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-7e35c422-0ed4-40fb-b9f4-a5936d4dff53 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.138874 Nov 01 01:41:45.067767 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 948/1982] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:41:44 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:41:46.083570 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-9671eb11-fc79-49f1-9c95-b63586f1f648 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:41:46.084160 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-9671eb11-fc79-49f1-9c95-b63586f1f648 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:41:46.090370 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9671eb11-fc79-49f1-9c95-b63586f1f648 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:41:46.090851 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9671eb11-fc79-49f1-9c95-b63586f1f648 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:41:46.091617 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9671eb11-fc79-49f1-9c95-b63586f1f648 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:41:46.092045 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9671eb11-fc79-49f1-9c95-b63586f1f648 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:41:46.208676 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-9671eb11-fc79-49f1-9c95-b63586f1f648 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:41:46.216393 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-9671eb11-fc79-49f1-9c95-b63586f1f648 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.136502 Nov 01 01:41:46.216953 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1035/1983] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:41:46 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:41:47.232779 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-b3f93110-210b-4683-9140-667dadf84fac tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:41:47.233381 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-b3f93110-210b-4683-9140-667dadf84fac tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:41:47.239521 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b3f93110-210b-4683-9140-667dadf84fac tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:41:47.239958 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b3f93110-210b-4683-9140-667dadf84fac tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:41:47.240707 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b3f93110-210b-4683-9140-667dadf84fac tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:41:47.241131 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b3f93110-210b-4683-9140-667dadf84fac tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:41:47.360137 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-b3f93110-210b-4683-9140-667dadf84fac tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:41:47.367751 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-b3f93110-210b-4683-9140-667dadf84fac tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.138578 Nov 01 01:41:47.368308 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 949/1984] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:41:47 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:41:48.384662 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-fa01eaa4-5db4-4cc8-bb47-6c284b3ded5d tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:41:48.385268 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-fa01eaa4-5db4-4cc8-bb47-6c284b3ded5d tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:41:48.391451 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-fa01eaa4-5db4-4cc8-bb47-6c284b3ded5d tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:41:48.391892 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-fa01eaa4-5db4-4cc8-bb47-6c284b3ded5d tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:41:48.392642 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-fa01eaa4-5db4-4cc8-bb47-6c284b3ded5d tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:41:48.393063 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-fa01eaa4-5db4-4cc8-bb47-6c284b3ded5d tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:41:48.511352 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-fa01eaa4-5db4-4cc8-bb47-6c284b3ded5d tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:41:48.518866 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-fa01eaa4-5db4-4cc8-bb47-6c284b3ded5d tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.137934 Nov 01 01:41:48.519415 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1036/1985] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:41:48 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:41:49.536408 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-7fd95661-ef59-4c88-a514-623db53467e6 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:41:49.536964 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-7fd95661-ef59-4c88-a514-623db53467e6 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:41:49.543131 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7fd95661-ef59-4c88-a514-623db53467e6 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:41:49.543575 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7fd95661-ef59-4c88-a514-623db53467e6 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:41:49.544325 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7fd95661-ef59-4c88-a514-623db53467e6 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:41:49.544751 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7fd95661-ef59-4c88-a514-623db53467e6 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:41:49.660622 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-7fd95661-ef59-4c88-a514-623db53467e6 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:41:49.668883 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-7fd95661-ef59-4c88-a514-623db53467e6 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.136632 Nov 01 01:41:49.669438 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 950/1986] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:41:49 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:41:50.684820 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-b640cfda-1da4-44a9-a442-50b387403510 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:41:50.685427 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-b640cfda-1da4-44a9-a442-50b387403510 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:41:50.691648 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b640cfda-1da4-44a9-a442-50b387403510 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:41:50.692683 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b640cfda-1da4-44a9-a442-50b387403510 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:41:50.693443 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b640cfda-1da4-44a9-a442-50b387403510 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:41:50.693871 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b640cfda-1da4-44a9-a442-50b387403510 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:41:50.816092 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-b640cfda-1da4-44a9-a442-50b387403510 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:41:50.823841 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-b640cfda-1da4-44a9-a442-50b387403510 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.142700 Nov 01 01:41:50.824406 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1037/1987] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:41:50 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:41:51.840727 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-b7637f02-f1a2-4500-a53c-5a53c7cfbcec tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:41:51.841381 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-b7637f02-f1a2-4500-a53c-5a53c7cfbcec tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:41:51.847615 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b7637f02-f1a2-4500-a53c-5a53c7cfbcec tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:41:51.848052 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b7637f02-f1a2-4500-a53c-5a53c7cfbcec tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:41:51.848803 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b7637f02-f1a2-4500-a53c-5a53c7cfbcec tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:41:51.849223 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b7637f02-f1a2-4500-a53c-5a53c7cfbcec tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:41:51.968204 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-b7637f02-f1a2-4500-a53c-5a53c7cfbcec tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:41:51.975739 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-b7637f02-f1a2-4500-a53c-5a53c7cfbcec tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.139516 Nov 01 01:41:51.976296 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 951/1988] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:41:51 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:41:52.992275 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-a88fca1b-5e64-478f-8998-3bcae5b75c13 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:41:52.992869 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-a88fca1b-5e64-478f-8998-3bcae5b75c13 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:41:52.999030 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a88fca1b-5e64-478f-8998-3bcae5b75c13 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:41:52.999470 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a88fca1b-5e64-478f-8998-3bcae5b75c13 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:41:53.000217 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a88fca1b-5e64-478f-8998-3bcae5b75c13 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:41:53.000639 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a88fca1b-5e64-478f-8998-3bcae5b75c13 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:41:53.123013 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-a88fca1b-5e64-478f-8998-3bcae5b75c13 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:41:53.131176 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-a88fca1b-5e64-478f-8998-3bcae5b75c13 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.142559 Nov 01 01:41:53.131729 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1038/1989] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:41:52 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:41:54.147820 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-c03316aa-239a-458d-a750-c7fd54047d3d tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:41:54.148415 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-c03316aa-239a-458d-a750-c7fd54047d3d tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:41:54.154649 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c03316aa-239a-458d-a750-c7fd54047d3d tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:41:54.155089 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c03316aa-239a-458d-a750-c7fd54047d3d tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:41:54.155890 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c03316aa-239a-458d-a750-c7fd54047d3d tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:41:54.156314 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c03316aa-239a-458d-a750-c7fd54047d3d tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:41:54.273257 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-c03316aa-239a-458d-a750-c7fd54047d3d tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:41:54.280889 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-c03316aa-239a-458d-a750-c7fd54047d3d tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.137148 Nov 01 01:41:54.281491 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 952/1990] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:41:54 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:41:55.298210 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-211fd295-39bf-487c-978c-bc2888fcbe59 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:41:55.298896 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-211fd295-39bf-487c-978c-bc2888fcbe59 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:41:55.305819 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-211fd295-39bf-487c-978c-bc2888fcbe59 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:41:55.306269 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-211fd295-39bf-487c-978c-bc2888fcbe59 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:41:55.307112 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-211fd295-39bf-487c-978c-bc2888fcbe59 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:41:55.307543 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-211fd295-39bf-487c-978c-bc2888fcbe59 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:41:55.430968 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-211fd295-39bf-487c-978c-bc2888fcbe59 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:41:55.438695 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-211fd295-39bf-487c-978c-bc2888fcbe59 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.144242 Nov 01 01:41:55.439260 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1039/1991] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:41:55 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:41:56.455807 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-90f36eb5-22e8-4ba4-86dc-76a6bfa551c8 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:41:56.456418 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-90f36eb5-22e8-4ba4-86dc-76a6bfa551c8 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:41:56.462157 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-90f36eb5-22e8-4ba4-86dc-76a6bfa551c8 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:41:56.462641 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-90f36eb5-22e8-4ba4-86dc-76a6bfa551c8 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:41:56.463393 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-90f36eb5-22e8-4ba4-86dc-76a6bfa551c8 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:41:56.463816 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-90f36eb5-22e8-4ba4-86dc-76a6bfa551c8 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:41:56.580271 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-90f36eb5-22e8-4ba4-86dc-76a6bfa551c8 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:41:56.588050 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-90f36eb5-22e8-4ba4-86dc-76a6bfa551c8 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.136261 Nov 01 01:41:56.588614 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 953/1992] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:41:56 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:41:57.604621 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-cff1b5a6-9840-4995-b7e1-072daf51ea75 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:41:57.605222 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-cff1b5a6-9840-4995-b7e1-072daf51ea75 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:41:57.611528 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-cff1b5a6-9840-4995-b7e1-072daf51ea75 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:41:57.611966 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-cff1b5a6-9840-4995-b7e1-072daf51ea75 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:41:57.612715 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-cff1b5a6-9840-4995-b7e1-072daf51ea75 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:41:57.613137 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-cff1b5a6-9840-4995-b7e1-072daf51ea75 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:41:57.735131 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-cff1b5a6-9840-4995-b7e1-072daf51ea75 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:41:57.742878 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-cff1b5a6-9840-4995-b7e1-072daf51ea75 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.141863 Nov 01 01:41:57.743433 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1040/1993] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:41:57 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:41:58.759600 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-6584d050-b1c3-439b-a29e-d07028de885f tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:41:58.760207 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-6584d050-b1c3-439b-a29e-d07028de885f tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:41:58.766506 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6584d050-b1c3-439b-a29e-d07028de885f tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:41:58.766947 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6584d050-b1c3-439b-a29e-d07028de885f tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:41:58.767695 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6584d050-b1c3-439b-a29e-d07028de885f tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:41:58.768114 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6584d050-b1c3-439b-a29e-d07028de885f tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:41:58.887677 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-6584d050-b1c3-439b-a29e-d07028de885f tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:41:58.895220 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-6584d050-b1c3-439b-a29e-d07028de885f tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.139332 Nov 01 01:41:58.896277 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 954/1994] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:41:58 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:41:59.913831 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-1d62b153-8dc5-4985-b91a-4d5798775d52 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:41:59.914446 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-1d62b153-8dc5-4985-b91a-4d5798775d52 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:41:59.920706 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-1d62b153-8dc5-4985-b91a-4d5798775d52 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:41:59.921135 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-1d62b153-8dc5-4985-b91a-4d5798775d52 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:41:59.921886 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-1d62b153-8dc5-4985-b91a-4d5798775d52 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:41:59.922307 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-1d62b153-8dc5-4985-b91a-4d5798775d52 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:42:00.040962 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-1d62b153-8dc5-4985-b91a-4d5798775d52 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:42:00.048664 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-1d62b153-8dc5-4985-b91a-4d5798775d52 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.139090 Nov 01 01:42:00.049217 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1041/1995] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:41:59 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:42:01.066301 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-94325346-ea67-4df9-a10d-26a79e76f1d8 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:42:01.066950 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-94325346-ea67-4df9-a10d-26a79e76f1d8 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:42:01.073765 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-94325346-ea67-4df9-a10d-26a79e76f1d8 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:42:01.074210 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-94325346-ea67-4df9-a10d-26a79e76f1d8 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:42:01.075029 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-94325346-ea67-4df9-a10d-26a79e76f1d8 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:42:01.075456 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-94325346-ea67-4df9-a10d-26a79e76f1d8 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:42:01.190705 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-94325346-ea67-4df9-a10d-26a79e76f1d8 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:42:01.198841 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-94325346-ea67-4df9-a10d-26a79e76f1d8 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.136222 Nov 01 01:42:01.199398 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 955/1996] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:42:01 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:42:02.215880 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-c5151152-e436-40e8-adcd-dbed120c266d tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:42:02.216486 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-c5151152-e436-40e8-adcd-dbed120c266d tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:42:02.222727 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c5151152-e436-40e8-adcd-dbed120c266d tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:42:02.223173 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c5151152-e436-40e8-adcd-dbed120c266d tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:42:02.224432 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c5151152-e436-40e8-adcd-dbed120c266d tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:42:02.224859 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c5151152-e436-40e8-adcd-dbed120c266d tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:42:02.345508 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-c5151152-e436-40e8-adcd-dbed120c266d tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:42:02.354744 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-c5151152-e436-40e8-adcd-dbed120c266d tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.142470 Nov 01 01:42:02.355303 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1042/1997] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:42:02 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:42:03.371632 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-46c584f8-7a31-4843-81dc-030b3e3bfb02 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:42:03.372239 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-46c584f8-7a31-4843-81dc-030b3e3bfb02 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:42:03.378516 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-46c584f8-7a31-4843-81dc-030b3e3bfb02 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:42:03.378959 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-46c584f8-7a31-4843-81dc-030b3e3bfb02 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:42:03.379778 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-46c584f8-7a31-4843-81dc-030b3e3bfb02 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:42:03.380752 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-46c584f8-7a31-4843-81dc-030b3e3bfb02 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:42:03.497701 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-46c584f8-7a31-4843-81dc-030b3e3bfb02 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:42:03.505317 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-46c584f8-7a31-4843-81dc-030b3e3bfb02 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.137363 Nov 01 01:42:03.505879 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 956/1998] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:42:03 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:42:04.522374 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-e2441a09-d004-409a-9863-9c95d21796ce tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:42:04.523009 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-e2441a09-d004-409a-9863-9c95d21796ce tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:42:04.529219 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e2441a09-d004-409a-9863-9c95d21796ce tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:42:04.529662 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e2441a09-d004-409a-9863-9c95d21796ce tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:42:04.530436 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e2441a09-d004-409a-9863-9c95d21796ce tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:42:04.530882 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e2441a09-d004-409a-9863-9c95d21796ce tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:42:04.661238 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-e2441a09-d004-409a-9863-9c95d21796ce tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:42:04.669919 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-e2441a09-d004-409a-9863-9c95d21796ce tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.151595 Nov 01 01:42:04.670534 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1043/1999] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:42:04 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:42:05.687761 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-a112869c-3d42-493b-ac70-12301bd4f5ad tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:42:05.688364 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-a112869c-3d42-493b-ac70-12301bd4f5ad tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:42:05.695173 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a112869c-3d42-493b-ac70-12301bd4f5ad tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:42:05.695614 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a112869c-3d42-493b-ac70-12301bd4f5ad tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:42:05.696365 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a112869c-3d42-493b-ac70-12301bd4f5ad tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:42:05.696787 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a112869c-3d42-493b-ac70-12301bd4f5ad tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:42:05.838647 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-a112869c-3d42-493b-ac70-12301bd4f5ad tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:42:05.846231 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-a112869c-3d42-493b-ac70-12301bd4f5ad tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.162112 Nov 01 01:42:05.846818 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 957/2000] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:42:05 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:42:06.863474 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-673503c6-0c57-4cfb-992b-703ab5964a6d tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:42:06.864655 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-673503c6-0c57-4cfb-992b-703ab5964a6d tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:42:06.870907 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-673503c6-0c57-4cfb-992b-703ab5964a6d tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:42:06.871348 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-673503c6-0c57-4cfb-992b-703ab5964a6d tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:42:06.872106 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-673503c6-0c57-4cfb-992b-703ab5964a6d tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:42:06.872533 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-673503c6-0c57-4cfb-992b-703ab5964a6d tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:42:06.989555 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-673503c6-0c57-4cfb-992b-703ab5964a6d tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:42:06.997260 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-673503c6-0c57-4cfb-992b-703ab5964a6d tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.137500 Nov 01 01:42:06.997820 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1044/2001] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:42:06 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:42:08.014005 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-121ed6d8-d079-4b7b-97ad-be00001fe1dd tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:42:08.014632 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-121ed6d8-d079-4b7b-97ad-be00001fe1dd tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:42:08.021640 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-121ed6d8-d079-4b7b-97ad-be00001fe1dd tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:42:08.022081 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-121ed6d8-d079-4b7b-97ad-be00001fe1dd tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:42:08.022879 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-121ed6d8-d079-4b7b-97ad-be00001fe1dd tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:42:08.023303 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-121ed6d8-d079-4b7b-97ad-be00001fe1dd tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:42:08.148473 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-121ed6d8-d079-4b7b-97ad-be00001fe1dd tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:42:08.156248 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-121ed6d8-d079-4b7b-97ad-be00001fe1dd tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.146072 Nov 01 01:42:08.156807 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 958/2002] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:42:08 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:42:09.177810 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-c36b17f3-3ace-4ded-8b51-d3001a2f7fad tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:42:09.178475 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-c36b17f3-3ace-4ded-8b51-d3001a2f7fad tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:42:09.184658 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c36b17f3-3ace-4ded-8b51-d3001a2f7fad tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:42:09.185109 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c36b17f3-3ace-4ded-8b51-d3001a2f7fad tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:42:09.185871 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c36b17f3-3ace-4ded-8b51-d3001a2f7fad tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:42:09.186300 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c36b17f3-3ace-4ded-8b51-d3001a2f7fad tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:42:09.305215 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-c36b17f3-3ace-4ded-8b51-d3001a2f7fad tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:42:09.312937 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-c36b17f3-3ace-4ded-8b51-d3001a2f7fad tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.139295 Nov 01 01:42:09.313502 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1045/2003] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:42:09 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:42:10.330471 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-d46cc6dc-ea84-451c-915a-3da354a34233 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:42:10.331141 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-d46cc6dc-ea84-451c-915a-3da354a34233 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:42:10.337293 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d46cc6dc-ea84-451c-915a-3da354a34233 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:42:10.337741 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d46cc6dc-ea84-451c-915a-3da354a34233 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:42:10.338520 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d46cc6dc-ea84-451c-915a-3da354a34233 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:42:10.338950 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d46cc6dc-ea84-451c-915a-3da354a34233 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:42:10.454884 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-d46cc6dc-ea84-451c-915a-3da354a34233 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:42:10.462516 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-d46cc6dc-ea84-451c-915a-3da354a34233 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.135957 Nov 01 01:42:10.463076 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 959/2004] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:42:10 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:42:11.479074 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-8ef81456-4ba2-46ed-97b5-d8df6533254a tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:42:11.479678 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-8ef81456-4ba2-46ed-97b5-d8df6533254a tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:42:11.487124 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8ef81456-4ba2-46ed-97b5-d8df6533254a tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:42:11.487563 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8ef81456-4ba2-46ed-97b5-d8df6533254a tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:42:11.488320 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8ef81456-4ba2-46ed-97b5-d8df6533254a tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:42:11.489241 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8ef81456-4ba2-46ed-97b5-d8df6533254a tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:42:11.607658 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-8ef81456-4ba2-46ed-97b5-d8df6533254a tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:42:11.616040 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-8ef81456-4ba2-46ed-97b5-d8df6533254a tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.140534 Nov 01 01:42:11.616534 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1046/2005] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:42:11 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:42:12.633777 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-fca53cdc-d9fb-4d1c-8894-648ba2e909ac tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:42:12.634315 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-fca53cdc-d9fb-4d1c-8894-648ba2e909ac tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:42:12.640645 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-fca53cdc-d9fb-4d1c-8894-648ba2e909ac tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:42:12.641092 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-fca53cdc-d9fb-4d1c-8894-648ba2e909ac tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:42:12.641834 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-fca53cdc-d9fb-4d1c-8894-648ba2e909ac tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:42:12.642261 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-fca53cdc-d9fb-4d1c-8894-648ba2e909ac tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:42:12.648827 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 01 01:42:12.649297 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: Mon Nov 1 01:42:12 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 01 01:42:12.762442 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-fca53cdc-d9fb-4d1c-8894-648ba2e909ac tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:42:12.770112 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-fca53cdc-d9fb-4d1c-8894-648ba2e909ac tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.141206 Nov 01 01:42:12.770711 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 960/2006] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:42:12 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:42:13.786026 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-f143c436-ba94-4b5d-a38b-424abb0f46dd tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:42:13.786731 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-f143c436-ba94-4b5d-a38b-424abb0f46dd tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:42:13.792939 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f143c436-ba94-4b5d-a38b-424abb0f46dd tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:42:13.793376 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f143c436-ba94-4b5d-a38b-424abb0f46dd tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:42:13.794127 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f143c436-ba94-4b5d-a38b-424abb0f46dd tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:42:13.794573 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f143c436-ba94-4b5d-a38b-424abb0f46dd tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:42:13.911324 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-f143c436-ba94-4b5d-a38b-424abb0f46dd tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:42:13.922434 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-f143c436-ba94-4b5d-a38b-424abb0f46dd tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.139989 Nov 01 01:42:13.929020 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1047/2007] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:42:13 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:42:14.939275 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-da3cf42d-aa43-4cb0-9423-2d7759611ccb tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:42:14.939884 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-da3cf42d-aa43-4cb0-9423-2d7759611ccb tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:42:14.946214 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-da3cf42d-aa43-4cb0-9423-2d7759611ccb tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:42:14.946688 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-da3cf42d-aa43-4cb0-9423-2d7759611ccb tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:42:14.947452 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-da3cf42d-aa43-4cb0-9423-2d7759611ccb tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:42:14.947878 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-da3cf42d-aa43-4cb0-9423-2d7759611ccb tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:42:15.282298 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-da3cf42d-aa43-4cb0-9423-2d7759611ccb tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:42:15.290728 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-da3cf42d-aa43-4cb0-9423-2d7759611ccb tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.355085 Nov 01 01:42:15.292210 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 961/2008] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:42:14 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:42:16.108732 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-221d5384-c088-42bc-9904-033a25f7ba35 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:42:16.109228 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-221d5384-c088-42bc-9904-033a25f7ba35 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:42:16.115948 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-221d5384-c088-42bc-9904-033a25f7ba35 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:42:16.116394 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-221d5384-c088-42bc-9904-033a25f7ba35 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:42:16.117165 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-221d5384-c088-42bc-9904-033a25f7ba35 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:42:16.117592 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-221d5384-c088-42bc-9904-033a25f7ba35 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:42:16.142234 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-221d5384-c088-42bc-9904-033a25f7ba35 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Going to try to terminate instance {{(pid=116267) delete /opt/stack/nova/nova/compute/api.py:2612}} Nov 01 01:42:16.307200 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-d3db1fbf-f7f6-47d5-b921-361ee4f367c7 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:42:16.307784 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-d3db1fbf-f7f6-47d5-b921-361ee4f367c7 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:42:16.313957 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d3db1fbf-f7f6-47d5-b921-361ee4f367c7 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:42:16.315125 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d3db1fbf-f7f6-47d5-b921-361ee4f367c7 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:42:16.315278 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d3db1fbf-f7f6-47d5-b921-361ee4f367c7 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:42:16.315685 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d3db1fbf-f7f6-47d5-b921-361ee4f367c7 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:42:16.438996 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-d3db1fbf-f7f6-47d5-b921-361ee4f367c7 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:42:16.447221 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-d3db1fbf-f7f6-47d5-b921-361ee4f367c7 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.143602 Nov 01 01:42:16.447781 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 962/2009] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:42:16 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:42:16.455000 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-221d5384-c088-42bc-9904-033a25f7ba35 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "DELETE /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 204 len: 0 microversion: 2.1 time: 0.349571 Nov 01 01:42:16.455571 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1048/2010] 10.222.0.47 () {58 vars in 1238 bytes} [Mon Nov 1 01:42:16 2021] DELETE /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 01 01:42:16.463824 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-78358986-e2f0-43c3-975a-31e1d3c51104 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:42:16.464418 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-78358986-e2f0-43c3-975a-31e1d3c51104 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:42:16.470074 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-78358986-e2f0-43c3-975a-31e1d3c51104 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:42:16.474762 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-78358986-e2f0-43c3-975a-31e1d3c51104 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:42:16.474762 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-78358986-e2f0-43c3-975a-31e1d3c51104 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:42:16.474762 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-78358986-e2f0-43c3-975a-31e1d3c51104 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:42:16.822962 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-78358986-e2f0-43c3-975a-31e1d3c51104 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:42:16.831164 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-78358986-e2f0-43c3-975a-31e1d3c51104 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1717 microversion: 2.1 time: 0.370755 Nov 01 01:42:16.835285 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 963/2011] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:42:16 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1717 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:42:17.464575 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-2eef3a6a-1179-4c65-9596-11ddf70cb2dd tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:42:17.465277 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-2eef3a6a-1179-4c65-9596-11ddf70cb2dd tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:42:17.471559 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-2eef3a6a-1179-4c65-9596-11ddf70cb2dd tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:42:17.472003 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-2eef3a6a-1179-4c65-9596-11ddf70cb2dd tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:42:17.472767 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-2eef3a6a-1179-4c65-9596-11ddf70cb2dd tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:42:17.473785 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-2eef3a6a-1179-4c65-9596-11ddf70cb2dd tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:42:17.591039 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-2eef3a6a-1179-4c65-9596-11ddf70cb2dd tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:42:17.599842 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-2eef3a6a-1179-4c65-9596-11ddf70cb2dd tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.138943 Nov 01 01:42:17.600787 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1049/2012] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:42:17 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:42:17.848315 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-956607da-8ab0-42c4-8991-ed1b97794bb5 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:42:17.848838 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-956607da-8ab0-42c4-8991-ed1b97794bb5 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:42:17.855259 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-956607da-8ab0-42c4-8991-ed1b97794bb5 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:42:17.855697 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-956607da-8ab0-42c4-8991-ed1b97794bb5 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:42:17.856450 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-956607da-8ab0-42c4-8991-ed1b97794bb5 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:42:17.856873 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-956607da-8ab0-42c4-8991-ed1b97794bb5 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:42:17.982540 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-956607da-8ab0-42c4-8991-ed1b97794bb5 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:42:17.990181 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-956607da-8ab0-42c4-8991-ed1b97794bb5 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1717 microversion: 2.1 time: 0.145612 Nov 01 01:42:17.990781 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 964/2013] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:42:17 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1717 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:42:18.617673 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-c579e5df-92ab-4664-9ce4-3e0b148a35b4 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:42:18.618278 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-c579e5df-92ab-4664-9ce4-3e0b148a35b4 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:42:18.624581 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c579e5df-92ab-4664-9ce4-3e0b148a35b4 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:42:18.625017 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c579e5df-92ab-4664-9ce4-3e0b148a35b4 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:42:18.625764 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c579e5df-92ab-4664-9ce4-3e0b148a35b4 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:42:18.626184 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c579e5df-92ab-4664-9ce4-3e0b148a35b4 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:42:18.742689 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-c579e5df-92ab-4664-9ce4-3e0b148a35b4 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:42:18.750254 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-c579e5df-92ab-4664-9ce4-3e0b148a35b4 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.136812 Nov 01 01:42:18.750842 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1050/2014] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:42:18 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:42:19.006659 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-d9c33bf9-4b2a-4471-94f0-3850adacd030 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:42:19.007360 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-d9c33bf9-4b2a-4471-94f0-3850adacd030 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:42:19.013553 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d9c33bf9-4b2a-4471-94f0-3850adacd030 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:42:19.013996 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d9c33bf9-4b2a-4471-94f0-3850adacd030 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:42:19.014775 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d9c33bf9-4b2a-4471-94f0-3850adacd030 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:42:19.015205 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d9c33bf9-4b2a-4471-94f0-3850adacd030 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:42:19.131686 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-d9c33bf9-4b2a-4471-94f0-3850adacd030 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:42:19.139495 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-d9c33bf9-4b2a-4471-94f0-3850adacd030 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1717 microversion: 2.1 time: 0.136498 Nov 01 01:42:19.140051 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 965/2015] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:42:19 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1717 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:42:19.767011 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-e0f8bb66-801b-42a7-befd-e3b4bb65f896 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:42:19.767615 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-e0f8bb66-801b-42a7-befd-e3b4bb65f896 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:42:19.773763 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e0f8bb66-801b-42a7-befd-e3b4bb65f896 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:42:19.774203 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e0f8bb66-801b-42a7-befd-e3b4bb65f896 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:42:19.774983 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e0f8bb66-801b-42a7-befd-e3b4bb65f896 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:42:19.775412 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e0f8bb66-801b-42a7-befd-e3b4bb65f896 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:42:19.895500 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-e0f8bb66-801b-42a7-befd-e3b4bb65f896 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:42:19.903223 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-e0f8bb66-801b-42a7-befd-e3b4bb65f896 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.139863 Nov 01 01:42:19.903785 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1051/2016] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:42:19 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:42:20.156367 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-543c6045-563e-4c4a-a6b9-3e9a1e83af3d tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:42:20.156915 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-543c6045-563e-4c4a-a6b9-3e9a1e83af3d tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:42:20.163818 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-543c6045-563e-4c4a-a6b9-3e9a1e83af3d tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:42:20.164262 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-543c6045-563e-4c4a-a6b9-3e9a1e83af3d tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:42:20.165023 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-543c6045-563e-4c4a-a6b9-3e9a1e83af3d tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:42:20.165452 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-543c6045-563e-4c4a-a6b9-3e9a1e83af3d tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:42:20.280792 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-543c6045-563e-4c4a-a6b9-3e9a1e83af3d tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:42:20.288861 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-543c6045-563e-4c4a-a6b9-3e9a1e83af3d tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1717 microversion: 2.1 time: 0.136188 Nov 01 01:42:20.289429 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 966/2017] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:42:20 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1717 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:42:20.920163 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-07933d75-05bc-4a4b-b48f-abcb3dc45743 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:42:20.920755 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-07933d75-05bc-4a4b-b48f-abcb3dc45743 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:42:20.927120 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-07933d75-05bc-4a4b-b48f-abcb3dc45743 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:42:20.927569 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-07933d75-05bc-4a4b-b48f-abcb3dc45743 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:42:20.928334 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-07933d75-05bc-4a4b-b48f-abcb3dc45743 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:42:20.928765 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-07933d75-05bc-4a4b-b48f-abcb3dc45743 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:42:21.048054 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-07933d75-05bc-4a4b-b48f-abcb3dc45743 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:42:21.055782 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-07933d75-05bc-4a4b-b48f-abcb3dc45743 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.139307 Nov 01 01:42:21.056344 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1052/2018] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:42:20 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:42:21.305887 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-d7f8c53f-80f3-43b0-ada7-d88116a0e0b3 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:42:21.306504 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-d7f8c53f-80f3-43b0-ada7-d88116a0e0b3 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:42:21.312658 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d7f8c53f-80f3-43b0-ada7-d88116a0e0b3 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:42:21.313098 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d7f8c53f-80f3-43b0-ada7-d88116a0e0b3 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:42:21.313844 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d7f8c53f-80f3-43b0-ada7-d88116a0e0b3 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:42:21.314267 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d7f8c53f-80f3-43b0-ada7-d88116a0e0b3 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:42:21.434596 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-d7f8c53f-80f3-43b0-ada7-d88116a0e0b3 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:42:21.442878 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-d7f8c53f-80f3-43b0-ada7-d88116a0e0b3 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1717 microversion: 2.1 time: 0.140113 Nov 01 01:42:21.443473 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 967/2019] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:42:21 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1717 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:42:22.072511 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-215596ee-7ff8-4d3f-a57c-c9050627ec4c tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:42:22.073114 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-215596ee-7ff8-4d3f-a57c-c9050627ec4c tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:42:22.079582 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-215596ee-7ff8-4d3f-a57c-c9050627ec4c tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:42:22.080022 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-215596ee-7ff8-4d3f-a57c-c9050627ec4c tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:42:22.080775 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-215596ee-7ff8-4d3f-a57c-c9050627ec4c tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:42:22.081196 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-215596ee-7ff8-4d3f-a57c-c9050627ec4c tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:42:22.197519 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-215596ee-7ff8-4d3f-a57c-c9050627ec4c tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:42:22.205375 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-215596ee-7ff8-4d3f-a57c-c9050627ec4c tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.136604 Nov 01 01:42:22.205933 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1053/2020] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:42:22 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:42:22.460506 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-dc41700f-6df9-48b3-8257-26d4ef591f94 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:42:22.461127 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-dc41700f-6df9-48b3-8257-26d4ef591f94 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:42:22.467329 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-dc41700f-6df9-48b3-8257-26d4ef591f94 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:42:22.467761 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-dc41700f-6df9-48b3-8257-26d4ef591f94 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:42:22.468508 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-dc41700f-6df9-48b3-8257-26d4ef591f94 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:42:22.468928 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-dc41700f-6df9-48b3-8257-26d4ef591f94 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:42:22.588663 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-dc41700f-6df9-48b3-8257-26d4ef591f94 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:42:22.596390 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-dc41700f-6df9-48b3-8257-26d4ef591f94 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1717 microversion: 2.1 time: 0.140202 Nov 01 01:42:22.596949 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 968/2021] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:42:22 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1717 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:42:23.336266 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-40900450-fcfc-4fb7-adc7-630351e24e14 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:42:23.336874 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-40900450-fcfc-4fb7-adc7-630351e24e14 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:42:23.342813 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-40900450-fcfc-4fb7-adc7-630351e24e14 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:42:23.343326 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-40900450-fcfc-4fb7-adc7-630351e24e14 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:42:23.344152 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-40900450-fcfc-4fb7-adc7-630351e24e14 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:42:23.344642 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-40900450-fcfc-4fb7-adc7-630351e24e14 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:42:23.464966 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-40900450-fcfc-4fb7-adc7-630351e24e14 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:42:23.472674 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-40900450-fcfc-4fb7-adc7-630351e24e14 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.253753 Nov 01 01:42:23.473237 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1054/2022] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:42:23 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:42:23.612859 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-78b77440-df58-4a0f-a1cf-bfeab413d435 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:42:23.613470 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-78b77440-df58-4a0f-a1cf-bfeab413d435 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:42:23.620292 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-78b77440-df58-4a0f-a1cf-bfeab413d435 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:42:23.620739 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-78b77440-df58-4a0f-a1cf-bfeab413d435 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:42:23.621499 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-78b77440-df58-4a0f-a1cf-bfeab413d435 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:42:23.621931 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-78b77440-df58-4a0f-a1cf-bfeab413d435 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:42:23.739772 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-78b77440-df58-4a0f-a1cf-bfeab413d435 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:42:23.747360 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-78b77440-df58-4a0f-a1cf-bfeab413d435 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1717 microversion: 2.1 time: 0.138190 Nov 01 01:42:23.747921 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 969/2023] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:42:23 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1717 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:42:24.488369 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-b9434a9b-3a06-4e16-960d-36a39930b625 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:42:24.488956 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-b9434a9b-3a06-4e16-960d-36a39930b625 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:42:24.495160 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b9434a9b-3a06-4e16-960d-36a39930b625 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:42:24.495605 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b9434a9b-3a06-4e16-960d-36a39930b625 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:42:24.496359 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b9434a9b-3a06-4e16-960d-36a39930b625 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:42:24.496788 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b9434a9b-3a06-4e16-960d-36a39930b625 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:42:24.615059 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-b9434a9b-3a06-4e16-960d-36a39930b625 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:42:24.622749 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-b9434a9b-3a06-4e16-960d-36a39930b625 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.137923 Nov 01 01:42:24.623248 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1055/2024] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:42:24 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:42:24.764857 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-b1a988f9-d74b-4887-8aba-d6adf10e0992 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:42:24.765459 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-b1a988f9-d74b-4887-8aba-d6adf10e0992 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:42:24.772368 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b1a988f9-d74b-4887-8aba-d6adf10e0992 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:42:24.772812 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b1a988f9-d74b-4887-8aba-d6adf10e0992 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:42:24.773574 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b1a988f9-d74b-4887-8aba-d6adf10e0992 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:42:24.773999 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b1a988f9-d74b-4887-8aba-d6adf10e0992 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:42:24.896961 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-b1a988f9-d74b-4887-8aba-d6adf10e0992 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:42:24.904792 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-b1a988f9-d74b-4887-8aba-d6adf10e0992 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1717 microversion: 2.1 time: 0.143622 Nov 01 01:42:24.905349 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 970/2025] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:42:24 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1717 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:42:25.639995 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-2a0bef4b-3da6-453d-ac4d-4268059eb1e7 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:42:25.640597 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-2a0bef4b-3da6-453d-ac4d-4268059eb1e7 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:42:25.647290 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-2a0bef4b-3da6-453d-ac4d-4268059eb1e7 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:42:25.647732 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-2a0bef4b-3da6-453d-ac4d-4268059eb1e7 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:42:25.648573 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-2a0bef4b-3da6-453d-ac4d-4268059eb1e7 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:42:25.648895 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-2a0bef4b-3da6-453d-ac4d-4268059eb1e7 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:42:25.766063 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-2a0bef4b-3da6-453d-ac4d-4268059eb1e7 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:42:25.774242 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-2a0bef4b-3da6-453d-ac4d-4268059eb1e7 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.138147 Nov 01 01:42:25.774827 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1056/2026] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:42:25 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:42:25.921838 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-f3ddf736-900c-4213-9638-16cd079460f4 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:42:25.922414 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-f3ddf736-900c-4213-9638-16cd079460f4 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:42:25.928370 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f3ddf736-900c-4213-9638-16cd079460f4 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:42:25.928817 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f3ddf736-900c-4213-9638-16cd079460f4 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:42:25.929585 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f3ddf736-900c-4213-9638-16cd079460f4 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:42:25.930018 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f3ddf736-900c-4213-9638-16cd079460f4 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:42:26.046191 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-f3ddf736-900c-4213-9638-16cd079460f4 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:42:26.053798 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-f3ddf736-900c-4213-9638-16cd079460f4 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1717 microversion: 2.1 time: 0.135512 Nov 01 01:42:26.054351 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 971/2027] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:42:25 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1717 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:42:26.791229 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-002d4487-e018-434f-865c-46ee29f29233 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:42:26.791834 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-002d4487-e018-434f-865c-46ee29f29233 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:42:26.798237 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-002d4487-e018-434f-865c-46ee29f29233 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:42:26.798706 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-002d4487-e018-434f-865c-46ee29f29233 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:42:26.799460 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-002d4487-e018-434f-865c-46ee29f29233 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:42:26.799880 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-002d4487-e018-434f-865c-46ee29f29233 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:42:26.921073 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-002d4487-e018-434f-865c-46ee29f29233 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:42:26.930214 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-002d4487-e018-434f-865c-46ee29f29233 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.142593 Nov 01 01:42:26.930818 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1057/2028] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:42:26 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:42:27.070257 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-8239bbcb-1fd8-46a3-b54f-48fd511924b9 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:42:27.070891 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-8239bbcb-1fd8-46a3-b54f-48fd511924b9 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:42:27.077393 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8239bbcb-1fd8-46a3-b54f-48fd511924b9 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:42:27.079192 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8239bbcb-1fd8-46a3-b54f-48fd511924b9 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:42:27.079192 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8239bbcb-1fd8-46a3-b54f-48fd511924b9 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:42:27.079192 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8239bbcb-1fd8-46a3-b54f-48fd511924b9 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:42:27.196865 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-8239bbcb-1fd8-46a3-b54f-48fd511924b9 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:42:27.204685 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-8239bbcb-1fd8-46a3-b54f-48fd511924b9 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1717 microversion: 2.1 time: 0.138245 Nov 01 01:42:27.205247 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 972/2029] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:42:27 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1717 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:42:27.947044 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-6684c8d3-9519-4b63-9e17-9f2a476ff949 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:42:27.947655 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-6684c8d3-9519-4b63-9e17-9f2a476ff949 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:42:27.954112 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-6684c8d3-9519-4b63-9e17-9f2a476ff949 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:42:27.954601 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-6684c8d3-9519-4b63-9e17-9f2a476ff949 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:42:27.955357 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-6684c8d3-9519-4b63-9e17-9f2a476ff949 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:42:27.955788 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-6684c8d3-9519-4b63-9e17-9f2a476ff949 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:42:28.079989 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-6684c8d3-9519-4b63-9e17-9f2a476ff949 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:42:28.088324 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-6684c8d3-9519-4b63-9e17-9f2a476ff949 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.145001 Nov 01 01:42:28.088885 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1058/2030] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:42:27 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:42:28.221988 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-93e6d565-87d0-4e3e-a15e-0bae2f65fa2b tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:42:28.222618 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-93e6d565-87d0-4e3e-a15e-0bae2f65fa2b tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:42:28.229424 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-93e6d565-87d0-4e3e-a15e-0bae2f65fa2b tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:42:28.229867 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-93e6d565-87d0-4e3e-a15e-0bae2f65fa2b tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:42:28.230673 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-93e6d565-87d0-4e3e-a15e-0bae2f65fa2b tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:42:28.231096 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-93e6d565-87d0-4e3e-a15e-0bae2f65fa2b tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:42:28.350280 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-93e6d565-87d0-4e3e-a15e-0bae2f65fa2b tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:42:28.357987 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-93e6d565-87d0-4e3e-a15e-0bae2f65fa2b tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1717 microversion: 2.1 time: 0.139745 Nov 01 01:42:28.358556 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 973/2031] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:42:28 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1717 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:42:29.104723 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-6dc99ab0-d75f-474f-b005-b87db791a5d6 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:42:29.105325 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-6dc99ab0-d75f-474f-b005-b87db791a5d6 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:42:29.112039 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-6dc99ab0-d75f-474f-b005-b87db791a5d6 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:42:29.112528 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-6dc99ab0-d75f-474f-b005-b87db791a5d6 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:42:29.113376 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-6dc99ab0-d75f-474f-b005-b87db791a5d6 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:42:29.114666 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-6dc99ab0-d75f-474f-b005-b87db791a5d6 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:42:29.236518 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-6dc99ab0-d75f-474f-b005-b87db791a5d6 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:42:29.244898 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-6dc99ab0-d75f-474f-b005-b87db791a5d6 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.143847 Nov 01 01:42:29.245529 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1059/2032] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:42:29 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:42:29.374800 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-128c5cff-0377-4d56-972c-e47dee276ef3 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:42:29.375444 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-128c5cff-0377-4d56-972c-e47dee276ef3 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:42:29.381639 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-128c5cff-0377-4d56-972c-e47dee276ef3 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:42:29.382084 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-128c5cff-0377-4d56-972c-e47dee276ef3 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:42:29.382868 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-128c5cff-0377-4d56-972c-e47dee276ef3 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:42:29.383299 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-128c5cff-0377-4d56-972c-e47dee276ef3 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:42:29.499840 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-128c5cff-0377-4d56-972c-e47dee276ef3 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:42:29.507495 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-128c5cff-0377-4d56-972c-e47dee276ef3 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1717 microversion: 2.1 time: 0.136325 Nov 01 01:42:29.508066 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 974/2033] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:42:29 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1717 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:42:30.261294 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-2ca6011b-e6f6-4298-8a34-2de306b02a71 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:42:30.261900 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-2ca6011b-e6f6-4298-8a34-2de306b02a71 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:42:30.268216 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-2ca6011b-e6f6-4298-8a34-2de306b02a71 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:42:30.268646 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-2ca6011b-e6f6-4298-8a34-2de306b02a71 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:42:30.269399 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-2ca6011b-e6f6-4298-8a34-2de306b02a71 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:42:30.269825 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-2ca6011b-e6f6-4298-8a34-2de306b02a71 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:42:30.391424 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-2ca6011b-e6f6-4298-8a34-2de306b02a71 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:42:30.399209 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-2ca6011b-e6f6-4298-8a34-2de306b02a71 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.141627 Nov 01 01:42:30.399768 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1060/2034] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:42:30 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:42:30.523720 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-26edc4b3-cc73-4912-85d8-1feced74bce0 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:42:30.524322 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-26edc4b3-cc73-4912-85d8-1feced74bce0 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:42:30.530408 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-26edc4b3-cc73-4912-85d8-1feced74bce0 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:42:30.530874 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-26edc4b3-cc73-4912-85d8-1feced74bce0 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:42:30.531631 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-26edc4b3-cc73-4912-85d8-1feced74bce0 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:42:30.532053 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-26edc4b3-cc73-4912-85d8-1feced74bce0 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:42:30.649556 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-26edc4b3-cc73-4912-85d8-1feced74bce0 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:42:30.657203 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-26edc4b3-cc73-4912-85d8-1feced74bce0 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1717 microversion: 2.1 time: 0.137090 Nov 01 01:42:30.657765 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 975/2035] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:42:30 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1717 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:42:31.415850 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-111c6d9c-feb6-4fb8-b1ad-e21647c5327e tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:42:31.416452 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-111c6d9c-feb6-4fb8-b1ad-e21647c5327e tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:42:31.422718 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-111c6d9c-feb6-4fb8-b1ad-e21647c5327e tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:42:31.423160 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-111c6d9c-feb6-4fb8-b1ad-e21647c5327e tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:42:31.423911 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-111c6d9c-feb6-4fb8-b1ad-e21647c5327e tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:42:31.424331 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-111c6d9c-feb6-4fb8-b1ad-e21647c5327e tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:42:31.540613 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-111c6d9c-feb6-4fb8-b1ad-e21647c5327e tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:42:31.548234 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-111c6d9c-feb6-4fb8-b1ad-e21647c5327e tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.136067 Nov 01 01:42:31.548785 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1061/2036] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:42:31 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:42:31.674402 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-c7e45298-d80c-4094-857b-35c8611bec68 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:42:31.675029 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-c7e45298-d80c-4094-857b-35c8611bec68 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:42:31.681712 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c7e45298-d80c-4094-857b-35c8611bec68 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:42:31.682148 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c7e45298-d80c-4094-857b-35c8611bec68 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:42:31.682928 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c7e45298-d80c-4094-857b-35c8611bec68 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:42:31.683383 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c7e45298-d80c-4094-857b-35c8611bec68 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:42:31.805357 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-c7e45298-d80c-4094-857b-35c8611bec68 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:42:31.812978 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-c7e45298-d80c-4094-857b-35c8611bec68 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1717 microversion: 2.1 time: 0.142326 Nov 01 01:42:31.813542 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 976/2037] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:42:31 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1717 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:42:32.565775 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-3f313565-f6bd-4dce-a4ef-46b9d06065c5 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:42:32.566408 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-3f313565-f6bd-4dce-a4ef-46b9d06065c5 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:42:32.572982 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3f313565-f6bd-4dce-a4ef-46b9d06065c5 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:42:32.573452 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3f313565-f6bd-4dce-a4ef-46b9d06065c5 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:42:32.574225 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3f313565-f6bd-4dce-a4ef-46b9d06065c5 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:42:32.574676 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3f313565-f6bd-4dce-a4ef-46b9d06065c5 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:42:32.692844 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-3f313565-f6bd-4dce-a4ef-46b9d06065c5 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:42:32.700550 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-3f313565-f6bd-4dce-a4ef-46b9d06065c5 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.139290 Nov 01 01:42:32.701133 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1062/2038] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:42:32 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:42:32.830383 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-78d7f0f2-c2c1-4eaa-8693-d6eae87dc26b tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:42:32.831021 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-78d7f0f2-c2c1-4eaa-8693-d6eae87dc26b tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:42:32.837770 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-78d7f0f2-c2c1-4eaa-8693-d6eae87dc26b tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:42:32.838211 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-78d7f0f2-c2c1-4eaa-8693-d6eae87dc26b tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:42:32.838998 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-78d7f0f2-c2c1-4eaa-8693-d6eae87dc26b tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:42:32.839429 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-78d7f0f2-c2c1-4eaa-8693-d6eae87dc26b tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:42:32.956756 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-78d7f0f2-c2c1-4eaa-8693-d6eae87dc26b tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:42:32.965121 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-78d7f0f2-c2c1-4eaa-8693-d6eae87dc26b tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1717 microversion: 2.1 time: 0.138614 Nov 01 01:42:32.965679 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 977/2039] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:42:32 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1717 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:42:33.717816 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-ce78e364-3cc0-41a6-96ae-956de7ce1479 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:42:33.718445 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-ce78e364-3cc0-41a6-96ae-956de7ce1479 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:42:33.725189 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ce78e364-3cc0-41a6-96ae-956de7ce1479 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:42:33.725628 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ce78e364-3cc0-41a6-96ae-956de7ce1479 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:42:33.726375 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ce78e364-3cc0-41a6-96ae-956de7ce1479 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:42:33.726825 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ce78e364-3cc0-41a6-96ae-956de7ce1479 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:42:33.848906 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-ce78e364-3cc0-41a6-96ae-956de7ce1479 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:42:33.856733 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-ce78e364-3cc0-41a6-96ae-956de7ce1479 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.142553 Nov 01 01:42:33.857296 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1063/2040] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:42:33 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:42:33.981950 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-a667709b-ea44-4ce2-91c5-90d013e2bf72 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:42:33.982518 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-a667709b-ea44-4ce2-91c5-90d013e2bf72 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:42:33.988946 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a667709b-ea44-4ce2-91c5-90d013e2bf72 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:42:33.989394 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a667709b-ea44-4ce2-91c5-90d013e2bf72 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:42:33.990163 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a667709b-ea44-4ce2-91c5-90d013e2bf72 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:42:33.990623 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a667709b-ea44-4ce2-91c5-90d013e2bf72 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:42:34.109122 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-a667709b-ea44-4ce2-91c5-90d013e2bf72 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:42:34.116994 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-a667709b-ea44-4ce2-91c5-90d013e2bf72 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1717 microversion: 2.1 time: 0.138842 Nov 01 01:42:34.118449 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 978/2041] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:42:33 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1717 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:42:34.874134 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-2c07ff00-2820-4f24-9969-684f30d1d15b tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:42:34.874751 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-2c07ff00-2820-4f24-9969-684f30d1d15b tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:42:34.881574 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-2c07ff00-2820-4f24-9969-684f30d1d15b tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:42:34.882021 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-2c07ff00-2820-4f24-9969-684f30d1d15b tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:42:34.882811 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-2c07ff00-2820-4f24-9969-684f30d1d15b tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:42:34.883239 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-2c07ff00-2820-4f24-9969-684f30d1d15b tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:42:34.999511 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-2c07ff00-2820-4f24-9969-684f30d1d15b tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:42:35.007803 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-2c07ff00-2820-4f24-9969-684f30d1d15b tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.137365 Nov 01 01:42:35.008368 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1064/2042] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:42:34 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:42:35.134048 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-eaa05902-7a05-44b6-8647-3f24e2cbf9ea tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:42:35.134609 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-eaa05902-7a05-44b6-8647-3f24e2cbf9ea tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:42:35.140907 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-eaa05902-7a05-44b6-8647-3f24e2cbf9ea tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:42:35.141343 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-eaa05902-7a05-44b6-8647-3f24e2cbf9ea tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:42:35.142106 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-eaa05902-7a05-44b6-8647-3f24e2cbf9ea tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:42:35.142583 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-eaa05902-7a05-44b6-8647-3f24e2cbf9ea tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:42:35.265322 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-eaa05902-7a05-44b6-8647-3f24e2cbf9ea tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:42:35.273056 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-eaa05902-7a05-44b6-8647-3f24e2cbf9ea tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1717 microversion: 2.1 time: 0.142749 Nov 01 01:42:35.273615 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 979/2043] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:42:35 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1717 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:42:36.024871 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-872f6cc9-3c53-4509-9bfd-89c07cacfa3e tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:42:36.025455 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-872f6cc9-3c53-4509-9bfd-89c07cacfa3e tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:42:36.031727 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-872f6cc9-3c53-4509-9bfd-89c07cacfa3e tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:42:36.032161 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-872f6cc9-3c53-4509-9bfd-89c07cacfa3e tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:42:36.032908 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-872f6cc9-3c53-4509-9bfd-89c07cacfa3e tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:42:36.033329 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-872f6cc9-3c53-4509-9bfd-89c07cacfa3e tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:42:36.153032 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-872f6cc9-3c53-4509-9bfd-89c07cacfa3e tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:42:36.160642 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-872f6cc9-3c53-4509-9bfd-89c07cacfa3e tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.139405 Nov 01 01:42:36.161184 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1065/2044] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:42:36 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:42:36.289468 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-b3b80fc1-54d2-4436-95e6-d2632a9859b4 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:42:36.289981 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-b3b80fc1-54d2-4436-95e6-d2632a9859b4 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:42:36.296239 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b3b80fc1-54d2-4436-95e6-d2632a9859b4 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:42:36.296678 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b3b80fc1-54d2-4436-95e6-d2632a9859b4 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:42:36.297433 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b3b80fc1-54d2-4436-95e6-d2632a9859b4 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:42:36.297861 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b3b80fc1-54d2-4436-95e6-d2632a9859b4 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:42:36.416239 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-b3b80fc1-54d2-4436-95e6-d2632a9859b4 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:42:36.423822 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-b3b80fc1-54d2-4436-95e6-d2632a9859b4 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1717 microversion: 2.1 time: 0.138056 Nov 01 01:42:36.426579 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 980/2045] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:42:36 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1717 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:42:37.177931 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-4599e75d-7136-4d93-973a-748c6bffe0b5 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:42:37.178570 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-4599e75d-7136-4d93-973a-748c6bffe0b5 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:42:37.184912 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4599e75d-7136-4d93-973a-748c6bffe0b5 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:42:37.185361 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4599e75d-7136-4d93-973a-748c6bffe0b5 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:42:37.186120 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4599e75d-7136-4d93-973a-748c6bffe0b5 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:42:37.186907 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4599e75d-7136-4d93-973a-748c6bffe0b5 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:42:37.309904 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-4599e75d-7136-4d93-973a-748c6bffe0b5 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:42:37.317548 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-4599e75d-7136-4d93-973a-748c6bffe0b5 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.143796 Nov 01 01:42:37.318103 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1066/2046] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:42:37 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:42:37.440965 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-39d7b74a-209c-41d6-910c-ab25075176be tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:42:37.441570 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-39d7b74a-209c-41d6-910c-ab25075176be tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:42:37.447957 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-39d7b74a-209c-41d6-910c-ab25075176be tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:42:37.448399 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-39d7b74a-209c-41d6-910c-ab25075176be tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:42:37.449155 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-39d7b74a-209c-41d6-910c-ab25075176be tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:42:37.449604 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-39d7b74a-209c-41d6-910c-ab25075176be tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:42:37.567095 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-39d7b74a-209c-41d6-910c-ab25075176be tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:42:37.574746 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-39d7b74a-209c-41d6-910c-ab25075176be tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1717 microversion: 2.1 time: 0.137348 Nov 01 01:42:37.575312 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 981/2047] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:42:37 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1717 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:42:38.334833 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-c97c3682-d5f6-4b11-9ad9-dc0a64563bfd tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:42:38.335443 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-c97c3682-d5f6-4b11-9ad9-dc0a64563bfd tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:42:38.341628 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c97c3682-d5f6-4b11-9ad9-dc0a64563bfd tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:42:38.342074 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c97c3682-d5f6-4b11-9ad9-dc0a64563bfd tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:42:38.342861 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c97c3682-d5f6-4b11-9ad9-dc0a64563bfd tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:42:38.343287 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c97c3682-d5f6-4b11-9ad9-dc0a64563bfd tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:42:38.460595 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-c97c3682-d5f6-4b11-9ad9-dc0a64563bfd tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:42:38.468463 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-c97c3682-d5f6-4b11-9ad9-dc0a64563bfd tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.137779 Nov 01 01:42:38.469026 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1067/2048] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:42:38 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:42:38.591499 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-aff2c374-39dd-486c-aad9-ff644fe25e91 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:42:38.592099 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-aff2c374-39dd-486c-aad9-ff644fe25e91 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:42:38.598198 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-aff2c374-39dd-486c-aad9-ff644fe25e91 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:42:38.598668 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-aff2c374-39dd-486c-aad9-ff644fe25e91 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:42:38.599412 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-aff2c374-39dd-486c-aad9-ff644fe25e91 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:42:38.600446 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-aff2c374-39dd-486c-aad9-ff644fe25e91 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:42:38.719591 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-aff2c374-39dd-486c-aad9-ff644fe25e91 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:42:38.727167 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-aff2c374-39dd-486c-aad9-ff644fe25e91 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1717 microversion: 2.1 time: 0.139359 Nov 01 01:42:38.727746 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 982/2049] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:42:38 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1717 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:42:39.484891 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-a82a2654-90c0-49d1-b6d3-3f2ca2b56479 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:42:39.485424 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-a82a2654-90c0-49d1-b6d3-3f2ca2b56479 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:42:39.491632 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a82a2654-90c0-49d1-b6d3-3f2ca2b56479 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:42:39.492663 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a82a2654-90c0-49d1-b6d3-3f2ca2b56479 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:42:39.493414 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a82a2654-90c0-49d1-b6d3-3f2ca2b56479 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:42:39.493836 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a82a2654-90c0-49d1-b6d3-3f2ca2b56479 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:42:39.616296 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-a82a2654-90c0-49d1-b6d3-3f2ca2b56479 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:42:39.624657 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-a82a2654-90c0-49d1-b6d3-3f2ca2b56479 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.143451 Nov 01 01:42:39.625208 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1068/2050] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:42:39 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:42:39.744547 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-4544f3da-de19-4857-9f08-6613762f40bd tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:42:39.745071 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-4544f3da-de19-4857-9f08-6613762f40bd tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:42:39.751261 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4544f3da-de19-4857-9f08-6613762f40bd tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:42:39.751700 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4544f3da-de19-4857-9f08-6613762f40bd tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:42:39.752455 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4544f3da-de19-4857-9f08-6613762f40bd tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:42:39.752881 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4544f3da-de19-4857-9f08-6613762f40bd tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:42:39.872385 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-4544f3da-de19-4857-9f08-6613762f40bd tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:42:39.880379 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-4544f3da-de19-4857-9f08-6613762f40bd tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1717 microversion: 2.1 time: 0.140253 Nov 01 01:42:39.880943 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 983/2051] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:42:39 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1717 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:42:40.640761 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-c6b4371c-9e59-4ecc-8596-1cd97a1192c0 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:42:40.641364 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-c6b4371c-9e59-4ecc-8596-1cd97a1192c0 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:42:40.647552 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c6b4371c-9e59-4ecc-8596-1cd97a1192c0 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:42:40.647993 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c6b4371c-9e59-4ecc-8596-1cd97a1192c0 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:42:40.648734 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c6b4371c-9e59-4ecc-8596-1cd97a1192c0 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:42:40.649157 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c6b4371c-9e59-4ecc-8596-1cd97a1192c0 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:42:40.770574 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-c6b4371c-9e59-4ecc-8596-1cd97a1192c0 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:42:40.778553 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-c6b4371c-9e59-4ecc-8596-1cd97a1192c0 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.141356 Nov 01 01:42:40.779192 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1069/2052] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:42:40 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:42:40.896761 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-58878e93-d882-43c4-8e6b-c38ea32b312d tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:42:40.897287 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-58878e93-d882-43c4-8e6b-c38ea32b312d tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:42:40.903609 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-58878e93-d882-43c4-8e6b-c38ea32b312d tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:42:40.904052 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-58878e93-d882-43c4-8e6b-c38ea32b312d tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:42:40.904844 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-58878e93-d882-43c4-8e6b-c38ea32b312d tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:42:40.905301 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-58878e93-d882-43c4-8e6b-c38ea32b312d tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:42:41.022627 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-58878e93-d882-43c4-8e6b-c38ea32b312d tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:42:41.030235 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-58878e93-d882-43c4-8e6b-c38ea32b312d tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1717 microversion: 2.1 time: 0.137255 Nov 01 01:42:41.030825 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 984/2053] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:42:40 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1717 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:42:41.794972 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-4788e2e7-f62d-4f7c-9b14-bc4fd38e913f tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:42:41.795574 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-4788e2e7-f62d-4f7c-9b14-bc4fd38e913f tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:42:41.801841 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4788e2e7-f62d-4f7c-9b14-bc4fd38e913f tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:42:41.802281 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4788e2e7-f62d-4f7c-9b14-bc4fd38e913f tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:42:41.803067 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4788e2e7-f62d-4f7c-9b14-bc4fd38e913f tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:42:41.803491 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4788e2e7-f62d-4f7c-9b14-bc4fd38e913f tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:42:41.920497 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-4788e2e7-f62d-4f7c-9b14-bc4fd38e913f tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:42:41.928447 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-4788e2e7-f62d-4f7c-9b14-bc4fd38e913f tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.137116 Nov 01 01:42:41.929002 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1070/2054] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:42:41 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:42:42.047667 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-510f76a2-2775-4445-aecc-1156c838dd57 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:42:42.048209 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-510f76a2-2775-4445-aecc-1156c838dd57 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:42:42.054311 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-510f76a2-2775-4445-aecc-1156c838dd57 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:42:42.054789 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-510f76a2-2775-4445-aecc-1156c838dd57 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:42:42.055919 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-510f76a2-2775-4445-aecc-1156c838dd57 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:42:42.056379 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-510f76a2-2775-4445-aecc-1156c838dd57 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:42:42.175930 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-510f76a2-2775-4445-aecc-1156c838dd57 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:42:42.183518 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-510f76a2-2775-4445-aecc-1156c838dd57 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1717 microversion: 2.1 time: 0.139532 Nov 01 01:42:42.184062 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 985/2055] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:42:42 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1717 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:42:42.945133 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-3a0c48a1-2c9a-4f6f-b108-3942f08d0e51 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:42:42.945848 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-3a0c48a1-2c9a-4f6f-b108-3942f08d0e51 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:42:42.952342 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3a0c48a1-2c9a-4f6f-b108-3942f08d0e51 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:42:42.952784 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3a0c48a1-2c9a-4f6f-b108-3942f08d0e51 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:42:42.953538 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3a0c48a1-2c9a-4f6f-b108-3942f08d0e51 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:42:42.953966 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3a0c48a1-2c9a-4f6f-b108-3942f08d0e51 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:42:43.070990 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-3a0c48a1-2c9a-4f6f-b108-3942f08d0e51 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:42:43.078916 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-3a0c48a1-2c9a-4f6f-b108-3942f08d0e51 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.137463 Nov 01 01:42:43.079478 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1071/2056] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:42:42 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:42:43.200522 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-fd08616c-859a-431b-94e0-dcb64b43ffcb tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:42:43.201056 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-fd08616c-859a-431b-94e0-dcb64b43ffcb tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:42:43.207562 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-fd08616c-859a-431b-94e0-dcb64b43ffcb tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:42:43.208013 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-fd08616c-859a-431b-94e0-dcb64b43ffcb tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:42:43.208769 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-fd08616c-859a-431b-94e0-dcb64b43ffcb tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:42:43.209194 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-fd08616c-859a-431b-94e0-dcb64b43ffcb tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:42:43.332039 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-fd08616c-859a-431b-94e0-dcb64b43ffcb tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:42:43.340374 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-fd08616c-859a-431b-94e0-dcb64b43ffcb tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1717 microversion: 2.1 time: 0.143552 Nov 01 01:42:43.340940 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 986/2057] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:42:43 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1717 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:42:44.096051 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-dfd1ddd5-dd67-47d8-a54d-e172f90bad04 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:42:44.096682 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-dfd1ddd5-dd67-47d8-a54d-e172f90bad04 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:42:44.103349 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-dfd1ddd5-dd67-47d8-a54d-e172f90bad04 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:42:44.103790 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-dfd1ddd5-dd67-47d8-a54d-e172f90bad04 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:42:44.104537 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-dfd1ddd5-dd67-47d8-a54d-e172f90bad04 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:42:44.104963 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-dfd1ddd5-dd67-47d8-a54d-e172f90bad04 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:42:44.236320 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-dfd1ddd5-dd67-47d8-a54d-e172f90bad04 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:42:44.246444 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-dfd1ddd5-dd67-47d8-a54d-e172f90bad04 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.153365 Nov 01 01:42:44.247008 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1072/2058] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:42:44 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:42:44.357269 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-94dff3f5-7b51-4cad-8cd4-b559d5e3cb1f tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:42:44.357795 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-94dff3f5-7b51-4cad-8cd4-b559d5e3cb1f tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:42:44.364181 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-94dff3f5-7b51-4cad-8cd4-b559d5e3cb1f tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:42:44.364658 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-94dff3f5-7b51-4cad-8cd4-b559d5e3cb1f tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:42:44.365422 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-94dff3f5-7b51-4cad-8cd4-b559d5e3cb1f tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:42:44.365851 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-94dff3f5-7b51-4cad-8cd4-b559d5e3cb1f tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:42:44.484833 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-94dff3f5-7b51-4cad-8cd4-b559d5e3cb1f tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:42:44.492602 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-94dff3f5-7b51-4cad-8cd4-b559d5e3cb1f tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1717 microversion: 2.1 time: 0.138993 Nov 01 01:42:44.493157 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 987/2059] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:42:44 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1717 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:42:45.265379 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-5878d039-74b9-4efe-8679-9b5fedaef0bc tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:42:45.265983 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-5878d039-74b9-4efe-8679-9b5fedaef0bc tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:42:45.272154 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-5878d039-74b9-4efe-8679-9b5fedaef0bc tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:42:45.273386 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-5878d039-74b9-4efe-8679-9b5fedaef0bc tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:42:45.273386 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-5878d039-74b9-4efe-8679-9b5fedaef0bc tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:42:45.273879 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-5878d039-74b9-4efe-8679-9b5fedaef0bc tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:42:45.393339 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-5878d039-74b9-4efe-8679-9b5fedaef0bc tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:42:45.401036 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-5878d039-74b9-4efe-8679-9b5fedaef0bc tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.139441 Nov 01 01:42:45.401593 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1073/2060] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:42:45 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:42:45.508529 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-b49b5f98-e52a-4ece-b85b-1431d38c6a01 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:42:45.509131 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-b49b5f98-e52a-4ece-b85b-1431d38c6a01 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:42:45.515215 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b49b5f98-e52a-4ece-b85b-1431d38c6a01 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:42:45.515706 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b49b5f98-e52a-4ece-b85b-1431d38c6a01 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:42:45.516405 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b49b5f98-e52a-4ece-b85b-1431d38c6a01 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:42:45.516826 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b49b5f98-e52a-4ece-b85b-1431d38c6a01 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:42:45.636811 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-b49b5f98-e52a-4ece-b85b-1431d38c6a01 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:42:45.644444 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-b49b5f98-e52a-4ece-b85b-1431d38c6a01 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1717 microversion: 2.1 time: 0.139526 Nov 01 01:42:45.645004 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 988/2061] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:42:45 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1717 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:42:46.417575 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-e570e2ca-6935-4053-ad54-4d37370cb166 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:42:46.418185 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-e570e2ca-6935-4053-ad54-4d37370cb166 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:42:46.424457 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e570e2ca-6935-4053-ad54-4d37370cb166 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:42:46.424900 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e570e2ca-6935-4053-ad54-4d37370cb166 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:42:46.425656 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e570e2ca-6935-4053-ad54-4d37370cb166 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:42:46.426086 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e570e2ca-6935-4053-ad54-4d37370cb166 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:42:46.544570 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-e570e2ca-6935-4053-ad54-4d37370cb166 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:42:46.552266 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-e570e2ca-6935-4053-ad54-4d37370cb166 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.138322 Nov 01 01:42:46.552737 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1074/2062] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:42:46 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:42:46.661593 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-fe283596-1743-40c7-ac5c-1532320f6b44 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:42:46.662126 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-fe283596-1743-40c7-ac5c-1532320f6b44 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:42:46.668359 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-fe283596-1743-40c7-ac5c-1532320f6b44 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:42:46.668804 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-fe283596-1743-40c7-ac5c-1532320f6b44 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:42:46.669561 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-fe283596-1743-40c7-ac5c-1532320f6b44 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:42:46.669991 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-fe283596-1743-40c7-ac5c-1532320f6b44 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:42:46.788700 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-fe283596-1743-40c7-ac5c-1532320f6b44 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:42:46.796330 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-fe283596-1743-40c7-ac5c-1532320f6b44 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1717 microversion: 2.1 time: 0.138526 Nov 01 01:42:46.796882 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 989/2063] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:42:46 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1717 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:42:47.569466 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-25ed3a27-8f37-4612-b24c-1f1623da06a9 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:42:47.570069 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-25ed3a27-8f37-4612-b24c-1f1623da06a9 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:42:47.577119 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-25ed3a27-8f37-4612-b24c-1f1623da06a9 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:42:47.577558 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-25ed3a27-8f37-4612-b24c-1f1623da06a9 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:42:47.578304 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-25ed3a27-8f37-4612-b24c-1f1623da06a9 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:42:47.578763 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-25ed3a27-8f37-4612-b24c-1f1623da06a9 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:42:47.704450 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-25ed3a27-8f37-4612-b24c-1f1623da06a9 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:42:47.712394 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-25ed3a27-8f37-4612-b24c-1f1623da06a9 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.146564 Nov 01 01:42:47.712963 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1075/2064] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:42:47 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:42:47.813321 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-cb372836-2a4a-4444-8d71-c694630173a5 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:42:47.813912 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-cb372836-2a4a-4444-8d71-c694630173a5 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:42:47.820126 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-cb372836-2a4a-4444-8d71-c694630173a5 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:42:47.820563 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-cb372836-2a4a-4444-8d71-c694630173a5 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:42:47.821312 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-cb372836-2a4a-4444-8d71-c694630173a5 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:42:47.821732 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-cb372836-2a4a-4444-8d71-c694630173a5 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:42:47.937829 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-cb372836-2a4a-4444-8d71-c694630173a5 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:42:47.945348 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-cb372836-2a4a-4444-8d71-c694630173a5 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1717 microversion: 2.1 time: 0.135613 Nov 01 01:42:47.945901 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 990/2065] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:42:47 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1717 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:42:48.728846 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-be8bb22e-1004-4d71-aceb-e91207e72a59 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:42:48.729453 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-be8bb22e-1004-4d71-aceb-e91207e72a59 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:42:48.735625 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-be8bb22e-1004-4d71-aceb-e91207e72a59 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:42:48.736096 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-be8bb22e-1004-4d71-aceb-e91207e72a59 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:42:48.736846 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-be8bb22e-1004-4d71-aceb-e91207e72a59 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:42:48.737269 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-be8bb22e-1004-4d71-aceb-e91207e72a59 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:42:48.854551 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-be8bb22e-1004-4d71-aceb-e91207e72a59 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:42:48.862189 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-be8bb22e-1004-4d71-aceb-e91207e72a59 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.136999 Nov 01 01:42:48.862781 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1076/2066] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:42:48 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:42:48.962204 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-ed0cb740-3c02-485d-b373-a58b031ccced tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:42:48.962837 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-ed0cb740-3c02-485d-b373-a58b031ccced tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:42:48.968948 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ed0cb740-3c02-485d-b373-a58b031ccced tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:42:48.969388 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ed0cb740-3c02-485d-b373-a58b031ccced tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:42:48.970139 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ed0cb740-3c02-485d-b373-a58b031ccced tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:42:48.970594 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ed0cb740-3c02-485d-b373-a58b031ccced tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:42:49.091457 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-ed0cb740-3c02-485d-b373-a58b031ccced tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:42:49.099102 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-ed0cb740-3c02-485d-b373-a58b031ccced tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1717 microversion: 2.1 time: 0.140490 Nov 01 01:42:49.099657 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 991/2067] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:42:48 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1717 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:42:49.879438 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-e5df973d-e632-407c-bcb7-9f7ebce665ab tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:42:49.880027 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-e5df973d-e632-407c-bcb7-9f7ebce665ab tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:42:49.886720 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e5df973d-e632-407c-bcb7-9f7ebce665ab tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:42:49.887164 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e5df973d-e632-407c-bcb7-9f7ebce665ab tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:42:49.887933 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e5df973d-e632-407c-bcb7-9f7ebce665ab tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:42:49.888355 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e5df973d-e632-407c-bcb7-9f7ebce665ab tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:42:50.007894 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-e5df973d-e632-407c-bcb7-9f7ebce665ab tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:42:50.016223 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-e5df973d-e632-407c-bcb7-9f7ebce665ab tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.140460 Nov 01 01:42:50.016789 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1077/2068] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:42:49 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:42:50.115839 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-ca8e487e-22fa-4b06-aa49-10bda0128854 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:42:50.116455 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-ca8e487e-22fa-4b06-aa49-10bda0128854 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:42:50.122727 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ca8e487e-22fa-4b06-aa49-10bda0128854 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:42:50.123176 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ca8e487e-22fa-4b06-aa49-10bda0128854 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:42:50.123943 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ca8e487e-22fa-4b06-aa49-10bda0128854 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:42:50.124382 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ca8e487e-22fa-4b06-aa49-10bda0128854 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:42:50.240473 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-ca8e487e-22fa-4b06-aa49-10bda0128854 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:42:50.248822 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-ca8e487e-22fa-4b06-aa49-10bda0128854 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1717 microversion: 2.1 time: 0.136659 Nov 01 01:42:50.249462 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 992/2069] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:42:50 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1717 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:42:51.032819 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-5aa6c07f-1bc3-44f4-92a8-2cc8b06dc94f tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:42:51.033426 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-5aa6c07f-1bc3-44f4-92a8-2cc8b06dc94f tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:42:51.039611 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-5aa6c07f-1bc3-44f4-92a8-2cc8b06dc94f tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:42:51.040615 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-5aa6c07f-1bc3-44f4-92a8-2cc8b06dc94f tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:42:51.041367 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-5aa6c07f-1bc3-44f4-92a8-2cc8b06dc94f tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:42:51.041794 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-5aa6c07f-1bc3-44f4-92a8-2cc8b06dc94f tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:42:51.163031 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-5aa6c07f-1bc3-44f4-92a8-2cc8b06dc94f tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:42:51.171251 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-5aa6c07f-1bc3-44f4-92a8-2cc8b06dc94f tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.142101 Nov 01 01:42:51.171815 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1078/2070] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:42:51 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:42:51.265526 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-8d29af58-7bc2-4b91-b5b9-ee46b86a6ba0 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:42:51.266128 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-8d29af58-7bc2-4b91-b5b9-ee46b86a6ba0 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:42:51.272285 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8d29af58-7bc2-4b91-b5b9-ee46b86a6ba0 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:42:51.272729 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8d29af58-7bc2-4b91-b5b9-ee46b86a6ba0 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:42:51.273484 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8d29af58-7bc2-4b91-b5b9-ee46b86a6ba0 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:42:51.273914 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8d29af58-7bc2-4b91-b5b9-ee46b86a6ba0 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:42:51.391794 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-8d29af58-7bc2-4b91-b5b9-ee46b86a6ba0 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:42:51.400123 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-8d29af58-7bc2-4b91-b5b9-ee46b86a6ba0 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1717 microversion: 2.1 time: 0.137565 Nov 01 01:42:51.400696 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 993/2071] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:42:51 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1717 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:42:52.187851 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-fccfce58-10d6-4dea-a828-9e88227b4f71 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:42:52.188457 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-fccfce58-10d6-4dea-a828-9e88227b4f71 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:42:52.194660 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-fccfce58-10d6-4dea-a828-9e88227b4f71 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:42:52.195100 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-fccfce58-10d6-4dea-a828-9e88227b4f71 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:42:52.195849 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-fccfce58-10d6-4dea-a828-9e88227b4f71 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:42:52.196789 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-fccfce58-10d6-4dea-a828-9e88227b4f71 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:42:52.312725 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-fccfce58-10d6-4dea-a828-9e88227b4f71 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:42:52.320304 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-fccfce58-10d6-4dea-a828-9e88227b4f71 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.136077 Nov 01 01:42:52.320862 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1079/2072] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:42:52 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:42:52.417161 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-46b06511-887d-4da5-9e41-6008ecf5b09f tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:42:52.417785 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-46b06511-887d-4da5-9e41-6008ecf5b09f tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:42:52.423963 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-46b06511-887d-4da5-9e41-6008ecf5b09f tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:42:52.424406 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-46b06511-887d-4da5-9e41-6008ecf5b09f tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:42:52.425162 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-46b06511-887d-4da5-9e41-6008ecf5b09f tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:42:52.425591 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-46b06511-887d-4da5-9e41-6008ecf5b09f tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:42:52.545407 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-46b06511-887d-4da5-9e41-6008ecf5b09f tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:42:52.553059 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-46b06511-887d-4da5-9e41-6008ecf5b09f tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1717 microversion: 2.1 time: 0.139736 Nov 01 01:42:52.553615 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 994/2073] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:42:52 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1717 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:42:53.338200 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-125559f5-e551-4ce4-93f5-f58060ce5f06 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:42:53.338840 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-125559f5-e551-4ce4-93f5-f58060ce5f06 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:42:53.345057 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-125559f5-e551-4ce4-93f5-f58060ce5f06 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:42:53.345494 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-125559f5-e551-4ce4-93f5-f58060ce5f06 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:42:53.346236 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-125559f5-e551-4ce4-93f5-f58060ce5f06 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:42:53.346680 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-125559f5-e551-4ce4-93f5-f58060ce5f06 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:42:53.465543 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-125559f5-e551-4ce4-93f5-f58060ce5f06 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:42:53.473150 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-125559f5-e551-4ce4-93f5-f58060ce5f06 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.139156 Nov 01 01:42:53.473703 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1080/2074] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:42:53 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:42:53.570231 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-52be86b9-a2f0-4bc2-b311-8e5cc9a8f66b tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:42:53.570876 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-52be86b9-a2f0-4bc2-b311-8e5cc9a8f66b tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:42:53.577334 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-52be86b9-a2f0-4bc2-b311-8e5cc9a8f66b tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:42:53.577781 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-52be86b9-a2f0-4bc2-b311-8e5cc9a8f66b tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:42:53.578582 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-52be86b9-a2f0-4bc2-b311-8e5cc9a8f66b tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:42:53.579018 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-52be86b9-a2f0-4bc2-b311-8e5cc9a8f66b tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:42:53.699463 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-52be86b9-a2f0-4bc2-b311-8e5cc9a8f66b tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:42:53.707735 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-52be86b9-a2f0-4bc2-b311-8e5cc9a8f66b tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1717 microversion: 2.1 time: 0.141240 Nov 01 01:42:53.708290 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 995/2075] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:42:53 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1717 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:42:54.490672 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-38bf95cb-d535-405d-957d-ae98b89847ca tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:42:54.491270 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-38bf95cb-d535-405d-957d-ae98b89847ca tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:42:54.498127 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-38bf95cb-d535-405d-957d-ae98b89847ca tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:42:54.498595 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-38bf95cb-d535-405d-957d-ae98b89847ca tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:42:54.499341 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-38bf95cb-d535-405d-957d-ae98b89847ca tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:42:54.499767 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-38bf95cb-d535-405d-957d-ae98b89847ca tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:42:54.619680 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-38bf95cb-d535-405d-957d-ae98b89847ca tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:42:54.627464 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-38bf95cb-d535-405d-957d-ae98b89847ca tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.140453 Nov 01 01:42:54.628022 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1081/2076] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:42:54 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:42:54.724985 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-6dc8de13-7e35-4156-93a3-814a194ae9f0 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:42:54.725585 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-6dc8de13-7e35-4156-93a3-814a194ae9f0 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:42:54.732448 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6dc8de13-7e35-4156-93a3-814a194ae9f0 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:42:54.732884 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6dc8de13-7e35-4156-93a3-814a194ae9f0 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:42:54.733637 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6dc8de13-7e35-4156-93a3-814a194ae9f0 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:42:54.734058 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6dc8de13-7e35-4156-93a3-814a194ae9f0 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:42:54.852210 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-6dc8de13-7e35-4156-93a3-814a194ae9f0 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:42:54.860522 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-6dc8de13-7e35-4156-93a3-814a194ae9f0 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1717 microversion: 2.1 time: 0.139191 Nov 01 01:42:54.861080 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 996/2077] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:42:54 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1717 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:42:55.644806 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-a3bf6bb8-58e1-45e6-ad15-8169e9d031ef tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:42:55.645336 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-a3bf6bb8-58e1-45e6-ad15-8169e9d031ef tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:42:55.651182 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a3bf6bb8-58e1-45e6-ad15-8169e9d031ef tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:42:55.651618 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a3bf6bb8-58e1-45e6-ad15-8169e9d031ef tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:42:55.652362 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a3bf6bb8-58e1-45e6-ad15-8169e9d031ef tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:42:55.652785 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a3bf6bb8-58e1-45e6-ad15-8169e9d031ef tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:42:55.775744 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-a3bf6bb8-58e1-45e6-ad15-8169e9d031ef tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:42:55.783347 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-a3bf6bb8-58e1-45e6-ad15-8169e9d031ef tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.142415 Nov 01 01:42:55.783932 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1082/2078] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:42:55 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:42:55.876721 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-a136a29e-e23d-4f29-bf4d-b1b5045df43b tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:42:55.877319 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-a136a29e-e23d-4f29-bf4d-b1b5045df43b tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:42:55.883136 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a136a29e-e23d-4f29-bf4d-b1b5045df43b tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:42:55.883576 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a136a29e-e23d-4f29-bf4d-b1b5045df43b tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:42:55.884323 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a136a29e-e23d-4f29-bf4d-b1b5045df43b tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:42:55.884746 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a136a29e-e23d-4f29-bf4d-b1b5045df43b tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:42:56.005137 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-a136a29e-e23d-4f29-bf4d-b1b5045df43b tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:42:56.012830 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-a136a29e-e23d-4f29-bf4d-b1b5045df43b tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1717 microversion: 2.1 time: 0.139663 Nov 01 01:42:56.013379 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 997/2079] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:42:55 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1717 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:42:56.799871 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-d9b45492-2e3e-4a6f-8e68-e94673b9eadd tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:42:56.800477 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-d9b45492-2e3e-4a6f-8e68-e94673b9eadd tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:42:56.806873 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d9b45492-2e3e-4a6f-8e68-e94673b9eadd tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:42:56.807325 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d9b45492-2e3e-4a6f-8e68-e94673b9eadd tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:42:56.808090 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d9b45492-2e3e-4a6f-8e68-e94673b9eadd tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:42:56.808552 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d9b45492-2e3e-4a6f-8e68-e94673b9eadd tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:42:56.925878 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-d9b45492-2e3e-4a6f-8e68-e94673b9eadd tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:42:56.933595 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-d9b45492-2e3e-4a6f-8e68-e94673b9eadd tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.137345 Nov 01 01:42:56.934162 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1083/2080] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:42:56 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:42:57.029393 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-2f641a6c-9deb-49d0-80bf-e9d629f4b9ad tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:42:57.030122 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-2f641a6c-9deb-49d0-80bf-e9d629f4b9ad tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:42:57.036300 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2f641a6c-9deb-49d0-80bf-e9d629f4b9ad tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:42:57.036743 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2f641a6c-9deb-49d0-80bf-e9d629f4b9ad tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:42:57.037506 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2f641a6c-9deb-49d0-80bf-e9d629f4b9ad tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:42:57.037933 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2f641a6c-9deb-49d0-80bf-e9d629f4b9ad tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:42:57.154826 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-2f641a6c-9deb-49d0-80bf-e9d629f4b9ad tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:42:57.162379 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-2f641a6c-9deb-49d0-80bf-e9d629f4b9ad tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1717 microversion: 2.1 time: 0.136612 Nov 01 01:42:57.162965 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 998/2081] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:42:57 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1717 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:42:57.949448 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-25b0740c-dae7-4446-8cae-a6e20f2cc9f4 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:42:57.950107 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-25b0740c-dae7-4446-8cae-a6e20f2cc9f4 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:42:57.956538 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-25b0740c-dae7-4446-8cae-a6e20f2cc9f4 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:42:57.956979 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-25b0740c-dae7-4446-8cae-a6e20f2cc9f4 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:42:57.957727 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-25b0740c-dae7-4446-8cae-a6e20f2cc9f4 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:42:57.958152 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-25b0740c-dae7-4446-8cae-a6e20f2cc9f4 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:42:58.081529 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-25b0740c-dae7-4446-8cae-a6e20f2cc9f4 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:42:58.089764 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-25b0740c-dae7-4446-8cae-a6e20f2cc9f4 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.144036 Nov 01 01:42:58.090347 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1084/2082] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:42:57 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:42:58.178923 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-453dd041-dac7-4d8f-9c7f-9479c0ce58cd tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:42:58.179538 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-453dd041-dac7-4d8f-9c7f-9479c0ce58cd tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:42:58.185699 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-453dd041-dac7-4d8f-9c7f-9479c0ce58cd tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:42:58.186143 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-453dd041-dac7-4d8f-9c7f-9479c0ce58cd tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:42:58.186929 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-453dd041-dac7-4d8f-9c7f-9479c0ce58cd tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:42:58.187359 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-453dd041-dac7-4d8f-9c7f-9479c0ce58cd tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:42:58.302539 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-453dd041-dac7-4d8f-9c7f-9479c0ce58cd tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:42:58.310149 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-453dd041-dac7-4d8f-9c7f-9479c0ce58cd tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1717 microversion: 2.1 time: 0.134824 Nov 01 01:42:58.310740 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 999/2083] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:42:58 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1717 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:42:59.106102 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-a73d6791-b79a-4634-9b15-3a0792e853ea tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:42:59.106735 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-a73d6791-b79a-4634-9b15-3a0792e853ea tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:42:59.112902 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a73d6791-b79a-4634-9b15-3a0792e853ea tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:42:59.113344 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a73d6791-b79a-4634-9b15-3a0792e853ea tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:42:59.114105 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a73d6791-b79a-4634-9b15-3a0792e853ea tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:42:59.114557 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a73d6791-b79a-4634-9b15-3a0792e853ea tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:42:59.234894 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-a73d6791-b79a-4634-9b15-3a0792e853ea tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:42:59.242449 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-a73d6791-b79a-4634-9b15-3a0792e853ea tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.140444 Nov 01 01:42:59.243588 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1085/2084] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:42:59 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:42:59.327355 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-85046dc5-1acc-4dfa-a2d3-9dfaa712086d tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:42:59.327954 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-85046dc5-1acc-4dfa-a2d3-9dfaa712086d tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:42:59.334103 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-85046dc5-1acc-4dfa-a2d3-9dfaa712086d tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:42:59.338797 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-85046dc5-1acc-4dfa-a2d3-9dfaa712086d tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:42:59.338797 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-85046dc5-1acc-4dfa-a2d3-9dfaa712086d tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:42:59.338797 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-85046dc5-1acc-4dfa-a2d3-9dfaa712086d tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:42:59.455605 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-85046dc5-1acc-4dfa-a2d3-9dfaa712086d tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:42:59.463667 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-85046dc5-1acc-4dfa-a2d3-9dfaa712086d tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1717 microversion: 2.1 time: 0.140273 Nov 01 01:42:59.464225 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1000/2085] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:42:59 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1717 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:43:00.260092 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-8ec47881-0b38-4822-bcd9-43a05cc41398 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:43:00.260692 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-8ec47881-0b38-4822-bcd9-43a05cc41398 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:43:00.266855 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8ec47881-0b38-4822-bcd9-43a05cc41398 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:00.267291 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8ec47881-0b38-4822-bcd9-43a05cc41398 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:00.268037 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8ec47881-0b38-4822-bcd9-43a05cc41398 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:00.268456 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8ec47881-0b38-4822-bcd9-43a05cc41398 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:00.386160 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-8ec47881-0b38-4822-bcd9-43a05cc41398 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:43:00.393925 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-8ec47881-0b38-4822-bcd9-43a05cc41398 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.138079 Nov 01 01:43:00.394497 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1086/2086] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:43:00 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:43:00.480523 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-95ff9100-7a58-4ff6-b9bb-7e33792f6a22 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:43:00.481131 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-95ff9100-7a58-4ff6-b9bb-7e33792f6a22 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:43:00.487454 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-95ff9100-7a58-4ff6-b9bb-7e33792f6a22 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:00.487902 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-95ff9100-7a58-4ff6-b9bb-7e33792f6a22 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:00.488697 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-95ff9100-7a58-4ff6-b9bb-7e33792f6a22 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:00.489126 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-95ff9100-7a58-4ff6-b9bb-7e33792f6a22 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:00.604996 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-95ff9100-7a58-4ff6-b9bb-7e33792f6a22 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:43:00.612711 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-95ff9100-7a58-4ff6-b9bb-7e33792f6a22 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1717 microversion: 2.1 time: 0.136279 Nov 01 01:43:00.613267 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1001/2087] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:43:00 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1717 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:43:01.410360 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-f999f6f7-ef64-425f-b21e-7f756b4fd8a6 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:43:01.411002 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-f999f6f7-ef64-425f-b21e-7f756b4fd8a6 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:43:01.417211 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f999f6f7-ef64-425f-b21e-7f756b4fd8a6 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:01.417650 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f999f6f7-ef64-425f-b21e-7f756b4fd8a6 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:01.418401 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f999f6f7-ef64-425f-b21e-7f756b4fd8a6 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:01.418855 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f999f6f7-ef64-425f-b21e-7f756b4fd8a6 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:01.538538 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-f999f6f7-ef64-425f-b21e-7f756b4fd8a6 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:43:01.546125 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-f999f6f7-ef64-425f-b21e-7f756b4fd8a6 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.139416 Nov 01 01:43:01.546729 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1087/2088] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:43:01 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:43:01.630006 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-4b66de3a-83fc-4911-8e53-53201c0bb22d tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:43:01.630638 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-4b66de3a-83fc-4911-8e53-53201c0bb22d tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:43:01.637438 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4b66de3a-83fc-4911-8e53-53201c0bb22d tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:01.637879 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4b66de3a-83fc-4911-8e53-53201c0bb22d tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:01.638664 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4b66de3a-83fc-4911-8e53-53201c0bb22d tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:01.639088 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4b66de3a-83fc-4911-8e53-53201c0bb22d tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:01.764399 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-4b66de3a-83fc-4911-8e53-53201c0bb22d tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:43:01.772046 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-4b66de3a-83fc-4911-8e53-53201c0bb22d tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1717 microversion: 2.1 time: 0.145685 Nov 01 01:43:01.772626 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1002/2089] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:43:01 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1717 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:43:02.563326 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-c14aca84-ee06-41ab-8d2f-5755de5805cd tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:43:02.563927 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-c14aca84-ee06-41ab-8d2f-5755de5805cd tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:43:02.570080 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c14aca84-ee06-41ab-8d2f-5755de5805cd tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:02.570554 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c14aca84-ee06-41ab-8d2f-5755de5805cd tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:02.571305 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c14aca84-ee06-41ab-8d2f-5755de5805cd tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:02.571729 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c14aca84-ee06-41ab-8d2f-5755de5805cd tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:02.692551 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-c14aca84-ee06-41ab-8d2f-5755de5805cd tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:43:02.701354 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-c14aca84-ee06-41ab-8d2f-5755de5805cd tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.141610 Nov 01 01:43:02.701926 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1088/2090] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:43:02 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:43:02.788717 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-96f378d6-fa43-4840-9098-f507978ad012 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:43:02.789364 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-96f378d6-fa43-4840-9098-f507978ad012 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:43:02.795592 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-96f378d6-fa43-4840-9098-f507978ad012 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:02.796041 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-96f378d6-fa43-4840-9098-f507978ad012 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:02.796804 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-96f378d6-fa43-4840-9098-f507978ad012 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:02.797240 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-96f378d6-fa43-4840-9098-f507978ad012 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:02.919436 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-96f378d6-fa43-4840-9098-f507978ad012 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:43:02.927161 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-96f378d6-fa43-4840-9098-f507978ad012 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1717 microversion: 2.1 time: 0.142105 Nov 01 01:43:02.927728 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1003/2091] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:43:02 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1717 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:43:03.717143 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-ff1dba7d-b852-49a0-9cb0-ee5b367a6d30 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:43:03.717743 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-ff1dba7d-b852-49a0-9cb0-ee5b367a6d30 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:43:03.723943 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ff1dba7d-b852-49a0-9cb0-ee5b367a6d30 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:03.724383 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ff1dba7d-b852-49a0-9cb0-ee5b367a6d30 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:03.725130 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ff1dba7d-b852-49a0-9cb0-ee5b367a6d30 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:03.725555 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ff1dba7d-b852-49a0-9cb0-ee5b367a6d30 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:03.849181 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-ff1dba7d-b852-49a0-9cb0-ee5b367a6d30 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:43:03.857553 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-ff1dba7d-b852-49a0-9cb0-ee5b367a6d30 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.144082 Nov 01 01:43:03.858123 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1089/2092] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:43:03 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:43:03.944286 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-232a8d18-8637-4bc8-b07e-bba218f758d5 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:43:03.944884 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-232a8d18-8637-4bc8-b07e-bba218f758d5 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:43:03.951652 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-232a8d18-8637-4bc8-b07e-bba218f758d5 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:03.952131 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-232a8d18-8637-4bc8-b07e-bba218f758d5 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:03.952896 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-232a8d18-8637-4bc8-b07e-bba218f758d5 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:03.953360 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-232a8d18-8637-4bc8-b07e-bba218f758d5 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:04.071119 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-232a8d18-8637-4bc8-b07e-bba218f758d5 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:43:04.079348 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-232a8d18-8637-4bc8-b07e-bba218f758d5 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1717 microversion: 2.1 time: 0.138662 Nov 01 01:43:04.079909 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1004/2093] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:43:03 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1717 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:43:04.874678 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-0ee83578-bf5c-4442-a784-f933f6b3893a tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:43:04.875198 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-0ee83578-bf5c-4442-a784-f933f6b3893a tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:43:04.881342 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0ee83578-bf5c-4442-a784-f933f6b3893a tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:04.881780 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0ee83578-bf5c-4442-a784-f933f6b3893a tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:04.882560 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0ee83578-bf5c-4442-a784-f933f6b3893a tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:04.882985 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0ee83578-bf5c-4442-a784-f933f6b3893a tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:05.003073 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-0ee83578-bf5c-4442-a784-f933f6b3893a tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:43:05.010713 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-0ee83578-bf5c-4442-a784-f933f6b3893a tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.139744 Nov 01 01:43:05.011365 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1090/2094] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:43:04 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:43:05.096535 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-d9495802-34e6-4fa8-b77d-7f5ea31258f0 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:43:05.097149 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-d9495802-34e6-4fa8-b77d-7f5ea31258f0 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:43:05.103335 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d9495802-34e6-4fa8-b77d-7f5ea31258f0 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:05.103786 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d9495802-34e6-4fa8-b77d-7f5ea31258f0 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:05.104553 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d9495802-34e6-4fa8-b77d-7f5ea31258f0 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:05.104987 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d9495802-34e6-4fa8-b77d-7f5ea31258f0 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:05.222973 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-d9495802-34e6-4fa8-b77d-7f5ea31258f0 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:43:05.230658 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-d9495802-34e6-4fa8-b77d-7f5ea31258f0 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1717 microversion: 2.1 time: 0.137738 Nov 01 01:43:05.231226 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1005/2095] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:43:05 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1717 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:43:06.028074 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-5cb26bc1-89e1-4a10-9af9-502edc05cf94 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:43:06.028684 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-5cb26bc1-89e1-4a10-9af9-502edc05cf94 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:43:06.034851 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-5cb26bc1-89e1-4a10-9af9-502edc05cf94 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:06.035289 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-5cb26bc1-89e1-4a10-9af9-502edc05cf94 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:06.036034 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-5cb26bc1-89e1-4a10-9af9-502edc05cf94 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:06.036454 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-5cb26bc1-89e1-4a10-9af9-502edc05cf94 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:06.156655 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-5cb26bc1-89e1-4a10-9af9-502edc05cf94 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:43:06.164261 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-5cb26bc1-89e1-4a10-9af9-502edc05cf94 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.140396 Nov 01 01:43:06.164824 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1091/2096] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:43:06 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:43:06.247269 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-ec279211-1c8a-497c-b239-b1f5abb8dfe0 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:43:06.247878 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-ec279211-1c8a-497c-b239-b1f5abb8dfe0 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:43:06.254106 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ec279211-1c8a-497c-b239-b1f5abb8dfe0 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:06.254586 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ec279211-1c8a-497c-b239-b1f5abb8dfe0 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:06.255350 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ec279211-1c8a-497c-b239-b1f5abb8dfe0 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:06.255774 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ec279211-1c8a-497c-b239-b1f5abb8dfe0 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:06.380340 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-ec279211-1c8a-497c-b239-b1f5abb8dfe0 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:43:06.385126 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-ec279211-1c8a-497c-b239-b1f5abb8dfe0 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1717 microversion: 2.1 time: 0.141403 Nov 01 01:43:06.386225 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1006/2097] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:43:06 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1717 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:43:07.181551 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-74d7b81f-5a1c-4455-b59b-0dfd9ae705f2 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:43:07.182152 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-74d7b81f-5a1c-4455-b59b-0dfd9ae705f2 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:43:07.188429 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-74d7b81f-5a1c-4455-b59b-0dfd9ae705f2 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:07.188865 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-74d7b81f-5a1c-4455-b59b-0dfd9ae705f2 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:07.189648 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-74d7b81f-5a1c-4455-b59b-0dfd9ae705f2 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:07.190070 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-74d7b81f-5a1c-4455-b59b-0dfd9ae705f2 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:07.309175 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-74d7b81f-5a1c-4455-b59b-0dfd9ae705f2 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:43:07.316782 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-74d7b81f-5a1c-4455-b59b-0dfd9ae705f2 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.138902 Nov 01 01:43:07.317342 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1092/2098] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:43:07 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:43:07.403014 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-54fa6afd-3ea1-47a1-9080-e532b7e5d525 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:43:07.407175 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-54fa6afd-3ea1-47a1-9080-e532b7e5d525 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:43:07.409806 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-54fa6afd-3ea1-47a1-9080-e532b7e5d525 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:07.410248 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-54fa6afd-3ea1-47a1-9080-e532b7e5d525 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:07.411041 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-54fa6afd-3ea1-47a1-9080-e532b7e5d525 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:07.411465 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-54fa6afd-3ea1-47a1-9080-e532b7e5d525 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:07.539950 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-54fa6afd-3ea1-47a1-9080-e532b7e5d525 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:43:07.547626 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-54fa6afd-3ea1-47a1-9080-e532b7e5d525 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1717 microversion: 2.1 time: 0.148865 Nov 01 01:43:07.548180 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1007/2099] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:43:07 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1717 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:43:08.333858 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-bb88c844-4331-4d7b-992c-eb193301fd0f tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:43:08.464717 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-bb88c844-4331-4d7b-992c-eb193301fd0f tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:43:08.464717 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-bb88c844-4331-4d7b-992c-eb193301fd0f tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:08.464717 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-bb88c844-4331-4d7b-992c-eb193301fd0f tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:08.464717 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-bb88c844-4331-4d7b-992c-eb193301fd0f tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:08.466372 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-bb88c844-4331-4d7b-992c-eb193301fd0f tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:08.480378 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-bb88c844-4331-4d7b-992c-eb193301fd0f tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:43:08.488188 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-bb88c844-4331-4d7b-992c-eb193301fd0f tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.158102 Nov 01 01:43:08.488786 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1093/2100] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:43:08 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:43:08.564084 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-11b05306-916a-4cb0-8abf-3d9120ca2847 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:43:08.564694 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-11b05306-916a-4cb0-8abf-3d9120ca2847 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:43:08.570867 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-11b05306-916a-4cb0-8abf-3d9120ca2847 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:08.571312 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-11b05306-916a-4cb0-8abf-3d9120ca2847 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:08.572082 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-11b05306-916a-4cb0-8abf-3d9120ca2847 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:08.572512 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-11b05306-916a-4cb0-8abf-3d9120ca2847 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:08.689790 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-11b05306-916a-4cb0-8abf-3d9120ca2847 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:43:08.697387 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-11b05306-916a-4cb0-8abf-3d9120ca2847 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1717 microversion: 2.1 time: 0.136909 Nov 01 01:43:08.697942 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1008/2101] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:43:08 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1717 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:43:09.504905 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-54981cdb-c212-4604-a3c9-f0f6169a7368 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:43:09.505440 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-54981cdb-c212-4604-a3c9-f0f6169a7368 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:43:09.511694 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-54981cdb-c212-4604-a3c9-f0f6169a7368 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:09.512132 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-54981cdb-c212-4604-a3c9-f0f6169a7368 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:09.512877 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-54981cdb-c212-4604-a3c9-f0f6169a7368 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:09.513298 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-54981cdb-c212-4604-a3c9-f0f6169a7368 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:09.631590 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-54981cdb-c212-4604-a3c9-f0f6169a7368 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:43:09.639246 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-54981cdb-c212-4604-a3c9-f0f6169a7368 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.138093 Nov 01 01:43:09.639806 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1094/2102] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:43:09 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:43:09.715189 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-03047e5d-5b30-4a31-93ff-1a4f2cdb7736 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:43:09.715817 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-03047e5d-5b30-4a31-93ff-1a4f2cdb7736 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:43:09.721976 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-03047e5d-5b30-4a31-93ff-1a4f2cdb7736 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:09.722442 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-03047e5d-5b30-4a31-93ff-1a4f2cdb7736 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:09.723201 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-03047e5d-5b30-4a31-93ff-1a4f2cdb7736 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:09.723632 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-03047e5d-5b30-4a31-93ff-1a4f2cdb7736 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:09.856961 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-03047e5d-5b30-4a31-93ff-1a4f2cdb7736 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:43:09.865015 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-03047e5d-5b30-4a31-93ff-1a4f2cdb7736 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1717 microversion: 2.1 time: 0.153978 Nov 01 01:43:09.865576 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1009/2103] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:43:09 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1717 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:43:10.655701 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-245844e5-fcd8-4afb-9590-274a10de934e tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:43:10.656310 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-245844e5-fcd8-4afb-9590-274a10de934e tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:43:10.662506 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-245844e5-fcd8-4afb-9590-274a10de934e tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:10.662956 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-245844e5-fcd8-4afb-9590-274a10de934e tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:10.663711 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-245844e5-fcd8-4afb-9590-274a10de934e tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:10.664142 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-245844e5-fcd8-4afb-9590-274a10de934e tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:10.789605 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-245844e5-fcd8-4afb-9590-274a10de934e tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:43:10.797969 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-245844e5-fcd8-4afb-9590-274a10de934e tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.145896 Nov 01 01:43:10.798558 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1095/2104] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:43:10 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:43:10.881710 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-0a76b53f-f4d7-45b2-9dc9-629859e04e3a tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:43:10.882279 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-0a76b53f-f4d7-45b2-9dc9-629859e04e3a tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:43:10.888455 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0a76b53f-f4d7-45b2-9dc9-629859e04e3a tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:10.888897 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0a76b53f-f4d7-45b2-9dc9-629859e04e3a tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:10.889653 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0a76b53f-f4d7-45b2-9dc9-629859e04e3a tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:10.890080 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0a76b53f-f4d7-45b2-9dc9-629859e04e3a tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:11.005895 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-0a76b53f-f4d7-45b2-9dc9-629859e04e3a tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:43:11.013599 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-0a76b53f-f4d7-45b2-9dc9-629859e04e3a tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1717 microversion: 2.1 time: 0.135578 Nov 01 01:43:11.014153 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1010/2105] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:43:10 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1717 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:43:11.814187 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-9b6141b4-0251-4e1e-b410-d4fd8807c8e4 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:43:11.814824 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-9b6141b4-0251-4e1e-b410-d4fd8807c8e4 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:43:11.821068 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9b6141b4-0251-4e1e-b410-d4fd8807c8e4 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:11.821516 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9b6141b4-0251-4e1e-b410-d4fd8807c8e4 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:11.822276 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9b6141b4-0251-4e1e-b410-d4fd8807c8e4 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:11.822743 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9b6141b4-0251-4e1e-b410-d4fd8807c8e4 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:11.944482 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-9b6141b4-0251-4e1e-b410-d4fd8807c8e4 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:43:11.952969 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-9b6141b4-0251-4e1e-b410-d4fd8807c8e4 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.142512 Nov 01 01:43:11.953526 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1096/2106] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:43:11 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:43:12.030116 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-95c16791-d21d-45cc-8089-545550f288ab tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:43:12.030749 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-95c16791-d21d-45cc-8089-545550f288ab tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:43:12.036939 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-95c16791-d21d-45cc-8089-545550f288ab tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:12.037387 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-95c16791-d21d-45cc-8089-545550f288ab tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:12.038151 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-95c16791-d21d-45cc-8089-545550f288ab tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:12.038771 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-95c16791-d21d-45cc-8089-545550f288ab tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:12.157086 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-95c16791-d21d-45cc-8089-545550f288ab tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:43:12.164684 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-95c16791-d21d-45cc-8089-545550f288ab tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1717 microversion: 2.1 time: 0.138289 Nov 01 01:43:12.165249 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1011/2107] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:43:12 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1717 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:43:12.969966 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-6363c28f-b274-4ae4-bbbb-95df61958b7c tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:43:12.970599 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-6363c28f-b274-4ae4-bbbb-95df61958b7c tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:43:12.976796 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-6363c28f-b274-4ae4-bbbb-95df61958b7c tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:12.977229 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-6363c28f-b274-4ae4-bbbb-95df61958b7c tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:12.977968 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-6363c28f-b274-4ae4-bbbb-95df61958b7c tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:12.978404 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-6363c28f-b274-4ae4-bbbb-95df61958b7c tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:13.096695 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-6363c28f-b274-4ae4-bbbb-95df61958b7c tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:43:13.104316 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-6363c28f-b274-4ae4-bbbb-95df61958b7c tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.137946 Nov 01 01:43:13.104882 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1097/2108] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:43:12 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:43:13.180672 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-c9ed0456-a1a0-4d7a-af58-77491e86e069 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:43:13.181310 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-c9ed0456-a1a0-4d7a-af58-77491e86e069 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:43:13.187586 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c9ed0456-a1a0-4d7a-af58-77491e86e069 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:13.188027 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c9ed0456-a1a0-4d7a-af58-77491e86e069 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:13.188781 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c9ed0456-a1a0-4d7a-af58-77491e86e069 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:13.189207 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c9ed0456-a1a0-4d7a-af58-77491e86e069 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:13.309121 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-c9ed0456-a1a0-4d7a-af58-77491e86e069 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:43:13.316883 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-c9ed0456-a1a0-4d7a-af58-77491e86e069 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1717 microversion: 2.1 time: 0.139859 Nov 01 01:43:13.317449 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1012/2109] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:43:13 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1717 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:43:14.122833 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-e3fe7152-87d2-4f27-972e-94ef1523e133 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:43:14.123713 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-e3fe7152-87d2-4f27-972e-94ef1523e133 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:43:14.130865 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e3fe7152-87d2-4f27-972e-94ef1523e133 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:14.131314 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e3fe7152-87d2-4f27-972e-94ef1523e133 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:14.132107 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e3fe7152-87d2-4f27-972e-94ef1523e133 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:14.132538 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e3fe7152-87d2-4f27-972e-94ef1523e133 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:14.252675 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-e3fe7152-87d2-4f27-972e-94ef1523e133 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:43:14.260271 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-e3fe7152-87d2-4f27-972e-94ef1523e133 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.143036 Nov 01 01:43:14.260844 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1098/2110] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:43:14 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:43:14.334167 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-7ba8bb5e-ec3a-4f1e-85ef-3037a0537092 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:43:14.334815 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-7ba8bb5e-ec3a-4f1e-85ef-3037a0537092 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:43:14.341563 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7ba8bb5e-ec3a-4f1e-85ef-3037a0537092 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:14.342011 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7ba8bb5e-ec3a-4f1e-85ef-3037a0537092 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:14.342804 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7ba8bb5e-ec3a-4f1e-85ef-3037a0537092 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:14.343236 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7ba8bb5e-ec3a-4f1e-85ef-3037a0537092 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:14.461284 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-7ba8bb5e-ec3a-4f1e-85ef-3037a0537092 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:43:14.469420 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-7ba8bb5e-ec3a-4f1e-85ef-3037a0537092 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1717 microversion: 2.1 time: 0.138896 Nov 01 01:43:14.469983 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1013/2111] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:43:14 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1717 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:43:15.276985 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-b9288b73-5561-4245-8818-337f1bf7abfe tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:43:15.277597 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-b9288b73-5561-4245-8818-337f1bf7abfe tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:43:15.283857 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b9288b73-5561-4245-8818-337f1bf7abfe tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:15.284300 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b9288b73-5561-4245-8818-337f1bf7abfe tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:15.285053 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b9288b73-5561-4245-8818-337f1bf7abfe tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:15.285480 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b9288b73-5561-4245-8818-337f1bf7abfe tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:15.410918 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-b9288b73-5561-4245-8818-337f1bf7abfe tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:43:15.419063 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-b9288b73-5561-4245-8818-337f1bf7abfe tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.145932 Nov 01 01:43:15.419618 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1099/2112] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:43:15 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:43:15.485935 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-28afb2f9-3422-4975-ad33-fd4bfdb8fdd5 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:43:15.486557 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-28afb2f9-3422-4975-ad33-fd4bfdb8fdd5 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:43:15.492735 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-28afb2f9-3422-4975-ad33-fd4bfdb8fdd5 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:15.493179 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-28afb2f9-3422-4975-ad33-fd4bfdb8fdd5 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:15.493933 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-28afb2f9-3422-4975-ad33-fd4bfdb8fdd5 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:15.494360 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-28afb2f9-3422-4975-ad33-fd4bfdb8fdd5 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:15.611593 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-28afb2f9-3422-4975-ad33-fd4bfdb8fdd5 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:43:15.619143 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-28afb2f9-3422-4975-ad33-fd4bfdb8fdd5 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1717 microversion: 2.1 time: 0.136837 Nov 01 01:43:15.620291 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1014/2113] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:43:15 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1717 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:43:16.435012 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-07a4c205-a58a-484e-bd56-cb099ebb0f29 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:43:16.435610 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-07a4c205-a58a-484e-bd56-cb099ebb0f29 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:43:16.441742 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-07a4c205-a58a-484e-bd56-cb099ebb0f29 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:16.442184 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-07a4c205-a58a-484e-bd56-cb099ebb0f29 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:16.443024 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-07a4c205-a58a-484e-bd56-cb099ebb0f29 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:16.443450 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-07a4c205-a58a-484e-bd56-cb099ebb0f29 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:16.561023 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-07a4c205-a58a-484e-bd56-cb099ebb0f29 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:43:16.568661 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-07a4c205-a58a-484e-bd56-cb099ebb0f29 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.137351 Nov 01 01:43:16.569222 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1100/2114] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:43:16 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:43:16.636413 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-8cd05b05-a0aa-4bc7-84bc-1092dcaf641a tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:43:16.636946 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-8cd05b05-a0aa-4bc7-84bc-1092dcaf641a tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:43:16.643067 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8cd05b05-a0aa-4bc7-84bc-1092dcaf641a tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:16.643505 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8cd05b05-a0aa-4bc7-84bc-1092dcaf641a tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:16.644253 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8cd05b05-a0aa-4bc7-84bc-1092dcaf641a tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:16.644676 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8cd05b05-a0aa-4bc7-84bc-1092dcaf641a tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:16.764034 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-8cd05b05-a0aa-4bc7-84bc-1092dcaf641a tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:43:16.771677 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-8cd05b05-a0aa-4bc7-84bc-1092dcaf641a tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1717 microversion: 2.1 time: 0.138933 Nov 01 01:43:16.772233 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1015/2115] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:43:16 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1717 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:43:17.586071 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-3e9bb208-5266-4e86-97dc-5bee7765edd6 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:43:17.586696 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-3e9bb208-5266-4e86-97dc-5bee7765edd6 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:43:17.593389 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3e9bb208-5266-4e86-97dc-5bee7765edd6 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:17.593828 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3e9bb208-5266-4e86-97dc-5bee7765edd6 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:17.594606 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3e9bb208-5266-4e86-97dc-5bee7765edd6 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:17.595029 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3e9bb208-5266-4e86-97dc-5bee7765edd6 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:17.712258 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-3e9bb208-5266-4e86-97dc-5bee7765edd6 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:43:17.720408 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-3e9bb208-5266-4e86-97dc-5bee7765edd6 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.138002 Nov 01 01:43:17.720967 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1101/2116] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:43:17 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:43:17.788875 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-fae00f33-82be-409e-b8b8-986d0e1276d6 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:43:17.789506 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-fae00f33-82be-409e-b8b8-986d0e1276d6 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:43:17.796275 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-fae00f33-82be-409e-b8b8-986d0e1276d6 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:17.796746 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-fae00f33-82be-409e-b8b8-986d0e1276d6 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:17.797531 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-fae00f33-82be-409e-b8b8-986d0e1276d6 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:17.797955 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-fae00f33-82be-409e-b8b8-986d0e1276d6 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:17.915774 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-fae00f33-82be-409e-b8b8-986d0e1276d6 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:43:17.924054 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-fae00f33-82be-409e-b8b8-986d0e1276d6 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1717 microversion: 2.1 time: 0.138767 Nov 01 01:43:17.924567 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1016/2117] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:43:17 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1717 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:43:18.737444 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-c38ee41a-6e05-4ffe-a7ea-ee76ff9d4f58 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:43:18.738058 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-c38ee41a-6e05-4ffe-a7ea-ee76ff9d4f58 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:43:18.744304 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c38ee41a-6e05-4ffe-a7ea-ee76ff9d4f58 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:18.744750 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c38ee41a-6e05-4ffe-a7ea-ee76ff9d4f58 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:18.745508 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c38ee41a-6e05-4ffe-a7ea-ee76ff9d4f58 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:18.745938 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c38ee41a-6e05-4ffe-a7ea-ee76ff9d4f58 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:18.866633 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-c38ee41a-6e05-4ffe-a7ea-ee76ff9d4f58 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:43:18.875040 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-c38ee41a-6e05-4ffe-a7ea-ee76ff9d4f58 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.141320 Nov 01 01:43:18.875602 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1102/2118] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:43:18 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:43:18.940768 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-0eda511e-2941-4895-b3c0-d5f81d3a2ea3 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:43:18.941375 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-0eda511e-2941-4895-b3c0-d5f81d3a2ea3 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:43:18.947662 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0eda511e-2941-4895-b3c0-d5f81d3a2ea3 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:18.948108 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0eda511e-2941-4895-b3c0-d5f81d3a2ea3 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:18.948870 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0eda511e-2941-4895-b3c0-d5f81d3a2ea3 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:18.949366 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0eda511e-2941-4895-b3c0-d5f81d3a2ea3 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:19.067195 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-0eda511e-2941-4895-b3c0-d5f81d3a2ea3 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:43:19.074871 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-0eda511e-2941-4895-b3c0-d5f81d3a2ea3 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1717 microversion: 2.1 time: 0.137735 Nov 01 01:43:19.075689 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1017/2119] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:43:18 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1717 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:43:19.892273 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-1d63e14c-7e8c-451d-89bf-9db0301705fc tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:43:19.892883 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-1d63e14c-7e8c-451d-89bf-9db0301705fc tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:43:19.899180 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-1d63e14c-7e8c-451d-89bf-9db0301705fc tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:19.899624 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-1d63e14c-7e8c-451d-89bf-9db0301705fc tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:19.900382 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-1d63e14c-7e8c-451d-89bf-9db0301705fc tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:19.900814 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-1d63e14c-7e8c-451d-89bf-9db0301705fc tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:20.020515 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-1d63e14c-7e8c-451d-89bf-9db0301705fc tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:43:20.029882 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-1d63e14c-7e8c-451d-89bf-9db0301705fc tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.141280 Nov 01 01:43:20.030455 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1103/2120] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:43:19 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:43:20.091748 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-19f4588e-7372-4474-a7dd-78d71f021fe7 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:43:20.092345 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-19f4588e-7372-4474-a7dd-78d71f021fe7 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:43:20.098508 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-19f4588e-7372-4474-a7dd-78d71f021fe7 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:20.098950 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-19f4588e-7372-4474-a7dd-78d71f021fe7 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:20.099731 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-19f4588e-7372-4474-a7dd-78d71f021fe7 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:20.100155 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-19f4588e-7372-4474-a7dd-78d71f021fe7 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:20.220103 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-19f4588e-7372-4474-a7dd-78d71f021fe7 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:43:20.227732 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-19f4588e-7372-4474-a7dd-78d71f021fe7 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1717 microversion: 2.1 time: 0.139585 Nov 01 01:43:20.228285 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1018/2121] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:43:20 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1717 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:43:21.045989 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-c4950aa2-0ac6-4ba7-89b5-f8285af046ee tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:43:21.046628 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-c4950aa2-0ac6-4ba7-89b5-f8285af046ee tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:43:21.052815 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c4950aa2-0ac6-4ba7-89b5-f8285af046ee tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:21.053250 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c4950aa2-0ac6-4ba7-89b5-f8285af046ee tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:21.054012 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c4950aa2-0ac6-4ba7-89b5-f8285af046ee tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:21.054456 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c4950aa2-0ac6-4ba7-89b5-f8285af046ee tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:21.172463 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-c4950aa2-0ac6-4ba7-89b5-f8285af046ee tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:43:21.180031 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-c4950aa2-0ac6-4ba7-89b5-f8285af046ee tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.137640 Nov 01 01:43:21.180588 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1104/2122] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:43:21 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:43:21.244806 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-edbbb871-4b72-4464-bca3-9830f4fcb3e9 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:43:21.245419 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-edbbb871-4b72-4464-bca3-9830f4fcb3e9 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:43:21.251626 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-edbbb871-4b72-4464-bca3-9830f4fcb3e9 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:21.252076 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-edbbb871-4b72-4464-bca3-9830f4fcb3e9 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:21.252838 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-edbbb871-4b72-4464-bca3-9830f4fcb3e9 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:21.253267 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-edbbb871-4b72-4464-bca3-9830f4fcb3e9 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:21.370644 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-edbbb871-4b72-4464-bca3-9830f4fcb3e9 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:43:21.378844 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-edbbb871-4b72-4464-bca3-9830f4fcb3e9 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1717 microversion: 2.1 time: 0.137643 Nov 01 01:43:21.379404 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1019/2123] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:43:21 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1717 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:43:22.196557 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-7eb254d7-8c6a-4129-8f4e-2443bed40d51 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:43:22.197196 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-7eb254d7-8c6a-4129-8f4e-2443bed40d51 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:43:22.203639 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-7eb254d7-8c6a-4129-8f4e-2443bed40d51 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:22.204082 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-7eb254d7-8c6a-4129-8f4e-2443bed40d51 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:22.204835 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-7eb254d7-8c6a-4129-8f4e-2443bed40d51 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:22.205261 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-7eb254d7-8c6a-4129-8f4e-2443bed40d51 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:22.326619 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-7eb254d7-8c6a-4129-8f4e-2443bed40d51 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:43:22.334344 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-7eb254d7-8c6a-4129-8f4e-2443bed40d51 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.141354 Nov 01 01:43:22.334884 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1105/2124] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:43:22 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:43:22.396127 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-c868e1b7-771c-4ee4-85db-8807c6067b67 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:43:22.396768 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-c868e1b7-771c-4ee4-85db-8807c6067b67 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:43:22.403554 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c868e1b7-771c-4ee4-85db-8807c6067b67 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:22.404002 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c868e1b7-771c-4ee4-85db-8807c6067b67 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:22.404760 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c868e1b7-771c-4ee4-85db-8807c6067b67 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:22.405196 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c868e1b7-771c-4ee4-85db-8807c6067b67 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:22.524825 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-c868e1b7-771c-4ee4-85db-8807c6067b67 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:43:22.533124 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-c868e1b7-771c-4ee4-85db-8807c6067b67 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1717 microversion: 2.1 time: 0.140704 Nov 01 01:43:22.533683 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1020/2125] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:43:22 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1717 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:43:23.351560 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-b05ab48f-bbe7-4f51-82a7-0423f2cc4727 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:43:23.352203 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-b05ab48f-bbe7-4f51-82a7-0423f2cc4727 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:43:23.358938 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b05ab48f-bbe7-4f51-82a7-0423f2cc4727 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:23.359405 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b05ab48f-bbe7-4f51-82a7-0423f2cc4727 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:23.360151 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b05ab48f-bbe7-4f51-82a7-0423f2cc4727 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:23.360579 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b05ab48f-bbe7-4f51-82a7-0423f2cc4727 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:23.477500 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-b05ab48f-bbe7-4f51-82a7-0423f2cc4727 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:43:23.485638 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-b05ab48f-bbe7-4f51-82a7-0423f2cc4727 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.137717 Nov 01 01:43:23.486201 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1106/2126] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:43:23 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:43:23.550296 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-dd7c634f-dbc8-472c-b14c-2c1144cdbd3c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:43:23.550939 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-dd7c634f-dbc8-472c-b14c-2c1144cdbd3c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:43:23.557210 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-dd7c634f-dbc8-472c-b14c-2c1144cdbd3c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:23.557648 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-dd7c634f-dbc8-472c-b14c-2c1144cdbd3c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:23.558400 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-dd7c634f-dbc8-472c-b14c-2c1144cdbd3c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:23.558845 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-dd7c634f-dbc8-472c-b14c-2c1144cdbd3c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:23.677489 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-dd7c634f-dbc8-472c-b14c-2c1144cdbd3c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:43:23.685204 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-dd7c634f-dbc8-472c-b14c-2c1144cdbd3c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1717 microversion: 2.1 time: 0.138611 Nov 01 01:43:23.685759 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1021/2127] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:43:23 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1717 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:43:24.503314 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-8045ff62-20c9-4477-b261-51e5e1390b2f tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:43:24.503952 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-8045ff62-20c9-4477-b261-51e5e1390b2f tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:43:24.510042 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8045ff62-20c9-4477-b261-51e5e1390b2f tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:24.510511 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8045ff62-20c9-4477-b261-51e5e1390b2f tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:24.511264 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8045ff62-20c9-4477-b261-51e5e1390b2f tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:24.511690 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8045ff62-20c9-4477-b261-51e5e1390b2f tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:24.629971 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-8045ff62-20c9-4477-b261-51e5e1390b2f tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:43:24.638263 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-8045ff62-20c9-4477-b261-51e5e1390b2f tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.137903 Nov 01 01:43:24.638853 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1107/2128] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:43:24 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:43:24.702165 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-31c437b1-52db-4930-b515-db53a6fc7518 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:43:24.702804 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-31c437b1-52db-4930-b515-db53a6fc7518 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:43:24.709013 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-31c437b1-52db-4930-b515-db53a6fc7518 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:24.709469 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-31c437b1-52db-4930-b515-db53a6fc7518 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:24.710235 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-31c437b1-52db-4930-b515-db53a6fc7518 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:24.710707 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-31c437b1-52db-4930-b515-db53a6fc7518 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:24.827914 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-31c437b1-52db-4930-b515-db53a6fc7518 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:43:24.835572 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-31c437b1-52db-4930-b515-db53a6fc7518 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1717 microversion: 2.1 time: 0.137328 Nov 01 01:43:24.836140 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1022/2129] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:43:24 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1717 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:43:25.655416 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-32b1eea3-feaa-40d5-aad8-e069d3368ead tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:43:25.655946 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-32b1eea3-feaa-40d5-aad8-e069d3368ead tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:43:25.661695 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-32b1eea3-feaa-40d5-aad8-e069d3368ead tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:25.662130 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-32b1eea3-feaa-40d5-aad8-e069d3368ead tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:25.662906 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-32b1eea3-feaa-40d5-aad8-e069d3368ead tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:25.663331 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-32b1eea3-feaa-40d5-aad8-e069d3368ead tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:25.784249 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-32b1eea3-feaa-40d5-aad8-e069d3368ead tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:43:25.793015 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-32b1eea3-feaa-40d5-aad8-e069d3368ead tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.142028 Nov 01 01:43:25.793592 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1108/2130] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:43:25 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:43:25.852167 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-7c69a1ad-5067-4ea6-b0e5-8a6310bce399 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:43:25.852761 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-7c69a1ad-5067-4ea6-b0e5-8a6310bce399 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:43:25.858664 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7c69a1ad-5067-4ea6-b0e5-8a6310bce399 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:25.859103 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7c69a1ad-5067-4ea6-b0e5-8a6310bce399 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:25.859850 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7c69a1ad-5067-4ea6-b0e5-8a6310bce399 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:25.860294 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7c69a1ad-5067-4ea6-b0e5-8a6310bce399 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:25.976776 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-7c69a1ad-5067-4ea6-b0e5-8a6310bce399 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:43:25.984283 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-7c69a1ad-5067-4ea6-b0e5-8a6310bce399 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1717 microversion: 2.1 time: 0.135742 Nov 01 01:43:25.984840 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1023/2131] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:43:25 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1717 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:43:26.810206 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-a06d48da-b4a2-4c29-bf74-292512a37b23 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:43:26.810920 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-a06d48da-b4a2-4c29-bf74-292512a37b23 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:43:26.817141 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a06d48da-b4a2-4c29-bf74-292512a37b23 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:26.817589 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a06d48da-b4a2-4c29-bf74-292512a37b23 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:26.818338 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a06d48da-b4a2-4c29-bf74-292512a37b23 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:26.818791 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a06d48da-b4a2-4c29-bf74-292512a37b23 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:26.935200 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-a06d48da-b4a2-4c29-bf74-292512a37b23 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:43:26.942906 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-a06d48da-b4a2-4c29-bf74-292512a37b23 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.136354 Nov 01 01:43:26.943464 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1109/2132] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:43:26 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:43:27.000718 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-8aa4ea77-6abb-4d96-bbf3-a6796f88cda5 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:43:27.001334 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-8aa4ea77-6abb-4d96-bbf3-a6796f88cda5 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:43:27.007619 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8aa4ea77-6abb-4d96-bbf3-a6796f88cda5 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:27.008064 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8aa4ea77-6abb-4d96-bbf3-a6796f88cda5 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:27.008822 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8aa4ea77-6abb-4d96-bbf3-a6796f88cda5 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:27.009252 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8aa4ea77-6abb-4d96-bbf3-a6796f88cda5 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:27.129492 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-8aa4ea77-6abb-4d96-bbf3-a6796f88cda5 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:43:27.137139 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-8aa4ea77-6abb-4d96-bbf3-a6796f88cda5 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1717 microversion: 2.1 time: 0.140065 Nov 01 01:43:27.138199 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1024/2133] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:43:26 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1717 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:43:27.959954 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-cd526e2c-82e9-42cb-a3b2-3437194bc056 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:43:27.960555 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-cd526e2c-82e9-42cb-a3b2-3437194bc056 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:43:27.967017 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-cd526e2c-82e9-42cb-a3b2-3437194bc056 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:27.967456 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-cd526e2c-82e9-42cb-a3b2-3437194bc056 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:27.968201 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-cd526e2c-82e9-42cb-a3b2-3437194bc056 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:27.968630 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-cd526e2c-82e9-42cb-a3b2-3437194bc056 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:28.085239 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-cd526e2c-82e9-42cb-a3b2-3437194bc056 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:43:28.093369 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-cd526e2c-82e9-42cb-a3b2-3437194bc056 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.137076 Nov 01 01:43:28.093921 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1110/2134] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:43:27 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:43:28.154774 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-e2796db6-cc54-46a7-83b7-31ca46973d7d tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:43:28.155385 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-e2796db6-cc54-46a7-83b7-31ca46973d7d tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:43:28.161659 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e2796db6-cc54-46a7-83b7-31ca46973d7d tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:28.162116 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e2796db6-cc54-46a7-83b7-31ca46973d7d tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:28.162914 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e2796db6-cc54-46a7-83b7-31ca46973d7d tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:28.163346 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e2796db6-cc54-46a7-83b7-31ca46973d7d tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:28.279678 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-e2796db6-cc54-46a7-83b7-31ca46973d7d tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:43:28.287346 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-e2796db6-cc54-46a7-83b7-31ca46973d7d tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1717 microversion: 2.1 time: 0.136699 Nov 01 01:43:28.287913 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1025/2135] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:43:28 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1717 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:43:29.110035 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-f4e12dd2-c5c9-4765-8102-0c47f818be07 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:43:29.110657 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-f4e12dd2-c5c9-4765-8102-0c47f818be07 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:43:29.116915 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f4e12dd2-c5c9-4765-8102-0c47f818be07 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:29.117361 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f4e12dd2-c5c9-4765-8102-0c47f818be07 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:29.118112 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f4e12dd2-c5c9-4765-8102-0c47f818be07 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:29.118577 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f4e12dd2-c5c9-4765-8102-0c47f818be07 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:29.249821 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-f4e12dd2-c5c9-4765-8102-0c47f818be07 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:43:29.257793 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-f4e12dd2-c5c9-4765-8102-0c47f818be07 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.151358 Nov 01 01:43:29.258343 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1111/2136] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:43:29 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:43:29.304534 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-979aacf7-9ffb-41a7-9a0e-9f0b99c36f12 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:43:29.305138 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-979aacf7-9ffb-41a7-9a0e-9f0b99c36f12 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:43:29.312360 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-979aacf7-9ffb-41a7-9a0e-9f0b99c36f12 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:29.312832 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-979aacf7-9ffb-41a7-9a0e-9f0b99c36f12 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:29.313596 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-979aacf7-9ffb-41a7-9a0e-9f0b99c36f12 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:29.314025 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-979aacf7-9ffb-41a7-9a0e-9f0b99c36f12 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:29.431426 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-979aacf7-9ffb-41a7-9a0e-9f0b99c36f12 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:43:29.439681 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-979aacf7-9ffb-41a7-9a0e-9f0b99c36f12 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1717 microversion: 2.1 time: 0.138715 Nov 01 01:43:29.440242 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1026/2137] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:43:29 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1717 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:43:30.273560 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-14d9e8ae-9833-4064-bb86-1d410d647f7c tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:43:30.274157 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-14d9e8ae-9833-4064-bb86-1d410d647f7c tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:43:30.281101 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-14d9e8ae-9833-4064-bb86-1d410d647f7c tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:30.281484 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-14d9e8ae-9833-4064-bb86-1d410d647f7c tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:30.282227 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-14d9e8ae-9833-4064-bb86-1d410d647f7c tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:30.282677 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-14d9e8ae-9833-4064-bb86-1d410d647f7c tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:30.402094 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-14d9e8ae-9833-4064-bb86-1d410d647f7c tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:43:30.409739 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-14d9e8ae-9833-4064-bb86-1d410d647f7c tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.139878 Nov 01 01:43:30.410298 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1112/2138] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:43:30 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:43:30.457936 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-9a043796-47bb-4f13-8cf4-705e9c6102ea tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:43:30.458595 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-9a043796-47bb-4f13-8cf4-705e9c6102ea tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:43:30.466416 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9a043796-47bb-4f13-8cf4-705e9c6102ea tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:30.466894 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9a043796-47bb-4f13-8cf4-705e9c6102ea tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:30.467663 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9a043796-47bb-4f13-8cf4-705e9c6102ea tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:30.468091 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9a043796-47bb-4f13-8cf4-705e9c6102ea tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:30.589621 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-9a043796-47bb-4f13-8cf4-705e9c6102ea tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:43:30.597291 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-9a043796-47bb-4f13-8cf4-705e9c6102ea tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1717 microversion: 2.1 time: 0.144091 Nov 01 01:43:30.597849 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1027/2139] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:43:30 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1717 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:43:31.426538 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-e9878fca-192a-44dd-9e1d-e90a926aa58f tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:43:31.427138 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-e9878fca-192a-44dd-9e1d-e90a926aa58f tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:43:31.433320 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e9878fca-192a-44dd-9e1d-e90a926aa58f tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:31.433756 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e9878fca-192a-44dd-9e1d-e90a926aa58f tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:31.435152 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e9878fca-192a-44dd-9e1d-e90a926aa58f tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:31.435578 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e9878fca-192a-44dd-9e1d-e90a926aa58f tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:31.552981 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-e9878fca-192a-44dd-9e1d-e90a926aa58f tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:43:31.561210 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-e9878fca-192a-44dd-9e1d-e90a926aa58f tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.138306 Nov 01 01:43:31.561766 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1113/2140] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:43:31 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:43:31.613307 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-f85ee0af-a000-4a2d-a50c-3c762dd94474 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:43:31.613905 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-f85ee0af-a000-4a2d-a50c-3c762dd94474 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:43:31.620089 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f85ee0af-a000-4a2d-a50c-3c762dd94474 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:31.620474 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f85ee0af-a000-4a2d-a50c-3c762dd94474 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:31.621223 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f85ee0af-a000-4a2d-a50c-3c762dd94474 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:31.622290 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f85ee0af-a000-4a2d-a50c-3c762dd94474 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:31.737699 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-f85ee0af-a000-4a2d-a50c-3c762dd94474 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:43:31.745493 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-f85ee0af-a000-4a2d-a50c-3c762dd94474 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1717 microversion: 2.1 time: 0.135829 Nov 01 01:43:31.746058 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1028/2141] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:43:31 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1717 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:43:32.578623 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-9c38166a-de42-444f-a66e-aeb54bbc8489 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:43:32.579250 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-9c38166a-de42-444f-a66e-aeb54bbc8489 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:43:32.585498 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9c38166a-de42-444f-a66e-aeb54bbc8489 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:32.585942 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9c38166a-de42-444f-a66e-aeb54bbc8489 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:32.586718 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9c38166a-de42-444f-a66e-aeb54bbc8489 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:32.587147 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9c38166a-de42-444f-a66e-aeb54bbc8489 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:32.708141 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-9c38166a-de42-444f-a66e-aeb54bbc8489 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:43:32.716193 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-9c38166a-de42-444f-a66e-aeb54bbc8489 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.142171 Nov 01 01:43:32.716783 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1114/2142] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:43:32 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:43:32.762775 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-4aa2ec32-709d-4bbb-811b-77f77523f646 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:43:32.763379 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-4aa2ec32-709d-4bbb-811b-77f77523f646 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:43:32.769513 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4aa2ec32-709d-4bbb-811b-77f77523f646 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:32.769949 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4aa2ec32-709d-4bbb-811b-77f77523f646 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:32.770735 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4aa2ec32-709d-4bbb-811b-77f77523f646 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:32.771157 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4aa2ec32-709d-4bbb-811b-77f77523f646 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:32.889382 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-4aa2ec32-709d-4bbb-811b-77f77523f646 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:43:32.897156 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-4aa2ec32-709d-4bbb-811b-77f77523f646 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1717 microversion: 2.1 time: 0.138713 Nov 01 01:43:32.897737 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1029/2143] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:43:32 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1717 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:43:33.733325 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-751deb6f-f6b0-4a66-8fd1-ee820baa376c tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:43:33.733931 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-751deb6f-f6b0-4a66-8fd1-ee820baa376c tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:43:33.740142 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-751deb6f-f6b0-4a66-8fd1-ee820baa376c tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:33.740585 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-751deb6f-f6b0-4a66-8fd1-ee820baa376c tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:33.741368 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-751deb6f-f6b0-4a66-8fd1-ee820baa376c tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:33.741796 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-751deb6f-f6b0-4a66-8fd1-ee820baa376c tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:33.861242 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-751deb6f-f6b0-4a66-8fd1-ee820baa376c tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:43:33.868955 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-751deb6f-f6b0-4a66-8fd1-ee820baa376c tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.139779 Nov 01 01:43:33.869516 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1115/2144] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:43:33 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:43:33.914032 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-93527478-0a7d-4c7a-b116-3fdf4a34951f tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:43:33.914750 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-93527478-0a7d-4c7a-b116-3fdf4a34951f tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:43:33.922201 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-93527478-0a7d-4c7a-b116-3fdf4a34951f tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:33.922697 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-93527478-0a7d-4c7a-b116-3fdf4a34951f tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:33.923469 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-93527478-0a7d-4c7a-b116-3fdf4a34951f tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:33.923901 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-93527478-0a7d-4c7a-b116-3fdf4a34951f tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:34.045137 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-93527478-0a7d-4c7a-b116-3fdf4a34951f tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:43:34.052866 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-93527478-0a7d-4c7a-b116-3fdf4a34951f tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1717 microversion: 2.1 time: 0.142537 Nov 01 01:43:34.053433 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1030/2145] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:43:33 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1717 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:43:34.885498 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-202eb415-5d42-4c7f-a839-77f794e2b120 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:43:34.886105 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-202eb415-5d42-4c7f-a839-77f794e2b120 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:43:34.893030 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-202eb415-5d42-4c7f-a839-77f794e2b120 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:34.893405 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-202eb415-5d42-4c7f-a839-77f794e2b120 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:34.894155 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-202eb415-5d42-4c7f-a839-77f794e2b120 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:34.894613 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-202eb415-5d42-4c7f-a839-77f794e2b120 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:35.012984 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-202eb415-5d42-4c7f-a839-77f794e2b120 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:43:35.020659 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-202eb415-5d42-4c7f-a839-77f794e2b120 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.138808 Nov 01 01:43:35.021419 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1116/2146] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:43:34 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:43:35.069468 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-37c83cdb-af2f-40ae-b615-bc9e72c73820 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:43:35.070078 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-37c83cdb-af2f-40ae-b615-bc9e72c73820 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:43:35.076944 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-37c83cdb-af2f-40ae-b615-bc9e72c73820 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:35.077394 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-37c83cdb-af2f-40ae-b615-bc9e72c73820 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:35.078158 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-37c83cdb-af2f-40ae-b615-bc9e72c73820 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:35.078619 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-37c83cdb-af2f-40ae-b615-bc9e72c73820 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:35.195893 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-37c83cdb-af2f-40ae-b615-bc9e72c73820 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:43:35.203819 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-37c83cdb-af2f-40ae-b615-bc9e72c73820 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1717 microversion: 2.1 time: 0.137954 Nov 01 01:43:35.204389 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1031/2147] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:43:35 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1717 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:43:36.037108 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-d87337f2-bbd4-4460-affb-0431a4b8d105 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:43:36.037661 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-d87337f2-bbd4-4460-affb-0431a4b8d105 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:43:36.043814 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d87337f2-bbd4-4460-affb-0431a4b8d105 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:36.044258 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d87337f2-bbd4-4460-affb-0431a4b8d105 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:36.045012 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d87337f2-bbd4-4460-affb-0431a4b8d105 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:36.045436 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d87337f2-bbd4-4460-affb-0431a4b8d105 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:36.169423 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-d87337f2-bbd4-4460-affb-0431a4b8d105 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:43:36.177098 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-d87337f2-bbd4-4460-affb-0431a4b8d105 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.143796 Nov 01 01:43:36.177656 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1117/2148] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:43:36 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:43:36.220938 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-a46b2491-7399-4699-8f65-2f5595526859 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:43:36.221543 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-a46b2491-7399-4699-8f65-2f5595526859 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:43:36.227708 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a46b2491-7399-4699-8f65-2f5595526859 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:36.228154 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a46b2491-7399-4699-8f65-2f5595526859 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:36.228921 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a46b2491-7399-4699-8f65-2f5595526859 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:36.229350 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a46b2491-7399-4699-8f65-2f5595526859 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:36.344753 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-a46b2491-7399-4699-8f65-2f5595526859 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:43:36.352636 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-a46b2491-7399-4699-8f65-2f5595526859 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1717 microversion: 2.1 time: 0.135261 Nov 01 01:43:36.353210 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1032/2149] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:43:36 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1717 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:43:37.193290 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-f1a416b6-f443-49e4-adad-e1d9957b37ed tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:43:37.193896 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-f1a416b6-f443-49e4-adad-e1d9957b37ed tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:43:37.200572 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f1a416b6-f443-49e4-adad-e1d9957b37ed tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:37.201018 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f1a416b6-f443-49e4-adad-e1d9957b37ed tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:37.201783 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f1a416b6-f443-49e4-adad-e1d9957b37ed tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:37.202211 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f1a416b6-f443-49e4-adad-e1d9957b37ed tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:37.320599 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-f1a416b6-f443-49e4-adad-e1d9957b37ed tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:43:37.328558 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-f1a416b6-f443-49e4-adad-e1d9957b37ed tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.138913 Nov 01 01:43:37.329131 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1118/2150] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:43:37 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:43:37.368652 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-3835ba2b-2ee5-4dae-9cba-78d8532a47b2 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:43:37.369282 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-3835ba2b-2ee5-4dae-9cba-78d8532a47b2 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:43:37.375588 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3835ba2b-2ee5-4dae-9cba-78d8532a47b2 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:37.376024 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3835ba2b-2ee5-4dae-9cba-78d8532a47b2 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:37.376775 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3835ba2b-2ee5-4dae-9cba-78d8532a47b2 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:37.377219 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3835ba2b-2ee5-4dae-9cba-78d8532a47b2 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:37.500483 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-3835ba2b-2ee5-4dae-9cba-78d8532a47b2 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:43:37.509056 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-3835ba2b-2ee5-4dae-9cba-78d8532a47b2 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1717 microversion: 2.1 time: 0.143856 Nov 01 01:43:37.510959 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1033/2151] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:43:37 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1717 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:43:38.347192 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-35d210b6-c69a-4464-b475-88b08dcad4ba tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:43:38.347733 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-35d210b6-c69a-4464-b475-88b08dcad4ba tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:43:38.353985 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-35d210b6-c69a-4464-b475-88b08dcad4ba tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:38.354461 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-35d210b6-c69a-4464-b475-88b08dcad4ba tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:38.355219 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-35d210b6-c69a-4464-b475-88b08dcad4ba tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:38.355678 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-35d210b6-c69a-4464-b475-88b08dcad4ba tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:38.474084 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-35d210b6-c69a-4464-b475-88b08dcad4ba tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:43:38.481684 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-35d210b6-c69a-4464-b475-88b08dcad4ba tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.139472 Nov 01 01:43:38.482238 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1119/2152] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:43:38 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:43:38.526711 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-fbec3e7d-7171-4f65-91c7-b45a61d014e0 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:43:38.527313 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-fbec3e7d-7171-4f65-91c7-b45a61d014e0 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:43:38.533923 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-fbec3e7d-7171-4f65-91c7-b45a61d014e0 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:38.534360 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-fbec3e7d-7171-4f65-91c7-b45a61d014e0 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:38.535141 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-fbec3e7d-7171-4f65-91c7-b45a61d014e0 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:38.535562 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-fbec3e7d-7171-4f65-91c7-b45a61d014e0 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:38.652614 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-fbec3e7d-7171-4f65-91c7-b45a61d014e0 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:43:38.660214 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-fbec3e7d-7171-4f65-91c7-b45a61d014e0 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1717 microversion: 2.1 time: 0.137074 Nov 01 01:43:38.660771 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1034/2153] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:43:38 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1717 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:43:39.497624 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-be837bcf-eb08-4103-8cc3-8fdfcbb72338 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:43:39.498222 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-be837bcf-eb08-4103-8cc3-8fdfcbb72338 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:43:39.504561 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-be837bcf-eb08-4103-8cc3-8fdfcbb72338 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:39.505012 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-be837bcf-eb08-4103-8cc3-8fdfcbb72338 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:39.505763 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-be837bcf-eb08-4103-8cc3-8fdfcbb72338 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:39.506193 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-be837bcf-eb08-4103-8cc3-8fdfcbb72338 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:39.625384 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-be837bcf-eb08-4103-8cc3-8fdfcbb72338 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:43:39.633071 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-be837bcf-eb08-4103-8cc3-8fdfcbb72338 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.139117 Nov 01 01:43:39.633629 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1120/2154] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:43:39 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:43:39.677063 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-e7778722-eacf-4368-bfc5-15d83bfcabc3 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:43:39.677669 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-e7778722-eacf-4368-bfc5-15d83bfcabc3 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:43:39.683822 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e7778722-eacf-4368-bfc5-15d83bfcabc3 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:39.684270 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e7778722-eacf-4368-bfc5-15d83bfcabc3 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:39.685025 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e7778722-eacf-4368-bfc5-15d83bfcabc3 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:39.685492 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e7778722-eacf-4368-bfc5-15d83bfcabc3 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:39.807157 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-e7778722-eacf-4368-bfc5-15d83bfcabc3 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:43:39.814723 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-e7778722-eacf-4368-bfc5-15d83bfcabc3 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1717 microversion: 2.1 time: 0.141261 Nov 01 01:43:39.815281 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1035/2155] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:43:39 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1717 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:43:40.649496 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-e82af009-ed29-4106-9c15-bb62c1208481 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:43:40.650064 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-e82af009-ed29-4106-9c15-bb62c1208481 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:43:40.656415 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e82af009-ed29-4106-9c15-bb62c1208481 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:40.656857 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e82af009-ed29-4106-9c15-bb62c1208481 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:40.657608 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e82af009-ed29-4106-9c15-bb62c1208481 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:40.658035 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e82af009-ed29-4106-9c15-bb62c1208481 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:40.784280 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-e82af009-ed29-4106-9c15-bb62c1208481 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:43:40.786621 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-e82af009-ed29-4106-9c15-bb62c1208481 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.140855 Nov 01 01:43:40.787188 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1121/2156] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:43:40 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:43:40.831860 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-82c4a114-c970-4e8a-8a00-31573bf944c5 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:43:40.832473 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-82c4a114-c970-4e8a-8a00-31573bf944c5 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:43:40.838191 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-82c4a114-c970-4e8a-8a00-31573bf944c5 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:40.838661 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-82c4a114-c970-4e8a-8a00-31573bf944c5 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:40.839409 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-82c4a114-c970-4e8a-8a00-31573bf944c5 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:40.839829 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-82c4a114-c970-4e8a-8a00-31573bf944c5 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:40.959622 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-82c4a114-c970-4e8a-8a00-31573bf944c5 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:43:40.967246 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-82c4a114-c970-4e8a-8a00-31573bf944c5 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1717 microversion: 2.1 time: 0.139557 Nov 01 01:43:40.967797 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1036/2157] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:43:40 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1717 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:43:41.803941 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-3adea1c3-17d1-43e4-8c0b-4f1b916eea3e tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:43:41.804554 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-3adea1c3-17d1-43e4-8c0b-4f1b916eea3e tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:43:41.810775 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3adea1c3-17d1-43e4-8c0b-4f1b916eea3e tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:41.811223 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3adea1c3-17d1-43e4-8c0b-4f1b916eea3e tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:41.811977 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3adea1c3-17d1-43e4-8c0b-4f1b916eea3e tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:41.812406 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3adea1c3-17d1-43e4-8c0b-4f1b916eea3e tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:41.932521 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-3adea1c3-17d1-43e4-8c0b-4f1b916eea3e tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:43:41.940766 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-3adea1c3-17d1-43e4-8c0b-4f1b916eea3e tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.140483 Nov 01 01:43:41.941321 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1122/2158] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:43:41 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:43:41.983869 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-fda201cf-c6af-4af3-ab98-f22d5a9d72c0 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:43:41.984473 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-fda201cf-c6af-4af3-ab98-f22d5a9d72c0 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:43:41.993911 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-fda201cf-c6af-4af3-ab98-f22d5a9d72c0 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:41.993911 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-fda201cf-c6af-4af3-ab98-f22d5a9d72c0 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:41.993911 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-fda201cf-c6af-4af3-ab98-f22d5a9d72c0 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:41.993911 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-fda201cf-c6af-4af3-ab98-f22d5a9d72c0 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:42.109519 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-fda201cf-c6af-4af3-ab98-f22d5a9d72c0 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:43:42.117126 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-fda201cf-c6af-4af3-ab98-f22d5a9d72c0 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1717 microversion: 2.1 time: 0.136790 Nov 01 01:43:42.117687 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1037/2159] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:43:41 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1717 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:43:42.956791 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-0b399897-6db1-419f-9230-7373cb142a30 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:43:42.957400 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-0b399897-6db1-419f-9230-7373cb142a30 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:43:42.963728 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0b399897-6db1-419f-9230-7373cb142a30 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:42.964172 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0b399897-6db1-419f-9230-7373cb142a30 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:42.964922 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0b399897-6db1-419f-9230-7373cb142a30 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:42.965381 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0b399897-6db1-419f-9230-7373cb142a30 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:43.086353 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-0b399897-6db1-419f-9230-7373cb142a30 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:43:43.094076 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-0b399897-6db1-419f-9230-7373cb142a30 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.140904 Nov 01 01:43:43.094667 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1123/2160] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:43:42 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:43:43.133559 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-a9891855-5ced-40b1-a698-8c5f97ce0eb2 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:43:43.134154 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-a9891855-5ced-40b1-a698-8c5f97ce0eb2 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:43:43.140320 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a9891855-5ced-40b1-a698-8c5f97ce0eb2 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:43.140766 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a9891855-5ced-40b1-a698-8c5f97ce0eb2 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:43.141520 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a9891855-5ced-40b1-a698-8c5f97ce0eb2 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:43.141949 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a9891855-5ced-40b1-a698-8c5f97ce0eb2 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:43.258940 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-a9891855-5ced-40b1-a698-8c5f97ce0eb2 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:43:43.266659 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-a9891855-5ced-40b1-a698-8c5f97ce0eb2 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1717 microversion: 2.1 time: 0.136651 Nov 01 01:43:43.267227 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1038/2161] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:43:43 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1717 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:43:44.109958 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-8dbbc15d-f962-420c-9c1c-b11b37ccfefa tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:43:44.110637 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-8dbbc15d-f962-420c-9c1c-b11b37ccfefa tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:43:44.116867 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8dbbc15d-f962-420c-9c1c-b11b37ccfefa tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:44.117307 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8dbbc15d-f962-420c-9c1c-b11b37ccfefa tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:44.118065 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8dbbc15d-f962-420c-9c1c-b11b37ccfefa tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:44.118515 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8dbbc15d-f962-420c-9c1c-b11b37ccfefa tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:44.235772 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-8dbbc15d-f962-420c-9c1c-b11b37ccfefa tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:43:44.243438 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-8dbbc15d-f962-420c-9c1c-b11b37ccfefa tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.137129 Nov 01 01:43:44.244006 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1124/2162] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:43:44 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:43:44.282948 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-4358ad51-b166-44ba-b967-d8f03a48a2f0 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:43:44.283553 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-4358ad51-b166-44ba-b967-d8f03a48a2f0 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:43:44.289663 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4358ad51-b166-44ba-b967-d8f03a48a2f0 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:44.290105 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4358ad51-b166-44ba-b967-d8f03a48a2f0 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:44.290892 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4358ad51-b166-44ba-b967-d8f03a48a2f0 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:44.291319 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4358ad51-b166-44ba-b967-d8f03a48a2f0 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:44.410494 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-4358ad51-b166-44ba-b967-d8f03a48a2f0 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:43:44.418107 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-4358ad51-b166-44ba-b967-d8f03a48a2f0 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1717 microversion: 2.1 time: 0.138883 Nov 01 01:43:44.418706 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1039/2163] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:43:44 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1717 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:43:45.260529 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-dab0fa52-1b14-4ed3-8d01-a0420a78fd11 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:43:45.261165 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-dab0fa52-1b14-4ed3-8d01-a0420a78fd11 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:43:45.268078 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-dab0fa52-1b14-4ed3-8d01-a0420a78fd11 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:45.268523 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-dab0fa52-1b14-4ed3-8d01-a0420a78fd11 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:45.269308 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-dab0fa52-1b14-4ed3-8d01-a0420a78fd11 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:45.269736 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-dab0fa52-1b14-4ed3-8d01-a0420a78fd11 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:45.390644 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-dab0fa52-1b14-4ed3-8d01-a0420a78fd11 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:43:45.398651 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-dab0fa52-1b14-4ed3-8d01-a0420a78fd11 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.141745 Nov 01 01:43:45.399215 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1125/2164] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:43:45 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:43:45.434916 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-bb0dde04-6b48-4860-a44e-92ad87b08d17 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:43:45.435549 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-bb0dde04-6b48-4860-a44e-92ad87b08d17 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:43:45.441742 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-bb0dde04-6b48-4860-a44e-92ad87b08d17 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:45.442189 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-bb0dde04-6b48-4860-a44e-92ad87b08d17 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:45.442972 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-bb0dde04-6b48-4860-a44e-92ad87b08d17 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:45.443400 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-bb0dde04-6b48-4860-a44e-92ad87b08d17 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:45.560461 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-bb0dde04-6b48-4860-a44e-92ad87b08d17 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:43:45.568317 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-bb0dde04-6b48-4860-a44e-92ad87b08d17 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1717 microversion: 2.1 time: 0.137023 Nov 01 01:43:45.568888 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1040/2165] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:43:45 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1717 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:43:46.415317 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-09ed515f-44ee-43bc-93b3-9803da8cb764 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:43:46.415850 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-09ed515f-44ee-43bc-93b3-9803da8cb764 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:43:46.422671 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-09ed515f-44ee-43bc-93b3-9803da8cb764 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:46.423116 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-09ed515f-44ee-43bc-93b3-9803da8cb764 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:46.423869 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-09ed515f-44ee-43bc-93b3-9803da8cb764 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:46.424296 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-09ed515f-44ee-43bc-93b3-9803da8cb764 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:46.544631 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-09ed515f-44ee-43bc-93b3-9803da8cb764 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:43:46.552331 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-09ed515f-44ee-43bc-93b3-9803da8cb764 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.140804 Nov 01 01:43:46.552889 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1126/2166] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:43:46 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:43:46.585474 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-ca86d0fa-afe6-44fa-97b0-ba94f8db55f6 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:43:46.586076 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-ca86d0fa-afe6-44fa-97b0-ba94f8db55f6 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:43:46.592886 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ca86d0fa-afe6-44fa-97b0-ba94f8db55f6 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:46.593325 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ca86d0fa-afe6-44fa-97b0-ba94f8db55f6 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:46.594104 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ca86d0fa-afe6-44fa-97b0-ba94f8db55f6 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:46.594826 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ca86d0fa-afe6-44fa-97b0-ba94f8db55f6 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:46.711568 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-ca86d0fa-afe6-44fa-97b0-ba94f8db55f6 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:43:46.719752 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-ca86d0fa-afe6-44fa-97b0-ba94f8db55f6 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1717 microversion: 2.1 time: 0.137823 Nov 01 01:43:46.720313 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1041/2167] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:43:46 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1717 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:43:47.568976 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-8b54f2c8-78a3-4eae-819d-2276ed6afeaa tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:43:47.569507 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-8b54f2c8-78a3-4eae-819d-2276ed6afeaa tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:43:47.575910 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8b54f2c8-78a3-4eae-819d-2276ed6afeaa tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:47.576350 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8b54f2c8-78a3-4eae-819d-2276ed6afeaa tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:47.577093 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8b54f2c8-78a3-4eae-819d-2276ed6afeaa tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:47.577515 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8b54f2c8-78a3-4eae-819d-2276ed6afeaa tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:47.694272 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-8b54f2c8-78a3-4eae-819d-2276ed6afeaa tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:43:47.702201 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-8b54f2c8-78a3-4eae-819d-2276ed6afeaa tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.136969 Nov 01 01:43:47.702790 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1127/2168] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:43:47 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:43:47.736961 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-65bd7dcc-2462-45d9-ad85-aa94dcee5a22 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:43:47.737568 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-65bd7dcc-2462-45d9-ad85-aa94dcee5a22 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:43:47.743800 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-65bd7dcc-2462-45d9-ad85-aa94dcee5a22 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:47.744243 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-65bd7dcc-2462-45d9-ad85-aa94dcee5a22 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:47.745000 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-65bd7dcc-2462-45d9-ad85-aa94dcee5a22 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:47.745431 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-65bd7dcc-2462-45d9-ad85-aa94dcee5a22 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:47.873634 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-65bd7dcc-2462-45d9-ad85-aa94dcee5a22 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:43:47.881308 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-65bd7dcc-2462-45d9-ad85-aa94dcee5a22 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1717 microversion: 2.1 time: 0.147926 Nov 01 01:43:47.881874 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1042/2169] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:43:47 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1717 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:43:48.718907 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-7d303a82-f479-4d27-9379-12ca863cf964 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:43:48.719603 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-7d303a82-f479-4d27-9379-12ca863cf964 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:43:48.726089 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-7d303a82-f479-4d27-9379-12ca863cf964 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:48.726623 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-7d303a82-f479-4d27-9379-12ca863cf964 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:48.727529 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-7d303a82-f479-4d27-9379-12ca863cf964 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:48.727956 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-7d303a82-f479-4d27-9379-12ca863cf964 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:48.845751 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-7d303a82-f479-4d27-9379-12ca863cf964 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:43:48.853476 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-7d303a82-f479-4d27-9379-12ca863cf964 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.138219 Nov 01 01:43:48.853976 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1128/2170] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:43:48 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:43:48.898067 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-0a3f0c2e-867e-4185-a75c-6f5bb403913f tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:43:48.898695 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-0a3f0c2e-867e-4185-a75c-6f5bb403913f tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:43:48.904909 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0a3f0c2e-867e-4185-a75c-6f5bb403913f tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:48.905351 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0a3f0c2e-867e-4185-a75c-6f5bb403913f tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:48.906107 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0a3f0c2e-867e-4185-a75c-6f5bb403913f tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:48.906563 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0a3f0c2e-867e-4185-a75c-6f5bb403913f tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:49.022277 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-0a3f0c2e-867e-4185-a75c-6f5bb403913f tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:43:49.030168 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-0a3f0c2e-867e-4185-a75c-6f5bb403913f tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1717 microversion: 2.1 time: 0.135624 Nov 01 01:43:49.030787 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1043/2171] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:43:48 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1717 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:43:49.870126 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-6a8dd645-66fa-4483-9305-5c1f41296ab9 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:43:49.870759 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-6a8dd645-66fa-4483-9305-5c1f41296ab9 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:43:49.877309 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-6a8dd645-66fa-4483-9305-5c1f41296ab9 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:49.877755 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-6a8dd645-66fa-4483-9305-5c1f41296ab9 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:49.878546 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-6a8dd645-66fa-4483-9305-5c1f41296ab9 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:49.878975 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-6a8dd645-66fa-4483-9305-5c1f41296ab9 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:49.999884 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-6a8dd645-66fa-4483-9305-5c1f41296ab9 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:43:50.007507 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-6a8dd645-66fa-4483-9305-5c1f41296ab9 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.141202 Nov 01 01:43:50.008073 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1129/2172] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:43:49 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:43:50.046778 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-3b66107f-276d-41d1-91df-11b8e2b28367 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:43:50.047401 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-3b66107f-276d-41d1-91df-11b8e2b28367 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:43:50.053436 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3b66107f-276d-41d1-91df-11b8e2b28367 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:50.053881 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3b66107f-276d-41d1-91df-11b8e2b28367 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:50.054677 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3b66107f-276d-41d1-91df-11b8e2b28367 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:50.055106 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3b66107f-276d-41d1-91df-11b8e2b28367 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:50.172225 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-3b66107f-276d-41d1-91df-11b8e2b28367 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:43:50.179780 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-3b66107f-276d-41d1-91df-11b8e2b28367 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1717 microversion: 2.1 time: 0.136571 Nov 01 01:43:50.180344 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1044/2173] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:43:50 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1717 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:43:51.024305 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-66aa8c8e-5445-4dd8-afbe-3db4185e8ff6 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:43:51.024922 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-66aa8c8e-5445-4dd8-afbe-3db4185e8ff6 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:43:51.031676 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-66aa8c8e-5445-4dd8-afbe-3db4185e8ff6 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:51.032123 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-66aa8c8e-5445-4dd8-afbe-3db4185e8ff6 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:51.032886 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-66aa8c8e-5445-4dd8-afbe-3db4185e8ff6 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:51.033315 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-66aa8c8e-5445-4dd8-afbe-3db4185e8ff6 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:51.150294 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-66aa8c8e-5445-4dd8-afbe-3db4185e8ff6 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:43:51.158460 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-66aa8c8e-5445-4dd8-afbe-3db4185e8ff6 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.137764 Nov 01 01:43:51.159019 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1130/2174] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:43:51 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:43:51.196552 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-55286c79-3bd5-4a39-a7a5-62408241549b tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:43:51.197153 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-55286c79-3bd5-4a39-a7a5-62408241549b tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:43:51.203493 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-55286c79-3bd5-4a39-a7a5-62408241549b tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:51.203929 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-55286c79-3bd5-4a39-a7a5-62408241549b tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:51.204673 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-55286c79-3bd5-4a39-a7a5-62408241549b tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:51.205092 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-55286c79-3bd5-4a39-a7a5-62408241549b tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:51.325008 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-55286c79-3bd5-4a39-a7a5-62408241549b tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:43:51.332692 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-55286c79-3bd5-4a39-a7a5-62408241549b tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1717 microversion: 2.1 time: 0.139656 Nov 01 01:43:51.333263 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1045/2175] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:43:51 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1717 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:43:52.175107 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-b4e5bb53-d631-471d-a48e-a6a954d463bf tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:43:52.175748 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-b4e5bb53-d631-471d-a48e-a6a954d463bf tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:43:52.181946 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b4e5bb53-d631-471d-a48e-a6a954d463bf tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:52.182369 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b4e5bb53-d631-471d-a48e-a6a954d463bf tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:52.183150 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b4e5bb53-d631-471d-a48e-a6a954d463bf tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:52.183579 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b4e5bb53-d631-471d-a48e-a6a954d463bf tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:52.304554 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-b4e5bb53-d631-471d-a48e-a6a954d463bf tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:43:52.312917 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-b4e5bb53-d631-471d-a48e-a6a954d463bf tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.141468 Nov 01 01:43:52.313479 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1131/2176] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:43:52 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:43:52.349900 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-0b85c005-514f-4a4c-978f-9ab73eb66d83 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:43:52.350557 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-0b85c005-514f-4a4c-978f-9ab73eb66d83 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:43:52.357267 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0b85c005-514f-4a4c-978f-9ab73eb66d83 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:52.357705 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0b85c005-514f-4a4c-978f-9ab73eb66d83 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:52.358487 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0b85c005-514f-4a4c-978f-9ab73eb66d83 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:52.358914 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0b85c005-514f-4a4c-978f-9ab73eb66d83 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:52.476677 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-0b85c005-514f-4a4c-978f-9ab73eb66d83 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:43:52.484951 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-0b85c005-514f-4a4c-978f-9ab73eb66d83 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1717 microversion: 2.1 time: 0.138675 Nov 01 01:43:52.485508 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1046/2177] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:43:52 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1717 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:43:53.330396 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-53ce9b0e-c6a6-44c9-bb4e-8517dfc5d13f tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:43:53.331015 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-53ce9b0e-c6a6-44c9-bb4e-8517dfc5d13f tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:43:53.337206 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-53ce9b0e-c6a6-44c9-bb4e-8517dfc5d13f tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:53.337647 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-53ce9b0e-c6a6-44c9-bb4e-8517dfc5d13f tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:53.338394 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-53ce9b0e-c6a6-44c9-bb4e-8517dfc5d13f tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:53.338843 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-53ce9b0e-c6a6-44c9-bb4e-8517dfc5d13f tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:53.459569 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-53ce9b0e-c6a6-44c9-bb4e-8517dfc5d13f tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:43:53.467335 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-53ce9b0e-c6a6-44c9-bb4e-8517dfc5d13f tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.140593 Nov 01 01:43:53.467907 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1132/2178] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:43:53 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:43:53.501157 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-248a6d64-ca1b-4c2d-b892-5534f8dc220c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:43:53.501764 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-248a6d64-ca1b-4c2d-b892-5534f8dc220c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:43:53.507879 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-248a6d64-ca1b-4c2d-b892-5534f8dc220c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:53.508322 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-248a6d64-ca1b-4c2d-b892-5534f8dc220c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:53.509077 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-248a6d64-ca1b-4c2d-b892-5534f8dc220c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:53.509501 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-248a6d64-ca1b-4c2d-b892-5534f8dc220c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:53.626031 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-248a6d64-ca1b-4c2d-b892-5534f8dc220c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:43:53.633681 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-248a6d64-ca1b-4c2d-b892-5534f8dc220c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1717 microversion: 2.1 time: 0.136094 Nov 01 01:43:53.634237 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1047/2179] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:43:53 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1717 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:43:54.301445 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 01 01:43:54.301719 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: Mon Nov 1 01:43:54 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 01 01:43:54.484134 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-14c13f75-4d0d-4c26-a5b4-1eb09c8e8d0a tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:43:54.484814 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-14c13f75-4d0d-4c26-a5b4-1eb09c8e8d0a tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:43:54.491088 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-14c13f75-4d0d-4c26-a5b4-1eb09c8e8d0a tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:54.491535 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-14c13f75-4d0d-4c26-a5b4-1eb09c8e8d0a tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:54.492286 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-14c13f75-4d0d-4c26-a5b4-1eb09c8e8d0a tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:54.492746 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-14c13f75-4d0d-4c26-a5b4-1eb09c8e8d0a tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:54.610915 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-14c13f75-4d0d-4c26-a5b4-1eb09c8e8d0a tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:43:54.618613 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-14c13f75-4d0d-4c26-a5b4-1eb09c8e8d0a tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.138128 Nov 01 01:43:54.619166 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1133/2180] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:43:54 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:43:54.650274 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-bf6baf1e-0131-4f06-82ce-429c7f64ea8d tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:43:54.651021 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-bf6baf1e-0131-4f06-82ce-429c7f64ea8d tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:43:54.657881 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-bf6baf1e-0131-4f06-82ce-429c7f64ea8d tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:54.658330 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-bf6baf1e-0131-4f06-82ce-429c7f64ea8d tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:54.659129 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-bf6baf1e-0131-4f06-82ce-429c7f64ea8d tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:54.659563 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-bf6baf1e-0131-4f06-82ce-429c7f64ea8d tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:54.783319 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-bf6baf1e-0131-4f06-82ce-429c7f64ea8d tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:43:54.791303 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-bf6baf1e-0131-4f06-82ce-429c7f64ea8d tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1717 microversion: 2.1 time: 0.144552 Nov 01 01:43:54.791871 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1048/2181] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:43:54 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1717 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:43:55.635303 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-234c2fad-6783-4f7b-9013-0ce2d72f3264 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:43:55.635839 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-234c2fad-6783-4f7b-9013-0ce2d72f3264 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:43:55.641578 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-234c2fad-6783-4f7b-9013-0ce2d72f3264 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:55.642015 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-234c2fad-6783-4f7b-9013-0ce2d72f3264 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:55.642859 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-234c2fad-6783-4f7b-9013-0ce2d72f3264 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:55.643289 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-234c2fad-6783-4f7b-9013-0ce2d72f3264 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:55.759963 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-234c2fad-6783-4f7b-9013-0ce2d72f3264 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:43:55.768072 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-234c2fad-6783-4f7b-9013-0ce2d72f3264 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.136586 Nov 01 01:43:55.768655 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1134/2182] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:43:55 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:43:55.808246 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-b5c12f11-e60c-4126-a77e-09946cddd641 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:43:55.808932 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-b5c12f11-e60c-4126-a77e-09946cddd641 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:43:55.814751 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b5c12f11-e60c-4126-a77e-09946cddd641 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:55.815190 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b5c12f11-e60c-4126-a77e-09946cddd641 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:55.815938 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b5c12f11-e60c-4126-a77e-09946cddd641 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:55.816358 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b5c12f11-e60c-4126-a77e-09946cddd641 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:55.932359 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-b5c12f11-e60c-4126-a77e-09946cddd641 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:43:55.940077 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-b5c12f11-e60c-4126-a77e-09946cddd641 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1717 microversion: 2.1 time: 0.135378 Nov 01 01:43:55.940641 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1049/2183] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:43:55 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1717 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:43:56.784691 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-b25c9c6d-c8ba-4525-8f8d-240e65fcc370 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:43:56.785299 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-b25c9c6d-c8ba-4525-8f8d-240e65fcc370 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:43:56.791573 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b25c9c6d-c8ba-4525-8f8d-240e65fcc370 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:56.792017 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b25c9c6d-c8ba-4525-8f8d-240e65fcc370 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:56.792768 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b25c9c6d-c8ba-4525-8f8d-240e65fcc370 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:56.793700 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b25c9c6d-c8ba-4525-8f8d-240e65fcc370 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:56.913128 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-b25c9c6d-c8ba-4525-8f8d-240e65fcc370 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:43:56.921412 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-b25c9c6d-c8ba-4525-8f8d-240e65fcc370 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.140359 Nov 01 01:43:56.921967 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1135/2184] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:43:56 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:43:56.957269 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-f808f711-c421-429c-86d9-ca61285b5086 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:43:56.957877 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-f808f711-c421-429c-86d9-ca61285b5086 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:43:56.964085 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f808f711-c421-429c-86d9-ca61285b5086 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:56.964527 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f808f711-c421-429c-86d9-ca61285b5086 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:56.965789 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f808f711-c421-429c-86d9-ca61285b5086 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:56.966216 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f808f711-c421-429c-86d9-ca61285b5086 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:57.085152 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-f808f711-c421-429c-86d9-ca61285b5086 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:43:57.093399 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-f808f711-c421-429c-86d9-ca61285b5086 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1717 microversion: 2.1 time: 0.139741 Nov 01 01:43:57.093966 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1050/2185] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:43:56 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1717 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:43:57.938573 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-42c58426-e7b5-4b42-95bd-f53fe19dcc81 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:43:57.939184 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-42c58426-e7b5-4b42-95bd-f53fe19dcc81 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:43:57.945365 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-42c58426-e7b5-4b42-95bd-f53fe19dcc81 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:57.945810 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-42c58426-e7b5-4b42-95bd-f53fe19dcc81 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:57.946607 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-42c58426-e7b5-4b42-95bd-f53fe19dcc81 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:57.947052 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-42c58426-e7b5-4b42-95bd-f53fe19dcc81 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:58.063216 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-42c58426-e7b5-4b42-95bd-f53fe19dcc81 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:43:58.070793 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-42c58426-e7b5-4b42-95bd-f53fe19dcc81 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.135834 Nov 01 01:43:58.071383 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1136/2186] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:43:57 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:43:58.110499 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-787880ce-d3c5-48c8-bf1d-5c83708fa227 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:43:58.111113 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-787880ce-d3c5-48c8-bf1d-5c83708fa227 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:43:58.117373 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-787880ce-d3c5-48c8-bf1d-5c83708fa227 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:58.117818 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-787880ce-d3c5-48c8-bf1d-5c83708fa227 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:58.118615 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-787880ce-d3c5-48c8-bf1d-5c83708fa227 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:58.119052 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-787880ce-d3c5-48c8-bf1d-5c83708fa227 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:58.238757 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-787880ce-d3c5-48c8-bf1d-5c83708fa227 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:43:58.247158 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-787880ce-d3c5-48c8-bf1d-5c83708fa227 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1717 microversion: 2.1 time: 0.139774 Nov 01 01:43:58.247726 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1051/2187] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:43:58 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1717 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:43:59.088157 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-1968f551-8490-4d87-93ae-993b456b4a70 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:43:59.088888 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-1968f551-8490-4d87-93ae-993b456b4a70 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:43:59.095560 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-1968f551-8490-4d87-93ae-993b456b4a70 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:59.096010 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-1968f551-8490-4d87-93ae-993b456b4a70 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:59.096766 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-1968f551-8490-4d87-93ae-993b456b4a70 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:59.097192 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-1968f551-8490-4d87-93ae-993b456b4a70 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:59.216067 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-1968f551-8490-4d87-93ae-993b456b4a70 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:43:59.224062 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-1968f551-8490-4d87-93ae-993b456b4a70 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.140023 Nov 01 01:43:59.224596 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1137/2188] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:43:59 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:43:59.263714 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-da11d56d-b7c2-4d1e-b019-e044494bd0c1 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:43:59.264320 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-da11d56d-b7c2-4d1e-b019-e044494bd0c1 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:43:59.270490 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-da11d56d-b7c2-4d1e-b019-e044494bd0c1 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:59.270941 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-da11d56d-b7c2-4d1e-b019-e044494bd0c1 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:59.271703 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-da11d56d-b7c2-4d1e-b019-e044494bd0c1 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:43:59.272128 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-da11d56d-b7c2-4d1e-b019-e044494bd0c1 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:43:59.388740 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-da11d56d-b7c2-4d1e-b019-e044494bd0c1 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:43:59.396440 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-da11d56d-b7c2-4d1e-b019-e044494bd0c1 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1717 microversion: 2.1 time: 0.136449 Nov 01 01:43:59.397004 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1052/2189] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:43:59 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1717 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:44:00.076268 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 01 01:44:00.076486 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: Mon Nov 1 01:44:00 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 01 01:44:00.245427 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-d63b8f40-43b8-4422-a3eb-0002300908a3 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:44:00.246060 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-d63b8f40-43b8-4422-a3eb-0002300908a3 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:44:00.253943 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d63b8f40-43b8-4422-a3eb-0002300908a3 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:00.254561 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d63b8f40-43b8-4422-a3eb-0002300908a3 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:00.255328 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d63b8f40-43b8-4422-a3eb-0002300908a3 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:00.255755 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d63b8f40-43b8-4422-a3eb-0002300908a3 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:00.378773 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-d63b8f40-43b8-4422-a3eb-0002300908a3 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:44:00.386467 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-d63b8f40-43b8-4422-a3eb-0002300908a3 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.144787 Nov 01 01:44:00.387528 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1138/2190] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:44:00 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:44:00.413116 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-153647dd-8983-483e-9ff7-783cdafa806e tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:44:00.413719 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-153647dd-8983-483e-9ff7-783cdafa806e tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:44:00.419976 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-153647dd-8983-483e-9ff7-783cdafa806e tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:00.420414 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-153647dd-8983-483e-9ff7-783cdafa806e tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:00.421161 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-153647dd-8983-483e-9ff7-783cdafa806e tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:00.421586 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-153647dd-8983-483e-9ff7-783cdafa806e tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:00.538025 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-153647dd-8983-483e-9ff7-783cdafa806e tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:44:00.545712 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-153647dd-8983-483e-9ff7-783cdafa806e tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1717 microversion: 2.1 time: 0.136239 Nov 01 01:44:00.546280 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1053/2191] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:44:00 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1717 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:44:01.404142 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-bb4944f2-94f5-497c-a822-1579cba41dbf tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:44:01.404744 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-bb4944f2-94f5-497c-a822-1579cba41dbf tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:44:01.410914 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-bb4944f2-94f5-497c-a822-1579cba41dbf tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:01.411353 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-bb4944f2-94f5-497c-a822-1579cba41dbf tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:01.412099 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-bb4944f2-94f5-497c-a822-1579cba41dbf tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:01.412520 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-bb4944f2-94f5-497c-a822-1579cba41dbf tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:01.529349 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-bb4944f2-94f5-497c-a822-1579cba41dbf tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:44:01.536922 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-bb4944f2-94f5-497c-a822-1579cba41dbf tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.136914 Nov 01 01:44:01.537471 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1139/2192] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:44:01 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:44:01.562124 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-87e30edb-6e2b-43b2-87ce-2876d6a2a041 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:44:01.562758 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-87e30edb-6e2b-43b2-87ce-2876d6a2a041 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:44:01.568973 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-87e30edb-6e2b-43b2-87ce-2876d6a2a041 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:01.569419 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-87e30edb-6e2b-43b2-87ce-2876d6a2a041 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:01.570172 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-87e30edb-6e2b-43b2-87ce-2876d6a2a041 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:01.570635 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-87e30edb-6e2b-43b2-87ce-2876d6a2a041 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:01.698030 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-87e30edb-6e2b-43b2-87ce-2876d6a2a041 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:44:01.705898 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-87e30edb-6e2b-43b2-87ce-2876d6a2a041 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1717 microversion: 2.1 time: 0.147369 Nov 01 01:44:01.706477 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1054/2193] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:44:01 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1717 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:44:02.553773 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-625a1353-0f5b-465a-9945-fde8c2fef3ee tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:44:02.554380 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-625a1353-0f5b-465a-9945-fde8c2fef3ee tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:44:02.560703 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-625a1353-0f5b-465a-9945-fde8c2fef3ee tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:02.561150 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-625a1353-0f5b-465a-9945-fde8c2fef3ee tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:02.561901 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-625a1353-0f5b-465a-9945-fde8c2fef3ee tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:02.562332 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-625a1353-0f5b-465a-9945-fde8c2fef3ee tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:02.681350 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-625a1353-0f5b-465a-9945-fde8c2fef3ee tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:44:02.689139 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-625a1353-0f5b-465a-9945-fde8c2fef3ee tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.139115 Nov 01 01:44:02.689694 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1140/2194] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:44:02 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:44:02.722713 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-09862f22-4413-4041-8ec2-3728ca2a0862 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:44:02.723391 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-09862f22-4413-4041-8ec2-3728ca2a0862 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:44:02.729706 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-09862f22-4413-4041-8ec2-3728ca2a0862 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:02.730941 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-09862f22-4413-4041-8ec2-3728ca2a0862 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:02.731426 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-09862f22-4413-4041-8ec2-3728ca2a0862 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:02.731853 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-09862f22-4413-4041-8ec2-3728ca2a0862 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:02.850813 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-09862f22-4413-4041-8ec2-3728ca2a0862 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:44:02.858966 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-09862f22-4413-4041-8ec2-3728ca2a0862 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1717 microversion: 2.1 time: 0.139914 Nov 01 01:44:02.859577 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1055/2195] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:44:02 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1717 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:44:03.705798 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-dd4c6ef5-e6d8-4e45-9b53-bb3bb412953d tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:44:03.706410 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-dd4c6ef5-e6d8-4e45-9b53-bb3bb412953d tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:44:03.712912 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-dd4c6ef5-e6d8-4e45-9b53-bb3bb412953d tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:03.713359 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-dd4c6ef5-e6d8-4e45-9b53-bb3bb412953d tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:03.714120 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-dd4c6ef5-e6d8-4e45-9b53-bb3bb412953d tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:03.714574 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-dd4c6ef5-e6d8-4e45-9b53-bb3bb412953d tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:03.836966 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-dd4c6ef5-e6d8-4e45-9b53-bb3bb412953d tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:44:03.845427 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-dd4c6ef5-e6d8-4e45-9b53-bb3bb412953d tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.143125 Nov 01 01:44:03.845993 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1141/2196] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:44:03 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:44:03.874912 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-a58b6113-91ec-46bc-a1b3-f0eb333ac93f tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:44:03.875508 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-a58b6113-91ec-46bc-a1b3-f0eb333ac93f tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:44:03.881696 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a58b6113-91ec-46bc-a1b3-f0eb333ac93f tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:03.882126 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a58b6113-91ec-46bc-a1b3-f0eb333ac93f tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:03.882932 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a58b6113-91ec-46bc-a1b3-f0eb333ac93f tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:03.883357 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a58b6113-91ec-46bc-a1b3-f0eb333ac93f tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:04.235412 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-a58b6113-91ec-46bc-a1b3-f0eb333ac93f tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:44:04.242985 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-a58b6113-91ec-46bc-a1b3-f0eb333ac93f tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1717 microversion: 2.1 time: 0.371672 Nov 01 01:44:04.243569 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1056/2197] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:44:03 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1717 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:44:04.862246 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-777c82bb-15c0-44c6-9c87-85cd4d93520b tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:44:04.862830 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-777c82bb-15c0-44c6-9c87-85cd4d93520b tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:44:04.869182 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-777c82bb-15c0-44c6-9c87-85cd4d93520b tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:04.869634 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-777c82bb-15c0-44c6-9c87-85cd4d93520b tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:04.870398 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-777c82bb-15c0-44c6-9c87-85cd4d93520b tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:04.871458 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-777c82bb-15c0-44c6-9c87-85cd4d93520b tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:04.988752 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-777c82bb-15c0-44c6-9c87-85cd4d93520b tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:44:04.997065 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-777c82bb-15c0-44c6-9c87-85cd4d93520b tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.138563 Nov 01 01:44:04.997628 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1142/2198] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:44:04 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:44:05.259893 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-944133c9-cce9-45e6-99c1-250378d6c864 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:44:05.260494 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-944133c9-cce9-45e6-99c1-250378d6c864 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:44:05.266594 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-944133c9-cce9-45e6-99c1-250378d6c864 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:05.267036 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-944133c9-cce9-45e6-99c1-250378d6c864 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:05.267780 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-944133c9-cce9-45e6-99c1-250378d6c864 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:05.268202 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-944133c9-cce9-45e6-99c1-250378d6c864 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:05.388977 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-944133c9-cce9-45e6-99c1-250378d6c864 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:44:05.396706 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-944133c9-cce9-45e6-99c1-250378d6c864 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1717 microversion: 2.1 time: 0.140399 Nov 01 01:44:05.401207 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1057/2199] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:44:05 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1717 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:44:06.013322 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-50b6de8a-9900-4602-8c19-8053df998068 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:44:06.013967 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-50b6de8a-9900-4602-8c19-8053df998068 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:44:06.020151 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-50b6de8a-9900-4602-8c19-8053df998068 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:06.020597 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-50b6de8a-9900-4602-8c19-8053df998068 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:06.021358 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-50b6de8a-9900-4602-8c19-8053df998068 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:06.021792 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-50b6de8a-9900-4602-8c19-8053df998068 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:06.139237 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-50b6de8a-9900-4602-8c19-8053df998068 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:44:06.147095 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-50b6de8a-9900-4602-8c19-8053df998068 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.138040 Nov 01 01:44:06.147669 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1143/2200] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:44:06 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:44:06.414126 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-735f636b-69a9-4721-a499-c7809bac6d1e tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:44:06.414755 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-735f636b-69a9-4721-a499-c7809bac6d1e tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:44:06.421975 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-735f636b-69a9-4721-a499-c7809bac6d1e tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:06.422437 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-735f636b-69a9-4721-a499-c7809bac6d1e tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:06.423214 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-735f636b-69a9-4721-a499-c7809bac6d1e tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:06.423638 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-735f636b-69a9-4721-a499-c7809bac6d1e tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:06.540100 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-735f636b-69a9-4721-a499-c7809bac6d1e tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:44:06.548243 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-735f636b-69a9-4721-a499-c7809bac6d1e tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1717 microversion: 2.1 time: 0.137753 Nov 01 01:44:06.548799 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1058/2201] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:44:06 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1717 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:44:07.163616 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-72a28ae0-a2f2-43b4-9820-bcf22ce76296 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:44:07.164236 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-72a28ae0-a2f2-43b4-9820-bcf22ce76296 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:44:07.171119 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-72a28ae0-a2f2-43b4-9820-bcf22ce76296 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:07.171597 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-72a28ae0-a2f2-43b4-9820-bcf22ce76296 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:07.172361 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-72a28ae0-a2f2-43b4-9820-bcf22ce76296 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:07.172791 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-72a28ae0-a2f2-43b4-9820-bcf22ce76296 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:07.291306 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-72a28ae0-a2f2-43b4-9820-bcf22ce76296 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:44:07.299544 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-72a28ae0-a2f2-43b4-9820-bcf22ce76296 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.139555 Nov 01 01:44:07.300111 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1144/2202] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:44:07 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:44:07.564883 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-37fcfc03-d647-4691-af49-4f6abf27278f tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:44:07.565416 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-37fcfc03-d647-4691-af49-4f6abf27278f tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:44:07.571630 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-37fcfc03-d647-4691-af49-4f6abf27278f tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:07.572075 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-37fcfc03-d647-4691-af49-4f6abf27278f tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:07.572826 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-37fcfc03-d647-4691-af49-4f6abf27278f tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:07.573252 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-37fcfc03-d647-4691-af49-4f6abf27278f tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:07.692385 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-37fcfc03-d647-4691-af49-4f6abf27278f tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:44:07.700270 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-37fcfc03-d647-4691-af49-4f6abf27278f tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1717 microversion: 2.1 time: 0.139166 Nov 01 01:44:07.700835 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1059/2203] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:44:07 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1717 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:44:08.316855 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-581dbe3a-ec8e-43cd-9eb5-00907d75bab0 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:44:08.317566 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-581dbe3a-ec8e-43cd-9eb5-00907d75bab0 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:44:08.324719 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-581dbe3a-ec8e-43cd-9eb5-00907d75bab0 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:08.325165 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-581dbe3a-ec8e-43cd-9eb5-00907d75bab0 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:08.325931 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-581dbe3a-ec8e-43cd-9eb5-00907d75bab0 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:08.326359 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-581dbe3a-ec8e-43cd-9eb5-00907d75bab0 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:08.444887 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-581dbe3a-ec8e-43cd-9eb5-00907d75bab0 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:44:08.453400 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-581dbe3a-ec8e-43cd-9eb5-00907d75bab0 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.140298 Nov 01 01:44:08.453965 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1145/2204] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:44:08 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:44:08.716911 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-168fde53-482c-4a0e-b02b-41a948c8d0c5 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:44:08.717552 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-168fde53-482c-4a0e-b02b-41a948c8d0c5 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:44:08.723997 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-168fde53-482c-4a0e-b02b-41a948c8d0c5 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:08.724449 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-168fde53-482c-4a0e-b02b-41a948c8d0c5 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:08.725219 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-168fde53-482c-4a0e-b02b-41a948c8d0c5 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:08.725652 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-168fde53-482c-4a0e-b02b-41a948c8d0c5 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:08.846651 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-168fde53-482c-4a0e-b02b-41a948c8d0c5 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:44:08.854332 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-168fde53-482c-4a0e-b02b-41a948c8d0c5 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1717 microversion: 2.1 time: 0.141037 Nov 01 01:44:08.854913 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1060/2205] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:44:08 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1717 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:44:09.470636 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-834d6572-7464-404b-9189-6285ec1416ea tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:44:09.471245 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-834d6572-7464-404b-9189-6285ec1416ea tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:44:09.477434 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-834d6572-7464-404b-9189-6285ec1416ea tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:09.477875 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-834d6572-7464-404b-9189-6285ec1416ea tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:09.478649 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-834d6572-7464-404b-9189-6285ec1416ea tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:09.479076 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-834d6572-7464-404b-9189-6285ec1416ea tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:09.602127 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-834d6572-7464-404b-9189-6285ec1416ea tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:44:09.610359 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-834d6572-7464-404b-9189-6285ec1416ea tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.143423 Nov 01 01:44:09.611110 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1146/2206] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:44:09 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:44:09.871333 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-42ecba2c-e49b-4468-9b00-b36e42aa0bbb tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:44:09.871884 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-42ecba2c-e49b-4468-9b00-b36e42aa0bbb tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:44:09.878004 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-42ecba2c-e49b-4468-9b00-b36e42aa0bbb tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:09.878480 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-42ecba2c-e49b-4468-9b00-b36e42aa0bbb tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:09.879238 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-42ecba2c-e49b-4468-9b00-b36e42aa0bbb tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:09.879666 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-42ecba2c-e49b-4468-9b00-b36e42aa0bbb tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:10.001244 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-42ecba2c-e49b-4468-9b00-b36e42aa0bbb tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:44:10.008970 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-42ecba2c-e49b-4468-9b00-b36e42aa0bbb tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1717 microversion: 2.1 time: 0.141365 Nov 01 01:44:10.009540 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1061/2207] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:44:09 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1717 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:44:10.627275 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-54822fef-3bd8-4674-995f-17fb944a3672 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:44:10.627886 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-54822fef-3bd8-4674-995f-17fb944a3672 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:44:10.634103 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-54822fef-3bd8-4674-995f-17fb944a3672 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:10.634581 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-54822fef-3bd8-4674-995f-17fb944a3672 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:10.635338 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-54822fef-3bd8-4674-995f-17fb944a3672 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:10.635762 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-54822fef-3bd8-4674-995f-17fb944a3672 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:10.756991 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-54822fef-3bd8-4674-995f-17fb944a3672 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:44:10.765425 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-54822fef-3bd8-4674-995f-17fb944a3672 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.141830 Nov 01 01:44:10.769984 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1147/2208] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:44:10 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:44:11.025566 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-e651112f-4eb3-441c-b410-bc755a87e05b tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:44:11.026171 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-e651112f-4eb3-441c-b410-bc755a87e05b tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:44:11.032386 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e651112f-4eb3-441c-b410-bc755a87e05b tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:11.032828 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e651112f-4eb3-441c-b410-bc755a87e05b tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:11.033575 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e651112f-4eb3-441c-b410-bc755a87e05b tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:11.034003 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e651112f-4eb3-441c-b410-bc755a87e05b tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:11.151248 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-e651112f-4eb3-441c-b410-bc755a87e05b tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:44:11.159442 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-e651112f-4eb3-441c-b410-bc755a87e05b tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1717 microversion: 2.1 time: 0.137449 Nov 01 01:44:11.160001 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1062/2209] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:44:11 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1717 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:44:11.782108 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-f1874193-9448-4394-b73f-91c76ecae3e7 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:44:11.783005 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-f1874193-9448-4394-b73f-91c76ecae3e7 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:44:11.790061 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f1874193-9448-4394-b73f-91c76ecae3e7 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:11.790559 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f1874193-9448-4394-b73f-91c76ecae3e7 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:11.791459 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f1874193-9448-4394-b73f-91c76ecae3e7 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:11.791886 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f1874193-9448-4394-b73f-91c76ecae3e7 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:11.918971 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-f1874193-9448-4394-b73f-91c76ecae3e7 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:44:11.927056 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-f1874193-9448-4394-b73f-91c76ecae3e7 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.148589 Nov 01 01:44:11.927614 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1148/2210] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:44:11 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:44:12.177887 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-80bb639b-162f-42ca-9ddf-3b7cb1679f21 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:44:12.178689 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-80bb639b-162f-42ca-9ddf-3b7cb1679f21 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:44:12.185544 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-80bb639b-162f-42ca-9ddf-3b7cb1679f21 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:12.186478 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-80bb639b-162f-42ca-9ddf-3b7cb1679f21 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:12.187249 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-80bb639b-162f-42ca-9ddf-3b7cb1679f21 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:12.187678 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-80bb639b-162f-42ca-9ddf-3b7cb1679f21 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:12.320726 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-80bb639b-162f-42ca-9ddf-3b7cb1679f21 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:44:12.329296 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-80bb639b-162f-42ca-9ddf-3b7cb1679f21 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1717 microversion: 2.1 time: 0.156713 Nov 01 01:44:12.329854 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1063/2211] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:44:12 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1717 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:44:12.943886 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-2a6fafcd-0d75-4c39-b759-cc5e7ddb7516 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:44:12.944499 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-2a6fafcd-0d75-4c39-b759-cc5e7ddb7516 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:44:12.951756 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-2a6fafcd-0d75-4c39-b759-cc5e7ddb7516 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:12.952193 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-2a6fafcd-0d75-4c39-b759-cc5e7ddb7516 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:12.952937 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-2a6fafcd-0d75-4c39-b759-cc5e7ddb7516 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:12.953387 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-2a6fafcd-0d75-4c39-b759-cc5e7ddb7516 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:13.069790 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-2a6fafcd-0d75-4c39-b759-cc5e7ddb7516 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:44:13.077733 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-2a6fafcd-0d75-4c39-b759-cc5e7ddb7516 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.137527 Nov 01 01:44:13.078289 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1149/2212] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:44:12 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:44:13.348656 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-2903d8f2-6204-4fe1-bf3e-350ace7b45fd tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:44:13.349249 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-2903d8f2-6204-4fe1-bf3e-350ace7b45fd tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:44:13.355944 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2903d8f2-6204-4fe1-bf3e-350ace7b45fd tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:13.356378 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2903d8f2-6204-4fe1-bf3e-350ace7b45fd tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:13.357124 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2903d8f2-6204-4fe1-bf3e-350ace7b45fd tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:13.357546 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2903d8f2-6204-4fe1-bf3e-350ace7b45fd tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:13.473777 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-2903d8f2-6204-4fe1-bf3e-350ace7b45fd tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:44:13.481921 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-2903d8f2-6204-4fe1-bf3e-350ace7b45fd tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1717 microversion: 2.1 time: 0.136866 Nov 01 01:44:13.482493 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1064/2213] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:44:13 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1717 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:44:14.094792 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-e5bddda1-50e0-4c24-a3e8-98b516ae1a73 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:44:14.095440 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-e5bddda1-50e0-4c24-a3e8-98b516ae1a73 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:44:14.101598 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e5bddda1-50e0-4c24-a3e8-98b516ae1a73 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:14.102036 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e5bddda1-50e0-4c24-a3e8-98b516ae1a73 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:14.102828 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e5bddda1-50e0-4c24-a3e8-98b516ae1a73 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:14.103261 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e5bddda1-50e0-4c24-a3e8-98b516ae1a73 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:14.223043 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-e5bddda1-50e0-4c24-a3e8-98b516ae1a73 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:44:14.230682 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-e5bddda1-50e0-4c24-a3e8-98b516ae1a73 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.139484 Nov 01 01:44:14.231253 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1150/2214] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:44:14 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:44:14.498985 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-ccec662a-5499-439c-9416-7b6f049d73ea tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:44:14.499590 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-ccec662a-5499-439c-9416-7b6f049d73ea tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:44:14.505680 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ccec662a-5499-439c-9416-7b6f049d73ea tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:14.506121 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ccec662a-5499-439c-9416-7b6f049d73ea tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:14.506906 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ccec662a-5499-439c-9416-7b6f049d73ea tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:14.507338 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ccec662a-5499-439c-9416-7b6f049d73ea tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:14.625246 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-ccec662a-5499-439c-9416-7b6f049d73ea tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:44:14.632941 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-ccec662a-5499-439c-9416-7b6f049d73ea tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1717 microversion: 2.1 time: 0.138113 Nov 01 01:44:14.633501 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1065/2215] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:44:14 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1717 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:44:15.247418 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-4865be86-35eb-43a4-b339-9dfbda52fc80 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:44:15.257440 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-4865be86-35eb-43a4-b339-9dfbda52fc80 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:44:15.257440 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4865be86-35eb-43a4-b339-9dfbda52fc80 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:15.257440 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4865be86-35eb-43a4-b339-9dfbda52fc80 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:15.257440 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4865be86-35eb-43a4-b339-9dfbda52fc80 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:15.257816 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4865be86-35eb-43a4-b339-9dfbda52fc80 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:15.376699 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-4865be86-35eb-43a4-b339-9dfbda52fc80 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:44:15.384617 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-4865be86-35eb-43a4-b339-9dfbda52fc80 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.140813 Nov 01 01:44:15.385186 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1151/2216] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:44:15 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:44:15.649634 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-e6cb1f6d-179a-4593-a732-92f7062aba4f tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:44:15.650162 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-e6cb1f6d-179a-4593-a732-92f7062aba4f tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:44:15.656964 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e6cb1f6d-179a-4593-a732-92f7062aba4f tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:15.657408 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e6cb1f6d-179a-4593-a732-92f7062aba4f tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:15.658155 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e6cb1f6d-179a-4593-a732-92f7062aba4f tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:15.658614 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e6cb1f6d-179a-4593-a732-92f7062aba4f tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:15.777767 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-e6cb1f6d-179a-4593-a732-92f7062aba4f tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:44:15.785417 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-e6cb1f6d-179a-4593-a732-92f7062aba4f tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1717 microversion: 2.1 time: 0.139565 Nov 01 01:44:15.785977 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1066/2217] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:44:15 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1717 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:44:16.402942 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-474dea25-b963-4582-a36e-07218722ed62 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:44:16.403642 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-474dea25-b963-4582-a36e-07218722ed62 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:44:16.409813 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-474dea25-b963-4582-a36e-07218722ed62 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:16.410259 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-474dea25-b963-4582-a36e-07218722ed62 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:16.411127 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-474dea25-b963-4582-a36e-07218722ed62 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:16.411557 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-474dea25-b963-4582-a36e-07218722ed62 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:16.534366 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-474dea25-b963-4582-a36e-07218722ed62 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:44:16.541997 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-474dea25-b963-4582-a36e-07218722ed62 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.143538 Nov 01 01:44:16.543219 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1152/2218] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:44:16 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:44:16.801291 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-74242bed-2c62-43aa-99c6-6b0865e6b159 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:44:16.801893 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-74242bed-2c62-43aa-99c6-6b0865e6b159 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:44:16.808145 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-74242bed-2c62-43aa-99c6-6b0865e6b159 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:16.808588 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-74242bed-2c62-43aa-99c6-6b0865e6b159 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:16.809339 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-74242bed-2c62-43aa-99c6-6b0865e6b159 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:16.809768 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-74242bed-2c62-43aa-99c6-6b0865e6b159 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:16.926533 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-74242bed-2c62-43aa-99c6-6b0865e6b159 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:44:16.934188 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-74242bed-2c62-43aa-99c6-6b0865e6b159 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1717 microversion: 2.1 time: 0.136586 Nov 01 01:44:16.934784 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1067/2219] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:44:16 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1717 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:44:17.559191 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-1c79b153-05b7-4ebf-b5f5-d6f668fc5a96 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:44:17.559793 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-1c79b153-05b7-4ebf-b5f5-d6f668fc5a96 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:44:17.565948 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-1c79b153-05b7-4ebf-b5f5-d6f668fc5a96 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:17.566391 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-1c79b153-05b7-4ebf-b5f5-d6f668fc5a96 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:17.567171 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-1c79b153-05b7-4ebf-b5f5-d6f668fc5a96 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:17.567600 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-1c79b153-05b7-4ebf-b5f5-d6f668fc5a96 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:17.688784 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-1c79b153-05b7-4ebf-b5f5-d6f668fc5a96 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:44:17.696447 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-1c79b153-05b7-4ebf-b5f5-d6f668fc5a96 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.141519 Nov 01 01:44:17.697000 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1153/2220] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:44:17 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:44:17.950876 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-43eeeb53-37ce-4306-b565-c7dd81c29eaf tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:44:17.951497 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-43eeeb53-37ce-4306-b565-c7dd81c29eaf tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:44:17.957766 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-43eeeb53-37ce-4306-b565-c7dd81c29eaf tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:17.958207 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-43eeeb53-37ce-4306-b565-c7dd81c29eaf tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:17.958993 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-43eeeb53-37ce-4306-b565-c7dd81c29eaf tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:17.959418 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-43eeeb53-37ce-4306-b565-c7dd81c29eaf tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:18.079981 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-43eeeb53-37ce-4306-b565-c7dd81c29eaf tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:44:18.087619 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-43eeeb53-37ce-4306-b565-c7dd81c29eaf tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1717 microversion: 2.1 time: 0.140838 Nov 01 01:44:18.088179 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1068/2221] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:44:17 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1717 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:44:18.712752 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-aff2b15c-10ae-458a-bffa-33958fdd96f6 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:44:18.713395 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-aff2b15c-10ae-458a-bffa-33958fdd96f6 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:44:18.720264 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-aff2b15c-10ae-458a-bffa-33958fdd96f6 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:18.720708 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-aff2b15c-10ae-458a-bffa-33958fdd96f6 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:18.721458 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-aff2b15c-10ae-458a-bffa-33958fdd96f6 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:18.721884 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-aff2b15c-10ae-458a-bffa-33958fdd96f6 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:18.837958 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-aff2b15c-10ae-458a-bffa-33958fdd96f6 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:44:18.846195 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-aff2b15c-10ae-458a-bffa-33958fdd96f6 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.137096 Nov 01 01:44:18.846792 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1154/2222] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:44:18 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:44:19.106675 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-ba72a125-259a-4e3d-a4cd-06893eb5406b tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:44:19.107306 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-ba72a125-259a-4e3d-a4cd-06893eb5406b tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:44:19.113825 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ba72a125-259a-4e3d-a4cd-06893eb5406b tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:19.114271 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ba72a125-259a-4e3d-a4cd-06893eb5406b tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:19.115072 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ba72a125-259a-4e3d-a4cd-06893eb5406b tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:19.115501 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ba72a125-259a-4e3d-a4cd-06893eb5406b tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:19.238008 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-ba72a125-259a-4e3d-a4cd-06893eb5406b tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:44:19.245655 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-ba72a125-259a-4e3d-a4cd-06893eb5406b tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1717 microversion: 2.1 time: 0.142607 Nov 01 01:44:19.246211 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1069/2223] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:44:19 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1717 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:44:19.863507 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-81c45fa9-b525-45c2-a734-ab7b1062eaf8 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:44:19.864115 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-81c45fa9-b525-45c2-a734-ab7b1062eaf8 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:44:19.870384 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-81c45fa9-b525-45c2-a734-ab7b1062eaf8 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:19.871402 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-81c45fa9-b525-45c2-a734-ab7b1062eaf8 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:19.872148 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-81c45fa9-b525-45c2-a734-ab7b1062eaf8 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:19.872576 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-81c45fa9-b525-45c2-a734-ab7b1062eaf8 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:19.992141 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-81c45fa9-b525-45c2-a734-ab7b1062eaf8 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:44:20.000509 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-81c45fa9-b525-45c2-a734-ab7b1062eaf8 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.140665 Nov 01 01:44:20.001077 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1155/2224] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:44:19 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:44:20.261597 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-220d6735-8561-4292-b769-5cc3c1003125 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:44:20.262198 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-220d6735-8561-4292-b769-5cc3c1003125 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:44:20.268416 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-220d6735-8561-4292-b769-5cc3c1003125 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:20.268860 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-220d6735-8561-4292-b769-5cc3c1003125 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:20.269614 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-220d6735-8561-4292-b769-5cc3c1003125 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:20.270045 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-220d6735-8561-4292-b769-5cc3c1003125 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:20.395049 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-220d6735-8561-4292-b769-5cc3c1003125 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:44:20.403234 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-220d6735-8561-4292-b769-5cc3c1003125 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1717 microversion: 2.1 time: 0.145260 Nov 01 01:44:20.403787 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1070/2225] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:44:20 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1717 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:44:21.017632 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-05c8f991-f119-45e5-a7ec-e105e87eedb5 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:44:21.018237 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-05c8f991-f119-45e5-a7ec-e105e87eedb5 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:44:21.024453 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-05c8f991-f119-45e5-a7ec-e105e87eedb5 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:21.024900 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-05c8f991-f119-45e5-a7ec-e105e87eedb5 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:21.025645 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-05c8f991-f119-45e5-a7ec-e105e87eedb5 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:21.026071 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-05c8f991-f119-45e5-a7ec-e105e87eedb5 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:21.146322 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-05c8f991-f119-45e5-a7ec-e105e87eedb5 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:44:21.154113 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-05c8f991-f119-45e5-a7ec-e105e87eedb5 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.140131 Nov 01 01:44:21.154710 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1156/2226] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:44:21 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:44:21.420507 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-7f39228b-00d9-48b8-b1e4-5565df2a7d91 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:44:21.421105 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-7f39228b-00d9-48b8-b1e4-5565df2a7d91 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:44:21.427309 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7f39228b-00d9-48b8-b1e4-5565df2a7d91 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:21.427745 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7f39228b-00d9-48b8-b1e4-5565df2a7d91 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:21.428490 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7f39228b-00d9-48b8-b1e4-5565df2a7d91 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:21.428912 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7f39228b-00d9-48b8-b1e4-5565df2a7d91 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:21.546121 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-7f39228b-00d9-48b8-b1e4-5565df2a7d91 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:44:21.553786 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-7f39228b-00d9-48b8-b1e4-5565df2a7d91 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1717 microversion: 2.1 time: 0.137419 Nov 01 01:44:21.554345 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1071/2227] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:44:21 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1717 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:44:22.171084 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-ae87b55d-4655-4900-b3b5-1b88e4e2a310 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:44:22.171642 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-ae87b55d-4655-4900-b3b5-1b88e4e2a310 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:44:22.177956 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ae87b55d-4655-4900-b3b5-1b88e4e2a310 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:22.178393 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ae87b55d-4655-4900-b3b5-1b88e4e2a310 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:22.179171 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ae87b55d-4655-4900-b3b5-1b88e4e2a310 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:22.179593 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ae87b55d-4655-4900-b3b5-1b88e4e2a310 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:22.297577 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-ae87b55d-4655-4900-b3b5-1b88e4e2a310 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:44:22.305568 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-ae87b55d-4655-4900-b3b5-1b88e4e2a310 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.138273 Nov 01 01:44:22.306714 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1157/2228] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:44:22 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:44:22.571178 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-a725fb11-2593-49ac-ba1d-550a4d2f6221 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:44:22.571781 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-a725fb11-2593-49ac-ba1d-550a4d2f6221 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:44:22.578869 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a725fb11-2593-49ac-ba1d-550a4d2f6221 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:22.579314 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a725fb11-2593-49ac-ba1d-550a4d2f6221 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:22.580069 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a725fb11-2593-49ac-ba1d-550a4d2f6221 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:22.580495 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a725fb11-2593-49ac-ba1d-550a4d2f6221 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:22.704589 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-a725fb11-2593-49ac-ba1d-550a4d2f6221 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:44:22.708758 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-a725fb11-2593-49ac-ba1d-550a4d2f6221 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1717 microversion: 2.1 time: 0.141243 Nov 01 01:44:22.709315 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1072/2229] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:44:22 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1717 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:44:23.322729 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-178d6a70-aaad-4054-bf33-e050129c0414 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:44:23.323597 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-178d6a70-aaad-4054-bf33-e050129c0414 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:44:23.329826 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-178d6a70-aaad-4054-bf33-e050129c0414 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:23.330268 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-178d6a70-aaad-4054-bf33-e050129c0414 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:23.331075 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-178d6a70-aaad-4054-bf33-e050129c0414 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:23.331494 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-178d6a70-aaad-4054-bf33-e050129c0414 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:23.450930 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-178d6a70-aaad-4054-bf33-e050129c0414 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:44:23.458777 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-178d6a70-aaad-4054-bf33-e050129c0414 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.139635 Nov 01 01:44:23.459344 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1158/2230] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:44:23 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:44:23.837852 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-b368de9a-1314-4d52-8d2f-7dcb03d5f70a tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:44:23.838492 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-b368de9a-1314-4d52-8d2f-7dcb03d5f70a tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:44:23.844900 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b368de9a-1314-4d52-8d2f-7dcb03d5f70a tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:23.845339 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b368de9a-1314-4d52-8d2f-7dcb03d5f70a tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:23.846092 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b368de9a-1314-4d52-8d2f-7dcb03d5f70a tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:23.846541 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b368de9a-1314-4d52-8d2f-7dcb03d5f70a tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:23.967546 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-b368de9a-1314-4d52-8d2f-7dcb03d5f70a tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:44:23.975096 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-b368de9a-1314-4d52-8d2f-7dcb03d5f70a tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1717 microversion: 2.1 time: 0.254008 Nov 01 01:44:23.975646 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1073/2231] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:44:23 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1717 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:44:24.475388 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-5b63ba97-fc20-4a1c-8a36-2233e1f83606 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:44:24.476002 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-5b63ba97-fc20-4a1c-8a36-2233e1f83606 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:44:24.482803 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-5b63ba97-fc20-4a1c-8a36-2233e1f83606 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:24.483249 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-5b63ba97-fc20-4a1c-8a36-2233e1f83606 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:24.483996 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-5b63ba97-fc20-4a1c-8a36-2233e1f83606 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:24.484432 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-5b63ba97-fc20-4a1c-8a36-2233e1f83606 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:24.612002 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-5b63ba97-fc20-4a1c-8a36-2233e1f83606 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:44:24.621063 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-5b63ba97-fc20-4a1c-8a36-2233e1f83606 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.149249 Nov 01 01:44:24.622472 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1159/2232] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:44:24 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:44:24.991737 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-7feaa93c-3d57-45b3-bdaf-39f87fa9e622 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:44:24.992318 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-7feaa93c-3d57-45b3-bdaf-39f87fa9e622 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:44:24.999120 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7feaa93c-3d57-45b3-bdaf-39f87fa9e622 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:24.999558 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7feaa93c-3d57-45b3-bdaf-39f87fa9e622 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:25.000301 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7feaa93c-3d57-45b3-bdaf-39f87fa9e622 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:25.000726 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7feaa93c-3d57-45b3-bdaf-39f87fa9e622 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:25.118489 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-7feaa93c-3d57-45b3-bdaf-39f87fa9e622 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:44:25.127038 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-7feaa93c-3d57-45b3-bdaf-39f87fa9e622 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1717 microversion: 2.1 time: 0.138836 Nov 01 01:44:25.128031 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1074/2233] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:44:24 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1717 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:44:25.638529 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-34dbb004-c63a-4f38-bbec-6fce69dc6c81 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:44:25.639073 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-34dbb004-c63a-4f38-bbec-6fce69dc6c81 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:44:25.644907 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-34dbb004-c63a-4f38-bbec-6fce69dc6c81 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:25.645350 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-34dbb004-c63a-4f38-bbec-6fce69dc6c81 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:25.646103 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-34dbb004-c63a-4f38-bbec-6fce69dc6c81 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:25.646569 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-34dbb004-c63a-4f38-bbec-6fce69dc6c81 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:25.765012 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-34dbb004-c63a-4f38-bbec-6fce69dc6c81 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:44:25.772681 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-34dbb004-c63a-4f38-bbec-6fce69dc6c81 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.138057 Nov 01 01:44:25.773239 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1160/2234] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:44:25 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:44:26.144452 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-9b3e4ad4-a5fb-42e1-a4d8-1accbb318c07 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:44:26.144970 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-9b3e4ad4-a5fb-42e1-a4d8-1accbb318c07 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:44:26.150705 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9b3e4ad4-a5fb-42e1-a4d8-1accbb318c07 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:26.151143 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9b3e4ad4-a5fb-42e1-a4d8-1accbb318c07 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:26.151887 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9b3e4ad4-a5fb-42e1-a4d8-1accbb318c07 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:26.152309 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9b3e4ad4-a5fb-42e1-a4d8-1accbb318c07 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:26.428967 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-9b3e4ad4-a5fb-42e1-a4d8-1accbb318c07 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:44:26.437542 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-9b3e4ad4-a5fb-42e1-a4d8-1accbb318c07 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1717 microversion: 2.1 time: 0.297051 Nov 01 01:44:26.438104 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1075/2235] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:44:26 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1717 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:44:26.789394 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-7b6ab8d6-6317-434b-af26-928e11ef9df6 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:44:26.789928 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-7b6ab8d6-6317-434b-af26-928e11ef9df6 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:44:26.796916 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-7b6ab8d6-6317-434b-af26-928e11ef9df6 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:26.797362 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-7b6ab8d6-6317-434b-af26-928e11ef9df6 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:26.798126 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-7b6ab8d6-6317-434b-af26-928e11ef9df6 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:26.798605 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-7b6ab8d6-6317-434b-af26-928e11ef9df6 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:26.918578 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-7b6ab8d6-6317-434b-af26-928e11ef9df6 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:44:26.926999 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-7b6ab8d6-6317-434b-af26-928e11ef9df6 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.141246 Nov 01 01:44:26.927575 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1161/2236] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:44:26 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:44:27.454908 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-a45f22ba-d2ae-4b93-8411-7e10306b5d40 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:44:27.455512 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-a45f22ba-d2ae-4b93-8411-7e10306b5d40 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:44:27.461683 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a45f22ba-d2ae-4b93-8411-7e10306b5d40 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:27.462118 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a45f22ba-d2ae-4b93-8411-7e10306b5d40 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:27.462904 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a45f22ba-d2ae-4b93-8411-7e10306b5d40 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:27.463324 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a45f22ba-d2ae-4b93-8411-7e10306b5d40 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:27.589296 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-a45f22ba-d2ae-4b93-8411-7e10306b5d40 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:44:27.597519 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-a45f22ba-d2ae-4b93-8411-7e10306b5d40 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1717 microversion: 2.1 time: 0.146185 Nov 01 01:44:27.598059 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1076/2237] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:44:27 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1717 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:44:27.943454 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-5fdbe5cb-f8f6-4732-b525-0d03b3500587 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:44:27.944064 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-5fdbe5cb-f8f6-4732-b525-0d03b3500587 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:44:27.951232 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-5fdbe5cb-f8f6-4732-b525-0d03b3500587 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:27.951681 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-5fdbe5cb-f8f6-4732-b525-0d03b3500587 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:27.952625 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-5fdbe5cb-f8f6-4732-b525-0d03b3500587 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:27.953013 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-5fdbe5cb-f8f6-4732-b525-0d03b3500587 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:28.080768 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-5fdbe5cb-f8f6-4732-b525-0d03b3500587 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:44:28.088467 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-5fdbe5cb-f8f6-4732-b525-0d03b3500587 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.148643 Nov 01 01:44:28.089042 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1162/2238] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:44:27 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:44:28.614250 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-a3a2552d-2cdc-4943-b1cb-463377dd9f2e tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:44:28.614897 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-a3a2552d-2cdc-4943-b1cb-463377dd9f2e tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:44:28.621126 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a3a2552d-2cdc-4943-b1cb-463377dd9f2e tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:28.621778 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a3a2552d-2cdc-4943-b1cb-463377dd9f2e tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:28.622254 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a3a2552d-2cdc-4943-b1cb-463377dd9f2e tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:28.622712 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a3a2552d-2cdc-4943-b1cb-463377dd9f2e tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:28.739998 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-a3a2552d-2cdc-4943-b1cb-463377dd9f2e tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:44:28.747721 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-a3a2552d-2cdc-4943-b1cb-463377dd9f2e tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1717 microversion: 2.1 time: 0.137099 Nov 01 01:44:28.748267 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1077/2239] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:44:28 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1717 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:44:29.104687 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-ef6b136a-38cf-43b8-91d2-118c44bb6730 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:44:29.105327 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-ef6b136a-38cf-43b8-91d2-118c44bb6730 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:44:29.111599 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ef6b136a-38cf-43b8-91d2-118c44bb6730 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:29.112044 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ef6b136a-38cf-43b8-91d2-118c44bb6730 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:29.112796 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ef6b136a-38cf-43b8-91d2-118c44bb6730 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:29.113221 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ef6b136a-38cf-43b8-91d2-118c44bb6730 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:29.230713 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-ef6b136a-38cf-43b8-91d2-118c44bb6730 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:44:29.238350 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-ef6b136a-38cf-43b8-91d2-118c44bb6730 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.137287 Nov 01 01:44:29.238939 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1163/2240] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:44:29 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:44:29.764384 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-b113257a-5618-41fe-82ed-001c2e5ffa5f tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:44:29.764986 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-b113257a-5618-41fe-82ed-001c2e5ffa5f tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:44:29.771165 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b113257a-5618-41fe-82ed-001c2e5ffa5f tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:29.771605 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b113257a-5618-41fe-82ed-001c2e5ffa5f tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:29.772355 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b113257a-5618-41fe-82ed-001c2e5ffa5f tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:29.772787 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b113257a-5618-41fe-82ed-001c2e5ffa5f tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:29.897018 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-b113257a-5618-41fe-82ed-001c2e5ffa5f tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:44:29.905222 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-b113257a-5618-41fe-82ed-001c2e5ffa5f tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1717 microversion: 2.1 time: 0.144521 Nov 01 01:44:29.905796 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1078/2241] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:44:29 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1717 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:44:30.255437 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-b7438255-863c-4554-8c0e-204844430042 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:44:30.256043 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-b7438255-863c-4554-8c0e-204844430042 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:44:30.262322 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b7438255-863c-4554-8c0e-204844430042 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:30.263459 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b7438255-863c-4554-8c0e-204844430042 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:30.264203 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b7438255-863c-4554-8c0e-204844430042 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:30.264627 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b7438255-863c-4554-8c0e-204844430042 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:30.385722 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-b7438255-863c-4554-8c0e-204844430042 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:44:30.394140 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-b7438255-863c-4554-8c0e-204844430042 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.142352 Nov 01 01:44:30.394729 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1164/2242] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:44:30 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:44:30.922372 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-f4549a56-755c-4e5a-876e-8b590d412eba tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:44:30.922973 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-f4549a56-755c-4e5a-876e-8b590d412eba tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:44:30.929177 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f4549a56-755c-4e5a-876e-8b590d412eba tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:30.929615 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f4549a56-755c-4e5a-876e-8b590d412eba tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:30.930368 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f4549a56-755c-4e5a-876e-8b590d412eba tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:30.930824 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f4549a56-755c-4e5a-876e-8b590d412eba tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:31.047947 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-f4549a56-755c-4e5a-876e-8b590d412eba tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:44:31.055511 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-f4549a56-755c-4e5a-876e-8b590d412eba tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1717 microversion: 2.1 time: 0.136838 Nov 01 01:44:31.056057 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1079/2243] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:44:30 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1717 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:44:31.411224 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-4cdd81e5-d58f-43ae-8333-7c8dca84e125 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:44:31.411853 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-4cdd81e5-d58f-43ae-8333-7c8dca84e125 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:44:31.418054 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4cdd81e5-d58f-43ae-8333-7c8dca84e125 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:31.418525 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4cdd81e5-d58f-43ae-8333-7c8dca84e125 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:31.419953 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4cdd81e5-d58f-43ae-8333-7c8dca84e125 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:31.420379 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4cdd81e5-d58f-43ae-8333-7c8dca84e125 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:31.542943 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-4cdd81e5-d58f-43ae-8333-7c8dca84e125 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:44:31.551243 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-4cdd81e5-d58f-43ae-8333-7c8dca84e125 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.143800 Nov 01 01:44:31.551803 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1165/2244] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:44:31 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:44:32.072893 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-767473cf-8af2-4eaf-9cc2-69b7ede113aa tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:44:32.073480 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-767473cf-8af2-4eaf-9cc2-69b7ede113aa tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:44:32.080167 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-767473cf-8af2-4eaf-9cc2-69b7ede113aa tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:32.080604 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-767473cf-8af2-4eaf-9cc2-69b7ede113aa tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:32.081357 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-767473cf-8af2-4eaf-9cc2-69b7ede113aa tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:32.081781 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-767473cf-8af2-4eaf-9cc2-69b7ede113aa tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:32.204991 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-767473cf-8af2-4eaf-9cc2-69b7ede113aa tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:44:32.212629 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-767473cf-8af2-4eaf-9cc2-69b7ede113aa tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1717 microversion: 2.1 time: 0.143629 Nov 01 01:44:32.213181 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1080/2245] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:44:32 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1717 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:44:32.567951 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-6de7feb0-e044-4254-a9f5-d2f646897499 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:44:32.568566 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-6de7feb0-e044-4254-a9f5-d2f646897499 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:44:32.575247 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-6de7feb0-e044-4254-a9f5-d2f646897499 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:32.575696 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-6de7feb0-e044-4254-a9f5-d2f646897499 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:32.576456 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-6de7feb0-e044-4254-a9f5-d2f646897499 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:32.576889 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-6de7feb0-e044-4254-a9f5-d2f646897499 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:32.696771 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-6de7feb0-e044-4254-a9f5-d2f646897499 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:44:32.704954 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-6de7feb0-e044-4254-a9f5-d2f646897499 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.140658 Nov 01 01:44:32.705519 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1166/2246] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:44:32 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:44:33.228532 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-062d09ba-5c31-4856-920d-9eaaa617f309 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:44:33.229133 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-062d09ba-5c31-4856-920d-9eaaa617f309 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:44:33.235813 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-062d09ba-5c31-4856-920d-9eaaa617f309 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:33.236248 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-062d09ba-5c31-4856-920d-9eaaa617f309 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:33.237108 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-062d09ba-5c31-4856-920d-9eaaa617f309 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:33.237537 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-062d09ba-5c31-4856-920d-9eaaa617f309 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:33.359393 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-062d09ba-5c31-4856-920d-9eaaa617f309 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:44:33.367192 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-062d09ba-5c31-4856-920d-9eaaa617f309 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1717 microversion: 2.1 time: 0.142169 Nov 01 01:44:33.367774 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1081/2247] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:44:33 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1717 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:44:33.720828 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-76af8a34-e7ac-456f-9931-5fa1ab656fba tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:44:33.721432 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-76af8a34-e7ac-456f-9931-5fa1ab656fba tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:44:33.727739 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-76af8a34-e7ac-456f-9931-5fa1ab656fba tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:33.728177 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-76af8a34-e7ac-456f-9931-5fa1ab656fba tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:33.728922 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-76af8a34-e7ac-456f-9931-5fa1ab656fba tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:33.729344 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-76af8a34-e7ac-456f-9931-5fa1ab656fba tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:33.847536 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-76af8a34-e7ac-456f-9931-5fa1ab656fba tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:44:33.855171 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-76af8a34-e7ac-456f-9931-5fa1ab656fba tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.138021 Nov 01 01:44:33.855734 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1167/2248] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:44:33 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:44:34.384579 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-e4b35bef-5226-4e4e-a2bc-a6fce5a694f3 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:44:34.385195 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-e4b35bef-5226-4e4e-a2bc-a6fce5a694f3 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:44:34.391452 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e4b35bef-5226-4e4e-a2bc-a6fce5a694f3 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:34.391900 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e4b35bef-5226-4e4e-a2bc-a6fce5a694f3 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:34.392662 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e4b35bef-5226-4e4e-a2bc-a6fce5a694f3 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:34.393092 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e4b35bef-5226-4e4e-a2bc-a6fce5a694f3 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:34.510006 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-e4b35bef-5226-4e4e-a2bc-a6fce5a694f3 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:44:34.517700 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-e4b35bef-5226-4e4e-a2bc-a6fce5a694f3 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1717 microversion: 2.1 time: 0.136772 Nov 01 01:44:34.518254 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1082/2249] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:44:34 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1717 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:44:34.872017 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-b02745f5-18a7-4626-a33d-ff364ecd6a35 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:44:34.872546 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-b02745f5-18a7-4626-a33d-ff364ecd6a35 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:44:34.878810 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b02745f5-18a7-4626-a33d-ff364ecd6a35 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:34.879256 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b02745f5-18a7-4626-a33d-ff364ecd6a35 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:34.880008 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b02745f5-18a7-4626-a33d-ff364ecd6a35 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:34.880440 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b02745f5-18a7-4626-a33d-ff364ecd6a35 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:35.000948 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-b02745f5-18a7-4626-a33d-ff364ecd6a35 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:44:35.008565 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-b02745f5-18a7-4626-a33d-ff364ecd6a35 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.140279 Nov 01 01:44:35.009127 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1168/2250] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:44:34 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:44:35.534315 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-df59f6cc-3a17-4810-b2ad-b4b57bb81d33 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:44:35.534937 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-df59f6cc-3a17-4810-b2ad-b4b57bb81d33 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:44:35.541051 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-df59f6cc-3a17-4810-b2ad-b4b57bb81d33 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:35.541495 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-df59f6cc-3a17-4810-b2ad-b4b57bb81d33 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:35.542279 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-df59f6cc-3a17-4810-b2ad-b4b57bb81d33 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:35.542727 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-df59f6cc-3a17-4810-b2ad-b4b57bb81d33 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:35.659532 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-df59f6cc-3a17-4810-b2ad-b4b57bb81d33 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:44:35.667167 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-df59f6cc-3a17-4810-b2ad-b4b57bb81d33 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1717 microversion: 2.1 time: 0.136529 Nov 01 01:44:35.667714 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1083/2251] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:44:35 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1717 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:44:36.025016 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-ccdc4817-35c3-4d95-a840-b6fbf3dca76f tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:44:36.025634 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-ccdc4817-35c3-4d95-a840-b6fbf3dca76f tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:44:36.033949 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ccdc4817-35c3-4d95-a840-b6fbf3dca76f tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:36.034386 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ccdc4817-35c3-4d95-a840-b6fbf3dca76f tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:36.035192 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ccdc4817-35c3-4d95-a840-b6fbf3dca76f tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:36.035616 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ccdc4817-35c3-4d95-a840-b6fbf3dca76f tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:36.159549 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-ccdc4817-35c3-4d95-a840-b6fbf3dca76f tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:44:36.167422 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-ccdc4817-35c3-4d95-a840-b6fbf3dca76f tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.146145 Nov 01 01:44:36.167994 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1169/2252] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:44:36 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:44:36.685010 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-d3c6132e-93a2-4a84-8661-26a9ad71e932 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:44:36.685646 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-d3c6132e-93a2-4a84-8661-26a9ad71e932 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:44:36.691904 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d3c6132e-93a2-4a84-8661-26a9ad71e932 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:36.692351 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d3c6132e-93a2-4a84-8661-26a9ad71e932 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:36.693112 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d3c6132e-93a2-4a84-8661-26a9ad71e932 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:36.693544 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d3c6132e-93a2-4a84-8661-26a9ad71e932 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:36.812679 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-d3c6132e-93a2-4a84-8661-26a9ad71e932 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:44:36.820316 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-d3c6132e-93a2-4a84-8661-26a9ad71e932 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1717 microversion: 2.1 time: 0.139436 Nov 01 01:44:36.820873 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1084/2253] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:44:36 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1717 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:44:37.183999 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-7c077ec4-c9ce-4d6f-a948-cd52e593a649 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:44:37.184594 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-7c077ec4-c9ce-4d6f-a948-cd52e593a649 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:44:37.190786 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-7c077ec4-c9ce-4d6f-a948-cd52e593a649 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:37.191228 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-7c077ec4-c9ce-4d6f-a948-cd52e593a649 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:37.191973 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-7c077ec4-c9ce-4d6f-a948-cd52e593a649 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:37.192398 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-7c077ec4-c9ce-4d6f-a948-cd52e593a649 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:37.308662 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-7c077ec4-c9ce-4d6f-a948-cd52e593a649 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:44:37.316187 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-7c077ec4-c9ce-4d6f-a948-cd52e593a649 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.135791 Nov 01 01:44:37.316742 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1170/2254] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:44:37 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:44:37.837969 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-da3830f8-4d95-4fb8-87b8-66fd75f6f62d tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:44:37.838612 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-da3830f8-4d95-4fb8-87b8-66fd75f6f62d tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:44:37.844919 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-da3830f8-4d95-4fb8-87b8-66fd75f6f62d tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:37.845362 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-da3830f8-4d95-4fb8-87b8-66fd75f6f62d tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:37.846122 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-da3830f8-4d95-4fb8-87b8-66fd75f6f62d tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:37.846592 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-da3830f8-4d95-4fb8-87b8-66fd75f6f62d tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:37.963546 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-da3830f8-4d95-4fb8-87b8-66fd75f6f62d tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:44:37.971343 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-da3830f8-4d95-4fb8-87b8-66fd75f6f62d tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1717 microversion: 2.1 time: 0.136965 Nov 01 01:44:37.971896 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1085/2255] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:44:37 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1717 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:44:38.255274 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 01 01:44:38.255506 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: Mon Nov 1 01:44:38 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 01 01:44:38.333398 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-474f7ffa-dc24-4b8a-80a0-3516c75d4f77 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:44:38.334031 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-474f7ffa-dc24-4b8a-80a0-3516c75d4f77 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:44:38.340208 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-474f7ffa-dc24-4b8a-80a0-3516c75d4f77 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:38.341148 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-474f7ffa-dc24-4b8a-80a0-3516c75d4f77 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:38.341960 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-474f7ffa-dc24-4b8a-80a0-3516c75d4f77 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:38.342383 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-474f7ffa-dc24-4b8a-80a0-3516c75d4f77 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:38.467140 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-474f7ffa-dc24-4b8a-80a0-3516c75d4f77 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:44:38.474815 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-474f7ffa-dc24-4b8a-80a0-3516c75d4f77 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.145063 Nov 01 01:44:38.475385 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1171/2256] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:44:38 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:44:38.988010 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-44322946-0ee6-4851-8209-9b8fd560a0e4 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:44:38.988626 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-44322946-0ee6-4851-8209-9b8fd560a0e4 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:44:38.994916 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-44322946-0ee6-4851-8209-9b8fd560a0e4 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:38.995360 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-44322946-0ee6-4851-8209-9b8fd560a0e4 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:38.996114 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-44322946-0ee6-4851-8209-9b8fd560a0e4 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:38.996544 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-44322946-0ee6-4851-8209-9b8fd560a0e4 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:39.113093 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-44322946-0ee6-4851-8209-9b8fd560a0e4 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:44:39.120829 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-44322946-0ee6-4851-8209-9b8fd560a0e4 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1717 microversion: 2.1 time: 0.136495 Nov 01 01:44:39.121379 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1086/2257] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:44:38 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1717 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:44:39.491452 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-b2928cde-2c6b-433e-9714-12127c880491 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:44:39.492093 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-b2928cde-2c6b-433e-9714-12127c880491 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:44:39.499036 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b2928cde-2c6b-433e-9714-12127c880491 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:39.499488 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b2928cde-2c6b-433e-9714-12127c880491 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:39.500245 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b2928cde-2c6b-433e-9714-12127c880491 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:39.500671 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b2928cde-2c6b-433e-9714-12127c880491 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:39.620622 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-b2928cde-2c6b-433e-9714-12127c880491 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:44:39.628680 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-b2928cde-2c6b-433e-9714-12127c880491 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.140803 Nov 01 01:44:39.629249 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1172/2258] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:44:39 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:44:40.138527 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-cb629432-5f33-403f-86c7-7b9a0a6ee951 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:44:40.139067 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-cb629432-5f33-403f-86c7-7b9a0a6ee951 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:44:40.145147 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-cb629432-5f33-403f-86c7-7b9a0a6ee951 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:40.145590 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-cb629432-5f33-403f-86c7-7b9a0a6ee951 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:40.146338 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-cb629432-5f33-403f-86c7-7b9a0a6ee951 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:40.146790 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-cb629432-5f33-403f-86c7-7b9a0a6ee951 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:40.267762 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-cb629432-5f33-403f-86c7-7b9a0a6ee951 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:44:40.275299 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-cb629432-5f33-403f-86c7-7b9a0a6ee951 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1717 microversion: 2.1 time: 0.141040 Nov 01 01:44:40.275842 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1087/2259] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:44:40 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1717 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:44:40.644852 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-ab32739f-1913-49a4-94e0-177954a1a32b tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:44:40.645458 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-ab32739f-1913-49a4-94e0-177954a1a32b tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:44:40.651649 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ab32739f-1913-49a4-94e0-177954a1a32b tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:40.652084 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ab32739f-1913-49a4-94e0-177954a1a32b tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:40.652834 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ab32739f-1913-49a4-94e0-177954a1a32b tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:40.653258 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ab32739f-1913-49a4-94e0-177954a1a32b tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:40.773577 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-ab32739f-1913-49a4-94e0-177954a1a32b tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:44:40.781305 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-ab32739f-1913-49a4-94e0-177954a1a32b tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.140194 Nov 01 01:44:40.781862 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1173/2260] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:44:40 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:44:41.292669 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-7ec879ce-6bb5-44d2-b359-1da753e37aef tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:44:41.293258 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-7ec879ce-6bb5-44d2-b359-1da753e37aef tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:44:41.299430 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7ec879ce-6bb5-44d2-b359-1da753e37aef tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:41.299872 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7ec879ce-6bb5-44d2-b359-1da753e37aef tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:41.300615 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7ec879ce-6bb5-44d2-b359-1da753e37aef tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:41.301035 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7ec879ce-6bb5-44d2-b359-1da753e37aef tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:41.417656 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-7ec879ce-6bb5-44d2-b359-1da753e37aef tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:44:41.425236 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-7ec879ce-6bb5-44d2-b359-1da753e37aef tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1717 microversion: 2.1 time: 0.136236 Nov 01 01:44:41.425786 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1088/2261] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:44:41 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1717 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:44:41.798036 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-c8b5e79c-0583-4a08-8c5b-db6d4a1b1146 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:44:41.798665 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-c8b5e79c-0583-4a08-8c5b-db6d4a1b1146 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:44:41.804942 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c8b5e79c-0583-4a08-8c5b-db6d4a1b1146 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:41.805324 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c8b5e79c-0583-4a08-8c5b-db6d4a1b1146 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:41.806067 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c8b5e79c-0583-4a08-8c5b-db6d4a1b1146 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:41.806521 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c8b5e79c-0583-4a08-8c5b-db6d4a1b1146 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:41.926549 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-c8b5e79c-0583-4a08-8c5b-db6d4a1b1146 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:44:41.934059 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-c8b5e79c-0583-4a08-8c5b-db6d4a1b1146 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.139637 Nov 01 01:44:41.935273 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1174/2262] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:44:41 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:44:42.441901 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-658eb9b3-b136-4432-bacd-622a6e7008c3 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:44:42.442524 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-658eb9b3-b136-4432-bacd-622a6e7008c3 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:44:42.448889 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-658eb9b3-b136-4432-bacd-622a6e7008c3 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:42.449325 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-658eb9b3-b136-4432-bacd-622a6e7008c3 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:42.450070 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-658eb9b3-b136-4432-bacd-622a6e7008c3 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:42.450522 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-658eb9b3-b136-4432-bacd-622a6e7008c3 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:42.567338 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-658eb9b3-b136-4432-bacd-622a6e7008c3 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:44:42.575162 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-658eb9b3-b136-4432-bacd-622a6e7008c3 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1717 microversion: 2.1 time: 0.136831 Nov 01 01:44:42.575709 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1089/2263] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:44:42 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1717 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:44:42.952196 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-d33322f0-64b4-4353-99a8-385dd9ba36c7 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:44:42.952814 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-d33322f0-64b4-4353-99a8-385dd9ba36c7 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:44:42.959132 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d33322f0-64b4-4353-99a8-385dd9ba36c7 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:42.959574 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d33322f0-64b4-4353-99a8-385dd9ba36c7 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:42.960321 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d33322f0-64b4-4353-99a8-385dd9ba36c7 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:42.960747 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d33322f0-64b4-4353-99a8-385dd9ba36c7 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:43.078044 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-d33322f0-64b4-4353-99a8-385dd9ba36c7 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:44:43.085735 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-d33322f0-64b4-4353-99a8-385dd9ba36c7 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.137676 Nov 01 01:44:43.086293 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1175/2264] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:44:42 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:44:43.593240 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-a37d0e0f-d696-4333-8a7c-a362217400f3 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:44:43.593872 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-a37d0e0f-d696-4333-8a7c-a362217400f3 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:44:43.600085 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a37d0e0f-d696-4333-8a7c-a362217400f3 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:43.600533 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a37d0e0f-d696-4333-8a7c-a362217400f3 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:43.601294 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a37d0e0f-d696-4333-8a7c-a362217400f3 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:43.601725 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a37d0e0f-d696-4333-8a7c-a362217400f3 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:43.721932 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-a37d0e0f-d696-4333-8a7c-a362217400f3 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:44:43.729570 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-a37d0e0f-d696-4333-8a7c-a362217400f3 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1717 microversion: 2.1 time: 0.139959 Nov 01 01:44:43.730124 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1090/2265] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:44:43 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1717 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:44:44.102408 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-3197195f-f22c-4c17-836d-e0030340a7a3 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:44:44.103015 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-3197195f-f22c-4c17-836d-e0030340a7a3 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:44:44.109746 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3197195f-f22c-4c17-836d-e0030340a7a3 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:44.110182 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3197195f-f22c-4c17-836d-e0030340a7a3 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:44.111108 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3197195f-f22c-4c17-836d-e0030340a7a3 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:44.111531 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3197195f-f22c-4c17-836d-e0030340a7a3 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:44.229503 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-3197195f-f22c-4c17-836d-e0030340a7a3 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:44:44.237175 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-3197195f-f22c-4c17-836d-e0030340a7a3 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.138489 Nov 01 01:44:44.237737 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1176/2266] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:44:44 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:44:44.746776 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-bc48a2e0-e400-4aa7-9520-427cb0ffb13a tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:44:44.747904 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-bc48a2e0-e400-4aa7-9520-427cb0ffb13a tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:44:44.754032 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-bc48a2e0-e400-4aa7-9520-427cb0ffb13a tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:44.754505 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-bc48a2e0-e400-4aa7-9520-427cb0ffb13a tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:44.755262 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-bc48a2e0-e400-4aa7-9520-427cb0ffb13a tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:44.755692 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-bc48a2e0-e400-4aa7-9520-427cb0ffb13a tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:44.871482 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-bc48a2e0-e400-4aa7-9520-427cb0ffb13a tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:44:44.879631 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-bc48a2e0-e400-4aa7-9520-427cb0ffb13a tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1717 microversion: 2.1 time: 0.136400 Nov 01 01:44:44.880255 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1091/2267] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:44:44 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1717 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:44:45.190186 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 01 01:44:45.190387 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: Mon Nov 1 01:44:45 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 01 01:44:45.253763 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-a3e70a8a-94ad-4345-982e-9e4333622594 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:44:45.254378 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-a3e70a8a-94ad-4345-982e-9e4333622594 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:44:45.260616 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a3e70a8a-94ad-4345-982e-9e4333622594 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:45.261061 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a3e70a8a-94ad-4345-982e-9e4333622594 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:45.261822 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a3e70a8a-94ad-4345-982e-9e4333622594 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:45.262245 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a3e70a8a-94ad-4345-982e-9e4333622594 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:45.383824 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-a3e70a8a-94ad-4345-982e-9e4333622594 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:44:45.392245 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-a3e70a8a-94ad-4345-982e-9e4333622594 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.142235 Nov 01 01:44:45.392803 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1177/2268] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:44:45 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:44:45.896594 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-5c65f95b-0238-4d3b-bd3e-6933d5bdaa57 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:44:45.897198 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-5c65f95b-0238-4d3b-bd3e-6933d5bdaa57 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:44:45.903401 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5c65f95b-0238-4d3b-bd3e-6933d5bdaa57 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:45.903848 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5c65f95b-0238-4d3b-bd3e-6933d5bdaa57 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:45.904600 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5c65f95b-0238-4d3b-bd3e-6933d5bdaa57 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:45.905037 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5c65f95b-0238-4d3b-bd3e-6933d5bdaa57 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:46.025346 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-5c65f95b-0238-4d3b-bd3e-6933d5bdaa57 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:44:46.033609 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-5c65f95b-0238-4d3b-bd3e-6933d5bdaa57 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1717 microversion: 2.1 time: 0.140624 Nov 01 01:44:46.034165 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1092/2269] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:44:45 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1717 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:44:46.409694 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-62cf82fb-3dc7-4153-a0ec-88fb14f0f4a5 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:44:46.410329 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-62cf82fb-3dc7-4153-a0ec-88fb14f0f4a5 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:44:46.416628 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-62cf82fb-3dc7-4153-a0ec-88fb14f0f4a5 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:46.417072 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-62cf82fb-3dc7-4153-a0ec-88fb14f0f4a5 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:46.417832 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-62cf82fb-3dc7-4153-a0ec-88fb14f0f4a5 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:46.418261 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-62cf82fb-3dc7-4153-a0ec-88fb14f0f4a5 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:46.537267 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-62cf82fb-3dc7-4153-a0ec-88fb14f0f4a5 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:44:46.544952 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-62cf82fb-3dc7-4153-a0ec-88fb14f0f4a5 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.139086 Nov 01 01:44:46.545517 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1178/2270] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:44:46 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:44:47.050264 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-37ad5ec0-e57a-45a0-8d02-5480545f9357 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:44:47.050870 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-37ad5ec0-e57a-45a0-8d02-5480545f9357 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:44:47.057276 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-37ad5ec0-e57a-45a0-8d02-5480545f9357 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:47.057729 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-37ad5ec0-e57a-45a0-8d02-5480545f9357 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:47.058547 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-37ad5ec0-e57a-45a0-8d02-5480545f9357 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:47.059011 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-37ad5ec0-e57a-45a0-8d02-5480545f9357 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:47.180705 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-37ad5ec0-e57a-45a0-8d02-5480545f9357 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:44:47.190244 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-37ad5ec0-e57a-45a0-8d02-5480545f9357 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1717 microversion: 2.1 time: 0.143452 Nov 01 01:44:47.191122 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1093/2271] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:44:47 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1717 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:44:47.562640 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-129b00ca-f98b-4303-9333-718a082bb3e2 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:44:47.563272 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-129b00ca-f98b-4303-9333-718a082bb3e2 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:44:47.569461 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-129b00ca-f98b-4303-9333-718a082bb3e2 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:47.569899 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-129b00ca-f98b-4303-9333-718a082bb3e2 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:47.570685 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-129b00ca-f98b-4303-9333-718a082bb3e2 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:47.571112 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-129b00ca-f98b-4303-9333-718a082bb3e2 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:47.687981 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-129b00ca-f98b-4303-9333-718a082bb3e2 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:44:47.695579 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-129b00ca-f98b-4303-9333-718a082bb3e2 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.136679 Nov 01 01:44:47.696135 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1179/2272] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:44:47 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:44:48.208562 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-3b9b6d0f-d52b-4d5c-9e52-ab13f0d9ca88 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:44:48.209160 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-3b9b6d0f-d52b-4d5c-9e52-ab13f0d9ca88 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:44:48.215401 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3b9b6d0f-d52b-4d5c-9e52-ab13f0d9ca88 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:48.215840 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3b9b6d0f-d52b-4d5c-9e52-ab13f0d9ca88 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:48.216588 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3b9b6d0f-d52b-4d5c-9e52-ab13f0d9ca88 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:48.217012 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3b9b6d0f-d52b-4d5c-9e52-ab13f0d9ca88 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:48.334440 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-3b9b6d0f-d52b-4d5c-9e52-ab13f0d9ca88 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:44:48.342486 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-3b9b6d0f-d52b-4d5c-9e52-ab13f0d9ca88 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1717 microversion: 2.1 time: 0.137523 Nov 01 01:44:48.343033 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1094/2273] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:44:48 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1717 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:44:48.712377 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-3815cb85-eb68-48c4-a354-203c4a5c0526 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:44:48.712991 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-3815cb85-eb68-48c4-a354-203c4a5c0526 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:44:48.719855 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3815cb85-eb68-48c4-a354-203c4a5c0526 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:48.720304 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3815cb85-eb68-48c4-a354-203c4a5c0526 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:48.721069 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3815cb85-eb68-48c4-a354-203c4a5c0526 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:48.721500 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3815cb85-eb68-48c4-a354-203c4a5c0526 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:48.841917 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-3815cb85-eb68-48c4-a354-203c4a5c0526 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:44:48.849717 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-3815cb85-eb68-48c4-a354-203c4a5c0526 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.141041 Nov 01 01:44:48.850285 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1180/2274] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:44:48 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:44:49.359097 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-24694ab5-221a-4c4b-9a9f-06613506b6e8 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:44:49.359733 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-24694ab5-221a-4c4b-9a9f-06613506b6e8 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:44:49.366162 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-24694ab5-221a-4c4b-9a9f-06613506b6e8 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:49.366907 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-24694ab5-221a-4c4b-9a9f-06613506b6e8 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:49.367387 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-24694ab5-221a-4c4b-9a9f-06613506b6e8 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:49.367815 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-24694ab5-221a-4c4b-9a9f-06613506b6e8 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:49.487654 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-24694ab5-221a-4c4b-9a9f-06613506b6e8 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:44:49.495380 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-24694ab5-221a-4c4b-9a9f-06613506b6e8 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1717 microversion: 2.1 time: 0.140031 Nov 01 01:44:49.495933 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1095/2275] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:44:49 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1717 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:44:49.866236 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-0952ced1-5546-4f45-acc3-eddf5e60e94f tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:44:49.866866 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-0952ced1-5546-4f45-acc3-eddf5e60e94f tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:44:49.873050 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0952ced1-5546-4f45-acc3-eddf5e60e94f tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:49.873491 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0952ced1-5546-4f45-acc3-eddf5e60e94f tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:49.874233 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0952ced1-5546-4f45-acc3-eddf5e60e94f tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:49.874687 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0952ced1-5546-4f45-acc3-eddf5e60e94f tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:49.992144 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-0952ced1-5546-4f45-acc3-eddf5e60e94f tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:44:49.999835 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-0952ced1-5546-4f45-acc3-eddf5e60e94f tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.137210 Nov 01 01:44:50.001916 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1181/2276] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:44:49 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:44:50.512612 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-bd5c0712-4e74-4212-88e2-e9581d5d1495 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:44:50.513820 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-bd5c0712-4e74-4212-88e2-e9581d5d1495 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:44:50.520001 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-bd5c0712-4e74-4212-88e2-e9581d5d1495 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:50.520440 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-bd5c0712-4e74-4212-88e2-e9581d5d1495 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:50.521188 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-bd5c0712-4e74-4212-88e2-e9581d5d1495 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:50.521612 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-bd5c0712-4e74-4212-88e2-e9581d5d1495 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:50.641305 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-bd5c0712-4e74-4212-88e2-e9581d5d1495 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:44:50.648940 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-bd5c0712-4e74-4212-88e2-e9581d5d1495 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1717 microversion: 2.1 time: 0.139941 Nov 01 01:44:50.649489 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1096/2277] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:44:50 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1717 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:44:51.015598 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-cb557858-1847-463c-a13e-58bc1da5704f tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:44:51.016207 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-cb557858-1847-463c-a13e-58bc1da5704f tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:44:51.022350 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-cb557858-1847-463c-a13e-58bc1da5704f tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:51.022824 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-cb557858-1847-463c-a13e-58bc1da5704f tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:51.023575 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-cb557858-1847-463c-a13e-58bc1da5704f tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:51.023996 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-cb557858-1847-463c-a13e-58bc1da5704f tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:51.141168 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-cb557858-1847-463c-a13e-58bc1da5704f tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:44:51.149337 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-cb557858-1847-463c-a13e-58bc1da5704f tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.137314 Nov 01 01:44:51.149904 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1182/2278] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:44:51 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:44:51.664866 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-236a680e-a589-4319-8e12-e65780f11fed tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:44:51.665398 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-236a680e-a589-4319-8e12-e65780f11fed tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:44:51.671663 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-236a680e-a589-4319-8e12-e65780f11fed tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:51.672114 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-236a680e-a589-4319-8e12-e65780f11fed tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:51.672880 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-236a680e-a589-4319-8e12-e65780f11fed tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:51.673312 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-236a680e-a589-4319-8e12-e65780f11fed tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:51.790773 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-236a680e-a589-4319-8e12-e65780f11fed tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:44:51.798318 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-236a680e-a589-4319-8e12-e65780f11fed tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1717 microversion: 2.1 time: 0.137209 Nov 01 01:44:51.798897 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1097/2279] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:44:51 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1717 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:44:52.166172 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-93fbc806-e212-4ce7-8595-5b66cc23bf02 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:44:52.166826 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-93fbc806-e212-4ce7-8595-5b66cc23bf02 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:44:52.173189 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-93fbc806-e212-4ce7-8595-5b66cc23bf02 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:52.173636 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-93fbc806-e212-4ce7-8595-5b66cc23bf02 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:52.174399 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-93fbc806-e212-4ce7-8595-5b66cc23bf02 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:52.174860 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-93fbc806-e212-4ce7-8595-5b66cc23bf02 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:52.294259 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-93fbc806-e212-4ce7-8595-5b66cc23bf02 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:44:52.301937 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-93fbc806-e212-4ce7-8595-5b66cc23bf02 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.139461 Nov 01 01:44:52.302516 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1183/2280] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:44:52 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:44:52.815093 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-3030b660-65d4-48a7-9c8b-312909284149 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:44:52.815697 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-3030b660-65d4-48a7-9c8b-312909284149 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:44:52.822146 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3030b660-65d4-48a7-9c8b-312909284149 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:52.822633 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3030b660-65d4-48a7-9c8b-312909284149 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:52.823384 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3030b660-65d4-48a7-9c8b-312909284149 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:52.823811 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3030b660-65d4-48a7-9c8b-312909284149 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:52.940315 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-3030b660-65d4-48a7-9c8b-312909284149 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:44:52.948538 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-3030b660-65d4-48a7-9c8b-312909284149 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1717 microversion: 2.1 time: 0.137200 Nov 01 01:44:52.949095 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1098/2281] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:44:52 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1717 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:44:53.318378 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-3eb6f87d-d9eb-4e40-99cc-692cfff26bcc tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:44:53.319025 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-3eb6f87d-d9eb-4e40-99cc-692cfff26bcc tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:44:53.325469 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3eb6f87d-d9eb-4e40-99cc-692cfff26bcc tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:53.325909 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3eb6f87d-d9eb-4e40-99cc-692cfff26bcc tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:53.327162 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3eb6f87d-d9eb-4e40-99cc-692cfff26bcc tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:53.327599 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3eb6f87d-d9eb-4e40-99cc-692cfff26bcc tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:53.446310 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-3eb6f87d-d9eb-4e40-99cc-692cfff26bcc tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:44:53.454818 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-3eb6f87d-d9eb-4e40-99cc-692cfff26bcc tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.140046 Nov 01 01:44:53.455375 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1184/2282] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:44:53 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:44:53.964777 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-490861a3-9718-41de-9899-3d58e99b4a0a tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:44:53.965385 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-490861a3-9718-41de-9899-3d58e99b4a0a tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:44:53.971578 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-490861a3-9718-41de-9899-3d58e99b4a0a tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:53.972027 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-490861a3-9718-41de-9899-3d58e99b4a0a tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:53.972782 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-490861a3-9718-41de-9899-3d58e99b4a0a tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:53.973214 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-490861a3-9718-41de-9899-3d58e99b4a0a tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:54.097600 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-490861a3-9718-41de-9899-3d58e99b4a0a tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:44:54.105348 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-490861a3-9718-41de-9899-3d58e99b4a0a tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1717 microversion: 2.1 time: 0.144232 Nov 01 01:44:54.105900 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1099/2283] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:44:53 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1717 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:44:54.471424 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-30f3d55d-8683-4e07-b14f-651f9e7d2d28 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:44:54.472182 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-30f3d55d-8683-4e07-b14f-651f9e7d2d28 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:44:54.478385 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-30f3d55d-8683-4e07-b14f-651f9e7d2d28 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:54.478856 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-30f3d55d-8683-4e07-b14f-651f9e7d2d28 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:54.479613 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-30f3d55d-8683-4e07-b14f-651f9e7d2d28 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:54.480035 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-30f3d55d-8683-4e07-b14f-651f9e7d2d28 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:54.598666 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-30f3d55d-8683-4e07-b14f-651f9e7d2d28 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:44:54.606290 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-30f3d55d-8683-4e07-b14f-651f9e7d2d28 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.138535 Nov 01 01:44:54.606879 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1185/2284] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:44:54 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:44:55.122159 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-b90cc55c-5a80-4623-81a6-243f8303d48e tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:44:55.122807 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-b90cc55c-5a80-4623-81a6-243f8303d48e tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:44:55.128909 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b90cc55c-5a80-4623-81a6-243f8303d48e tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:55.129353 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b90cc55c-5a80-4623-81a6-243f8303d48e tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:55.130133 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b90cc55c-5a80-4623-81a6-243f8303d48e tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:55.130585 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b90cc55c-5a80-4623-81a6-243f8303d48e tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:55.248567 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-b90cc55c-5a80-4623-81a6-243f8303d48e tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:44:55.256987 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-b90cc55c-5a80-4623-81a6-243f8303d48e tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1717 microversion: 2.1 time: 0.138435 Nov 01 01:44:55.257550 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1100/2285] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:44:55 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1717 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:44:55.622984 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-7d117a0b-23b2-4df0-a2e5-fbbca5f9704a tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:44:55.623576 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-7d117a0b-23b2-4df0-a2e5-fbbca5f9704a tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:44:55.630038 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-7d117a0b-23b2-4df0-a2e5-fbbca5f9704a tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:55.630537 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-7d117a0b-23b2-4df0-a2e5-fbbca5f9704a tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:55.631292 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-7d117a0b-23b2-4df0-a2e5-fbbca5f9704a tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:55.631721 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-7d117a0b-23b2-4df0-a2e5-fbbca5f9704a tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:55.755570 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-7d117a0b-23b2-4df0-a2e5-fbbca5f9704a tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:44:55.763228 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-7d117a0b-23b2-4df0-a2e5-fbbca5f9704a tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.143904 Nov 01 01:44:55.763787 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1186/2286] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:44:55 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:44:56.272675 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-9643d6a9-3c48-4b5a-a6e1-e307328ffac5 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:44:56.273271 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-9643d6a9-3c48-4b5a-a6e1-e307328ffac5 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:44:56.279234 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9643d6a9-3c48-4b5a-a6e1-e307328ffac5 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:56.279675 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9643d6a9-3c48-4b5a-a6e1-e307328ffac5 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:56.280423 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9643d6a9-3c48-4b5a-a6e1-e307328ffac5 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:56.280849 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9643d6a9-3c48-4b5a-a6e1-e307328ffac5 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:56.412804 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-9643d6a9-3c48-4b5a-a6e1-e307328ffac5 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:44:56.418378 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-9643d6a9-3c48-4b5a-a6e1-e307328ffac5 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1717 microversion: 2.1 time: 0.149359 Nov 01 01:44:56.418946 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1101/2287] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:44:56 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1717 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:44:56.779875 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-7ae7dc81-c84f-4eea-b125-bb1a65339649 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:44:56.780480 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-7ae7dc81-c84f-4eea-b125-bb1a65339649 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:44:56.786730 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-7ae7dc81-c84f-4eea-b125-bb1a65339649 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:56.787172 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-7ae7dc81-c84f-4eea-b125-bb1a65339649 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:56.787922 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-7ae7dc81-c84f-4eea-b125-bb1a65339649 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:56.788349 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-7ae7dc81-c84f-4eea-b125-bb1a65339649 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:56.904417 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-7ae7dc81-c84f-4eea-b125-bb1a65339649 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:44:56.912104 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-7ae7dc81-c84f-4eea-b125-bb1a65339649 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.135942 Nov 01 01:44:56.912664 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1187/2288] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:44:56 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:44:57.435040 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-ff244f12-632e-43ba-ab18-a2d7d084debf tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:44:57.435635 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-ff244f12-632e-43ba-ab18-a2d7d084debf tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:44:57.441820 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ff244f12-632e-43ba-ab18-a2d7d084debf tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:57.442261 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ff244f12-632e-43ba-ab18-a2d7d084debf tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:57.443046 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ff244f12-632e-43ba-ab18-a2d7d084debf tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:57.443475 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ff244f12-632e-43ba-ab18-a2d7d084debf tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:57.562835 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-ff244f12-632e-43ba-ab18-a2d7d084debf tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:44:57.570957 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-ff244f12-632e-43ba-ab18-a2d7d084debf tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1717 microversion: 2.1 time: 0.139547 Nov 01 01:44:57.571507 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1102/2289] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:44:57 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1717 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:44:57.929383 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-9d008362-c2f6-42e5-a3d6-9d16fccba88a tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:44:57.929994 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-9d008362-c2f6-42e5-a3d6-9d16fccba88a tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:44:57.936244 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9d008362-c2f6-42e5-a3d6-9d16fccba88a tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:57.936688 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9d008362-c2f6-42e5-a3d6-9d16fccba88a tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:57.937476 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9d008362-c2f6-42e5-a3d6-9d16fccba88a tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:57.937903 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9d008362-c2f6-42e5-a3d6-9d16fccba88a tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:58.060772 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-9d008362-c2f6-42e5-a3d6-9d16fccba88a tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:44:58.069512 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-9d008362-c2f6-42e5-a3d6-9d16fccba88a tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.144281 Nov 01 01:44:58.070079 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1188/2290] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:44:57 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:44:58.588441 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-131d32f3-96d1-44cd-a41a-3ce0e80c7374 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:44:58.589004 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-131d32f3-96d1-44cd-a41a-3ce0e80c7374 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:44:58.595171 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-131d32f3-96d1-44cd-a41a-3ce0e80c7374 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:58.595617 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-131d32f3-96d1-44cd-a41a-3ce0e80c7374 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:58.596377 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-131d32f3-96d1-44cd-a41a-3ce0e80c7374 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:58.597327 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-131d32f3-96d1-44cd-a41a-3ce0e80c7374 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:58.715078 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-131d32f3-96d1-44cd-a41a-3ce0e80c7374 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:44:58.723416 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-131d32f3-96d1-44cd-a41a-3ce0e80c7374 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1717 microversion: 2.1 time: 0.138734 Nov 01 01:44:58.723978 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1103/2291] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:44:58 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1717 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:44:59.087020 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-b26cfcca-a287-4e8e-98b7-bec3fc49a2d0 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:44:59.087639 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-b26cfcca-a287-4e8e-98b7-bec3fc49a2d0 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:44:59.093864 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b26cfcca-a287-4e8e-98b7-bec3fc49a2d0 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:59.094315 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b26cfcca-a287-4e8e-98b7-bec3fc49a2d0 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:59.095107 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b26cfcca-a287-4e8e-98b7-bec3fc49a2d0 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:59.095540 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b26cfcca-a287-4e8e-98b7-bec3fc49a2d0 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:59.216369 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-b26cfcca-a287-4e8e-98b7-bec3fc49a2d0 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:44:59.224069 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-b26cfcca-a287-4e8e-98b7-bec3fc49a2d0 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.140711 Nov 01 01:44:59.224634 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1189/2292] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:44:59 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:44:59.739890 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-dd68afb8-39c5-4cff-b25d-f01830ebec8d tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:44:59.740497 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-dd68afb8-39c5-4cff-b25d-f01830ebec8d tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:44:59.746700 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-dd68afb8-39c5-4cff-b25d-f01830ebec8d tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:59.747151 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-dd68afb8-39c5-4cff-b25d-f01830ebec8d tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:59.747914 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-dd68afb8-39c5-4cff-b25d-f01830ebec8d tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:44:59.748350 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-dd68afb8-39c5-4cff-b25d-f01830ebec8d tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:44:59.865221 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-dd68afb8-39c5-4cff-b25d-f01830ebec8d tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:44:59.872896 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-dd68afb8-39c5-4cff-b25d-f01830ebec8d tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1717 microversion: 2.1 time: 0.137208 Nov 01 01:44:59.873453 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1104/2293] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:44:59 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1717 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:45:00.240644 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-502ab7fd-15fe-4aeb-a5cd-23e7d9bffd68 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:45:00.241249 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-502ab7fd-15fe-4aeb-a5cd-23e7d9bffd68 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:45:00.247587 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-502ab7fd-15fe-4aeb-a5cd-23e7d9bffd68 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:00.250112 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-502ab7fd-15fe-4aeb-a5cd-23e7d9bffd68 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:00.250112 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-502ab7fd-15fe-4aeb-a5cd-23e7d9bffd68 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:00.250112 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-502ab7fd-15fe-4aeb-a5cd-23e7d9bffd68 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:00.367695 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-502ab7fd-15fe-4aeb-a5cd-23e7d9bffd68 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:45:00.375465 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-502ab7fd-15fe-4aeb-a5cd-23e7d9bffd68 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.138611 Nov 01 01:45:00.382687 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1190/2294] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:45:00 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:45:00.889061 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-76ae5bac-c3a3-411e-95f6-9862aae170c4 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:45:00.889636 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-76ae5bac-c3a3-411e-95f6-9862aae170c4 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:45:00.895770 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-76ae5bac-c3a3-411e-95f6-9862aae170c4 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:00.896219 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-76ae5bac-c3a3-411e-95f6-9862aae170c4 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:00.896974 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-76ae5bac-c3a3-411e-95f6-9862aae170c4 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:00.897405 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-76ae5bac-c3a3-411e-95f6-9862aae170c4 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:01.016425 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-76ae5bac-c3a3-411e-95f6-9862aae170c4 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:45:01.024063 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-76ae5bac-c3a3-411e-95f6-9862aae170c4 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1717 microversion: 2.1 time: 0.138771 Nov 01 01:45:01.024621 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1105/2295] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:45:00 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1717 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:45:01.392136 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-eee5727a-c520-4371-8d5e-e2505f45d9e1 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:45:01.392816 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-eee5727a-c520-4371-8d5e-e2505f45d9e1 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:45:01.399071 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-eee5727a-c520-4371-8d5e-e2505f45d9e1 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:01.399540 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-eee5727a-c520-4371-8d5e-e2505f45d9e1 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:01.400285 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-eee5727a-c520-4371-8d5e-e2505f45d9e1 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:01.400711 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-eee5727a-c520-4371-8d5e-e2505f45d9e1 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:01.520506 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-eee5727a-c520-4371-8d5e-e2505f45d9e1 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:45:01.528157 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-eee5727a-c520-4371-8d5e-e2505f45d9e1 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.139717 Nov 01 01:45:01.528719 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1191/2296] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:45:01 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:45:02.040899 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-9b18daf1-6fbe-4360-86b2-8b1a33f2b6ae tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:45:02.041466 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-9b18daf1-6fbe-4360-86b2-8b1a33f2b6ae tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:45:02.047638 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9b18daf1-6fbe-4360-86b2-8b1a33f2b6ae tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:02.048075 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9b18daf1-6fbe-4360-86b2-8b1a33f2b6ae tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:02.048821 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9b18daf1-6fbe-4360-86b2-8b1a33f2b6ae tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:02.049246 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9b18daf1-6fbe-4360-86b2-8b1a33f2b6ae tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:02.173794 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-9b18daf1-6fbe-4360-86b2-8b1a33f2b6ae tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:45:02.181508 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-9b18daf1-6fbe-4360-86b2-8b1a33f2b6ae tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1717 microversion: 2.1 time: 0.144414 Nov 01 01:45:02.182074 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1106/2297] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:45:02 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1717 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:45:02.545229 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-00e306da-bc5a-4d98-9acc-682951774e58 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:45:02.545838 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-00e306da-bc5a-4d98-9acc-682951774e58 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:45:02.552553 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-00e306da-bc5a-4d98-9acc-682951774e58 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:02.552985 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-00e306da-bc5a-4d98-9acc-682951774e58 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:02.553756 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-00e306da-bc5a-4d98-9acc-682951774e58 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:02.554177 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-00e306da-bc5a-4d98-9acc-682951774e58 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:02.675191 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-00e306da-bc5a-4d98-9acc-682951774e58 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:45:02.683418 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-00e306da-bc5a-4d98-9acc-682951774e58 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.141887 Nov 01 01:45:02.683968 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1192/2298] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:45:02 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:45:03.198933 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-f04256af-edeb-4734-ad5d-65ccc5ee15a2 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:45:03.199533 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-f04256af-edeb-4734-ad5d-65ccc5ee15a2 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:45:03.205858 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f04256af-edeb-4734-ad5d-65ccc5ee15a2 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:03.206301 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f04256af-edeb-4734-ad5d-65ccc5ee15a2 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:03.207110 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f04256af-edeb-4734-ad5d-65ccc5ee15a2 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:03.207561 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f04256af-edeb-4734-ad5d-65ccc5ee15a2 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:03.333435 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-f04256af-edeb-4734-ad5d-65ccc5ee15a2 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:45:03.341024 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-f04256af-edeb-4734-ad5d-65ccc5ee15a2 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1717 microversion: 2.1 time: 0.145987 Nov 01 01:45:03.341584 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1107/2299] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:45:03 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1717 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:45:03.700866 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-e38b799c-7062-40af-a2c2-20a87be6af0f tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:45:03.701473 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-e38b799c-7062-40af-a2c2-20a87be6af0f tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:45:03.708343 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e38b799c-7062-40af-a2c2-20a87be6af0f tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:03.708779 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e38b799c-7062-40af-a2c2-20a87be6af0f tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:03.709519 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e38b799c-7062-40af-a2c2-20a87be6af0f tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:03.709942 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e38b799c-7062-40af-a2c2-20a87be6af0f tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:03.827460 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-e38b799c-7062-40af-a2c2-20a87be6af0f tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:45:03.837818 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-e38b799c-7062-40af-a2c2-20a87be6af0f tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.138368 Nov 01 01:45:03.837818 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1193/2300] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:45:03 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:45:04.356833 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-4362f831-1395-417b-9721-48ab5321e863 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:45:04.357439 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-4362f831-1395-417b-9721-48ab5321e863 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:45:04.364363 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4362f831-1395-417b-9721-48ab5321e863 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:04.364811 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4362f831-1395-417b-9721-48ab5321e863 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:04.365595 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4362f831-1395-417b-9721-48ab5321e863 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:04.366026 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4362f831-1395-417b-9721-48ab5321e863 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:04.490494 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-4362f831-1395-417b-9721-48ab5321e863 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:45:04.498178 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-4362f831-1395-417b-9721-48ab5321e863 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1717 microversion: 2.1 time: 0.145009 Nov 01 01:45:04.498770 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1108/2301] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:45:04 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1717 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:45:04.853373 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-2a32e0c7-7f96-4b25-9c2d-b06bbfe6f495 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:45:04.853988 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-2a32e0c7-7f96-4b25-9c2d-b06bbfe6f495 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:45:04.860368 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-2a32e0c7-7f96-4b25-9c2d-b06bbfe6f495 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:04.860636 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-2a32e0c7-7f96-4b25-9c2d-b06bbfe6f495 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:04.861380 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-2a32e0c7-7f96-4b25-9c2d-b06bbfe6f495 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:04.861804 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-2a32e0c7-7f96-4b25-9c2d-b06bbfe6f495 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:04.979187 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-2a32e0c7-7f96-4b25-9c2d-b06bbfe6f495 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:45:04.986838 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-2a32e0c7-7f96-4b25-9c2d-b06bbfe6f495 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.137128 Nov 01 01:45:04.987529 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1194/2302] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:45:04 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:45:05.515387 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-c6ff672a-2221-46c3-9867-4df211e88317 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:45:05.516017 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-c6ff672a-2221-46c3-9867-4df211e88317 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:45:05.522378 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c6ff672a-2221-46c3-9867-4df211e88317 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:05.522855 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c6ff672a-2221-46c3-9867-4df211e88317 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:05.523633 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c6ff672a-2221-46c3-9867-4df211e88317 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:05.524060 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c6ff672a-2221-46c3-9867-4df211e88317 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:05.642115 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-c6ff672a-2221-46c3-9867-4df211e88317 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:45:05.649679 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-c6ff672a-2221-46c3-9867-4df211e88317 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1717 microversion: 2.1 time: 0.137913 Nov 01 01:45:05.650223 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1109/2303] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:45:05 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1717 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:45:06.003651 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-a7428f46-5141-43d1-9f5b-13bb5d00896a tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:45:06.004797 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-a7428f46-5141-43d1-9f5b-13bb5d00896a tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:45:06.011044 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a7428f46-5141-43d1-9f5b-13bb5d00896a tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:06.011485 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a7428f46-5141-43d1-9f5b-13bb5d00896a tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:06.012232 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a7428f46-5141-43d1-9f5b-13bb5d00896a tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:06.012654 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a7428f46-5141-43d1-9f5b-13bb5d00896a tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:06.136604 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-a7428f46-5141-43d1-9f5b-13bb5d00896a tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:45:06.144458 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-a7428f46-5141-43d1-9f5b-13bb5d00896a tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.144451 Nov 01 01:45:06.145056 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1195/2304] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:45:05 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:45:06.666917 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-bad960dd-524b-4b0e-aa6b-0f117ea5d237 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:45:06.667542 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-bad960dd-524b-4b0e-aa6b-0f117ea5d237 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:45:06.673618 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-bad960dd-524b-4b0e-aa6b-0f117ea5d237 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:06.674058 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-bad960dd-524b-4b0e-aa6b-0f117ea5d237 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:06.674836 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-bad960dd-524b-4b0e-aa6b-0f117ea5d237 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:06.675265 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-bad960dd-524b-4b0e-aa6b-0f117ea5d237 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:06.792118 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-bad960dd-524b-4b0e-aa6b-0f117ea5d237 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:45:06.799729 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-bad960dd-524b-4b0e-aa6b-0f117ea5d237 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1717 microversion: 2.1 time: 0.136419 Nov 01 01:45:06.800281 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1110/2305] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:45:06 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1717 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:45:07.161106 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-46416982-df95-451b-8722-d868c30e8970 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:45:07.161713 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-46416982-df95-451b-8722-d868c30e8970 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:45:07.167924 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-46416982-df95-451b-8722-d868c30e8970 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:07.168357 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-46416982-df95-451b-8722-d868c30e8970 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:07.169104 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-46416982-df95-451b-8722-d868c30e8970 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:07.169526 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-46416982-df95-451b-8722-d868c30e8970 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:07.285643 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-46416982-df95-451b-8722-d868c30e8970 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:45:07.293218 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-46416982-df95-451b-8722-d868c30e8970 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.136332 Nov 01 01:45:07.293772 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1196/2306] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:45:07 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:45:07.817157 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-476b7f90-fcdd-4c79-9d72-61377ffbac9b tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:45:07.817761 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-476b7f90-fcdd-4c79-9d72-61377ffbac9b tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:45:07.824238 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-476b7f90-fcdd-4c79-9d72-61377ffbac9b tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:07.824683 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-476b7f90-fcdd-4c79-9d72-61377ffbac9b tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:07.825446 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-476b7f90-fcdd-4c79-9d72-61377ffbac9b tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:07.825881 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-476b7f90-fcdd-4c79-9d72-61377ffbac9b tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:07.944904 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-476b7f90-fcdd-4c79-9d72-61377ffbac9b tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:45:07.952888 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-476b7f90-fcdd-4c79-9d72-61377ffbac9b tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1717 microversion: 2.1 time: 0.139989 Nov 01 01:45:07.953456 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1111/2307] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:45:07 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1717 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:45:08.309436 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-fcfee3d8-67b2-44c7-ab13-00c8c5cf5085 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:45:08.309983 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-fcfee3d8-67b2-44c7-ab13-00c8c5cf5085 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:45:08.316121 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-fcfee3d8-67b2-44c7-ab13-00c8c5cf5085 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:08.316606 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-fcfee3d8-67b2-44c7-ab13-00c8c5cf5085 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:08.317351 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-fcfee3d8-67b2-44c7-ab13-00c8c5cf5085 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:08.317772 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-fcfee3d8-67b2-44c7-ab13-00c8c5cf5085 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:08.435157 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-fcfee3d8-67b2-44c7-ab13-00c8c5cf5085 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:45:08.442770 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-fcfee3d8-67b2-44c7-ab13-00c8c5cf5085 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.136989 Nov 01 01:45:08.443329 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1197/2308] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:45:08 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:45:08.968706 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-8a3f31f9-b639-443e-8e28-75213277048c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:45:08.969316 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-8a3f31f9-b639-443e-8e28-75213277048c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:45:08.975527 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8a3f31f9-b639-443e-8e28-75213277048c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:08.975973 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8a3f31f9-b639-443e-8e28-75213277048c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:08.976761 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8a3f31f9-b639-443e-8e28-75213277048c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:08.977192 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8a3f31f9-b639-443e-8e28-75213277048c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:09.092897 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-8a3f31f9-b639-443e-8e28-75213277048c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:45:09.100497 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-8a3f31f9-b639-443e-8e28-75213277048c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1717 microversion: 2.1 time: 0.135422 Nov 01 01:45:09.101050 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1112/2309] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:45:08 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1717 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:45:09.459549 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-ec14b9fe-2c2a-4da3-91f3-47bf65f9f1b5 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:45:09.460158 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-ec14b9fe-2c2a-4da3-91f3-47bf65f9f1b5 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:45:09.466358 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ec14b9fe-2c2a-4da3-91f3-47bf65f9f1b5 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:09.466834 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ec14b9fe-2c2a-4da3-91f3-47bf65f9f1b5 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:09.467660 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ec14b9fe-2c2a-4da3-91f3-47bf65f9f1b5 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:09.468090 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ec14b9fe-2c2a-4da3-91f3-47bf65f9f1b5 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:09.588299 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-ec14b9fe-2c2a-4da3-91f3-47bf65f9f1b5 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:45:09.596174 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-ec14b9fe-2c2a-4da3-91f3-47bf65f9f1b5 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.140320 Nov 01 01:45:09.596740 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1198/2310] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:45:09 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:45:10.117237 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-05e4308b-f9e8-49e5-8e15-ee1e7d52abe4 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:45:10.117797 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-05e4308b-f9e8-49e5-8e15-ee1e7d52abe4 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:45:10.124115 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-05e4308b-f9e8-49e5-8e15-ee1e7d52abe4 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:10.124558 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-05e4308b-f9e8-49e5-8e15-ee1e7d52abe4 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:10.125332 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-05e4308b-f9e8-49e5-8e15-ee1e7d52abe4 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:10.125768 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-05e4308b-f9e8-49e5-8e15-ee1e7d52abe4 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:10.244288 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-05e4308b-f9e8-49e5-8e15-ee1e7d52abe4 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:45:10.251912 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-05e4308b-f9e8-49e5-8e15-ee1e7d52abe4 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1717 microversion: 2.1 time: 0.138973 Nov 01 01:45:10.252477 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1113/2311] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:45:10 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1717 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:45:10.612827 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-fc5ad00f-20ed-484d-be5c-11cd2ce70ca3 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:45:10.613444 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-fc5ad00f-20ed-484d-be5c-11cd2ce70ca3 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:45:10.619967 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-fc5ad00f-20ed-484d-be5c-11cd2ce70ca3 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:10.620413 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-fc5ad00f-20ed-484d-be5c-11cd2ce70ca3 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:10.621172 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-fc5ad00f-20ed-484d-be5c-11cd2ce70ca3 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:10.621599 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-fc5ad00f-20ed-484d-be5c-11cd2ce70ca3 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:10.751461 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-fc5ad00f-20ed-484d-be5c-11cd2ce70ca3 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:45:10.759535 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-fc5ad00f-20ed-484d-be5c-11cd2ce70ca3 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.150353 Nov 01 01:45:10.760144 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1199/2312] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:45:10 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:45:11.268616 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-b050721d-89c7-40ad-bdcf-7c4cb4a6e1b5 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:45:11.269242 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-b050721d-89c7-40ad-bdcf-7c4cb4a6e1b5 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:45:11.275936 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b050721d-89c7-40ad-bdcf-7c4cb4a6e1b5 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:11.276378 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b050721d-89c7-40ad-bdcf-7c4cb4a6e1b5 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:11.277128 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b050721d-89c7-40ad-bdcf-7c4cb4a6e1b5 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:11.277555 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b050721d-89c7-40ad-bdcf-7c4cb4a6e1b5 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:11.403584 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-b050721d-89c7-40ad-bdcf-7c4cb4a6e1b5 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:45:11.411288 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-b050721d-89c7-40ad-bdcf-7c4cb4a6e1b5 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1717 microversion: 2.1 time: 0.146338 Nov 01 01:45:11.411840 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1114/2313] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:45:11 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1717 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:45:11.776337 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-1381b6cd-64a4-423a-be74-e0390c838d86 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:45:11.776938 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-1381b6cd-64a4-423a-be74-e0390c838d86 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:45:11.783170 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-1381b6cd-64a4-423a-be74-e0390c838d86 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:11.783608 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-1381b6cd-64a4-423a-be74-e0390c838d86 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:11.784355 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-1381b6cd-64a4-423a-be74-e0390c838d86 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:11.784777 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-1381b6cd-64a4-423a-be74-e0390c838d86 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:11.903559 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-1381b6cd-64a4-423a-be74-e0390c838d86 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:45:11.911730 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-1381b6cd-64a4-423a-be74-e0390c838d86 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.139068 Nov 01 01:45:11.912295 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1200/2314] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:45:11 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:45:12.429190 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-5c5955f7-4168-448e-ba43-cdaf8af7fbdf tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:45:12.429788 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-5c5955f7-4168-448e-ba43-cdaf8af7fbdf tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:45:12.435940 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5c5955f7-4168-448e-ba43-cdaf8af7fbdf tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:12.436382 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5c5955f7-4168-448e-ba43-cdaf8af7fbdf tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:12.437129 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5c5955f7-4168-448e-ba43-cdaf8af7fbdf tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:12.437554 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5c5955f7-4168-448e-ba43-cdaf8af7fbdf tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:12.555381 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-5c5955f7-4168-448e-ba43-cdaf8af7fbdf tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:45:12.563168 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-5c5955f7-4168-448e-ba43-cdaf8af7fbdf tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1717 microversion: 2.1 time: 0.138064 Nov 01 01:45:12.563731 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1115/2315] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:45:12 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1717 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:45:12.929586 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-b0d58fa6-4972-4ba7-8949-dea87e42c9dc tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:45:12.930214 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-b0d58fa6-4972-4ba7-8949-dea87e42c9dc tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:45:12.936494 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b0d58fa6-4972-4ba7-8949-dea87e42c9dc tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:12.936943 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b0d58fa6-4972-4ba7-8949-dea87e42c9dc tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:12.937746 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b0d58fa6-4972-4ba7-8949-dea87e42c9dc tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:12.938176 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b0d58fa6-4972-4ba7-8949-dea87e42c9dc tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:13.068035 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-b0d58fa6-4972-4ba7-8949-dea87e42c9dc tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:45:13.076344 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-b0d58fa6-4972-4ba7-8949-dea87e42c9dc tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.151697 Nov 01 01:45:13.076921 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1201/2316] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:45:12 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:45:13.579834 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-22f607cf-700c-4459-bf7e-faf396d00cee tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:45:13.580430 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-22f607cf-700c-4459-bf7e-faf396d00cee tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:45:13.587241 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-22f607cf-700c-4459-bf7e-faf396d00cee tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:13.587680 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-22f607cf-700c-4459-bf7e-faf396d00cee tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:13.588426 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-22f607cf-700c-4459-bf7e-faf396d00cee tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:13.588857 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-22f607cf-700c-4459-bf7e-faf396d00cee tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:13.708251 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-22f607cf-700c-4459-bf7e-faf396d00cee tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:45:13.715871 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-22f607cf-700c-4459-bf7e-faf396d00cee tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1717 microversion: 2.1 time: 0.139715 Nov 01 01:45:13.716429 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1116/2317] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:45:13 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1717 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:45:14.093563 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-df5a46fa-0d89-405a-94b9-3e4f1ddf32c8 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:45:14.094208 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-df5a46fa-0d89-405a-94b9-3e4f1ddf32c8 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:45:14.101112 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-df5a46fa-0d89-405a-94b9-3e4f1ddf32c8 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:14.101557 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-df5a46fa-0d89-405a-94b9-3e4f1ddf32c8 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:14.102312 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-df5a46fa-0d89-405a-94b9-3e4f1ddf32c8 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:14.102766 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-df5a46fa-0d89-405a-94b9-3e4f1ddf32c8 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:14.220804 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-df5a46fa-0d89-405a-94b9-3e4f1ddf32c8 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:45:14.228884 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-df5a46fa-0d89-405a-94b9-3e4f1ddf32c8 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.139087 Nov 01 01:45:14.229462 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1202/2318] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:45:14 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:45:14.732625 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-ed533be9-a221-4dff-a822-61693a7dbcd5 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:45:14.733226 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-ed533be9-a221-4dff-a822-61693a7dbcd5 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:45:14.739496 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ed533be9-a221-4dff-a822-61693a7dbcd5 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:14.739939 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ed533be9-a221-4dff-a822-61693a7dbcd5 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:14.740688 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ed533be9-a221-4dff-a822-61693a7dbcd5 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:14.741113 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ed533be9-a221-4dff-a822-61693a7dbcd5 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:14.860563 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-ed533be9-a221-4dff-a822-61693a7dbcd5 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:45:14.868409 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-ed533be9-a221-4dff-a822-61693a7dbcd5 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1717 microversion: 2.1 time: 0.139435 Nov 01 01:45:14.868959 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1117/2319] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:45:14 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1717 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:45:15.246392 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-561e4d1e-d070-45bd-9bf8-ffeecfe83154 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:45:15.247023 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-561e4d1e-d070-45bd-9bf8-ffeecfe83154 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:45:15.253398 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-561e4d1e-d070-45bd-9bf8-ffeecfe83154 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:15.254470 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-561e4d1e-d070-45bd-9bf8-ffeecfe83154 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:15.255240 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-561e4d1e-d070-45bd-9bf8-ffeecfe83154 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:15.255667 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-561e4d1e-d070-45bd-9bf8-ffeecfe83154 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:15.375255 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-561e4d1e-d070-45bd-9bf8-ffeecfe83154 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:45:15.383576 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-561e4d1e-d070-45bd-9bf8-ffeecfe83154 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.140896 Nov 01 01:45:15.384134 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1203/2320] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:45:15 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:45:15.884949 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-9eaad2af-71b4-46d4-be5c-6b53cf5ef318 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:45:15.885553 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-9eaad2af-71b4-46d4-be5c-6b53cf5ef318 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:45:15.891753 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9eaad2af-71b4-46d4-be5c-6b53cf5ef318 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:15.892193 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9eaad2af-71b4-46d4-be5c-6b53cf5ef318 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:15.892941 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9eaad2af-71b4-46d4-be5c-6b53cf5ef318 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:15.893365 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9eaad2af-71b4-46d4-be5c-6b53cf5ef318 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:16.010483 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-9eaad2af-71b4-46d4-be5c-6b53cf5ef318 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:45:16.018219 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-9eaad2af-71b4-46d4-be5c-6b53cf5ef318 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1717 microversion: 2.1 time: 0.136867 Nov 01 01:45:16.018810 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1118/2321] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:45:15 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1717 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:45:16.401002 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-8c196868-aa16-4fb6-90f0-d4375ff4e08f tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:45:16.401610 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-8c196868-aa16-4fb6-90f0-d4375ff4e08f tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:45:16.407756 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8c196868-aa16-4fb6-90f0-d4375ff4e08f tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:16.412547 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8c196868-aa16-4fb6-90f0-d4375ff4e08f tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:16.412547 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8c196868-aa16-4fb6-90f0-d4375ff4e08f tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:16.412547 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8c196868-aa16-4fb6-90f0-d4375ff4e08f tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:16.534288 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-8c196868-aa16-4fb6-90f0-d4375ff4e08f tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:45:16.542074 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-8c196868-aa16-4fb6-90f0-d4375ff4e08f tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.144784 Nov 01 01:45:16.542887 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1204/2322] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:45:16 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:45:17.036350 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-3b7dfc82-5acc-46da-80c1-4c260570b404 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:45:17.036940 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-3b7dfc82-5acc-46da-80c1-4c260570b404 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:45:17.043220 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3b7dfc82-5acc-46da-80c1-4c260570b404 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:17.043657 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3b7dfc82-5acc-46da-80c1-4c260570b404 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:17.044406 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3b7dfc82-5acc-46da-80c1-4c260570b404 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:17.044830 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3b7dfc82-5acc-46da-80c1-4c260570b404 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:17.164036 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-3b7dfc82-5acc-46da-80c1-4c260570b404 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:45:17.171786 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-3b7dfc82-5acc-46da-80c1-4c260570b404 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1717 microversion: 2.1 time: 0.139568 Nov 01 01:45:17.172342 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1119/2323] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:45:17 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1717 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:45:17.559256 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-d63a46a0-7069-4859-9831-4e4c183285a0 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:45:17.559889 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-d63a46a0-7069-4859-9831-4e4c183285a0 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:45:17.566061 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d63a46a0-7069-4859-9831-4e4c183285a0 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:17.567118 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d63a46a0-7069-4859-9831-4e4c183285a0 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:17.567870 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d63a46a0-7069-4859-9831-4e4c183285a0 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:17.568289 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d63a46a0-7069-4859-9831-4e4c183285a0 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:17.686808 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-d63a46a0-7069-4859-9831-4e4c183285a0 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:45:17.696548 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-d63a46a0-7069-4859-9831-4e4c183285a0 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.140632 Nov 01 01:45:17.697393 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1205/2324] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:45:17 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:45:18.188308 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-bbadde75-f055-47bb-90c3-f5d5c354f5d9 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:45:18.188909 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-bbadde75-f055-47bb-90c3-f5d5c354f5d9 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:45:18.195066 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-bbadde75-f055-47bb-90c3-f5d5c354f5d9 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:18.195525 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-bbadde75-f055-47bb-90c3-f5d5c354f5d9 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:18.196524 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-bbadde75-f055-47bb-90c3-f5d5c354f5d9 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:18.196960 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-bbadde75-f055-47bb-90c3-f5d5c354f5d9 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:18.323715 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-bbadde75-f055-47bb-90c3-f5d5c354f5d9 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:45:18.331483 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-bbadde75-f055-47bb-90c3-f5d5c354f5d9 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1717 microversion: 2.1 time: 0.146800 Nov 01 01:45:18.332563 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1120/2325] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:45:18 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1717 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:45:18.713716 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-375b0e5d-86a7-40f7-92e5-938ba7f7ee72 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:45:18.714320 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-375b0e5d-86a7-40f7-92e5-938ba7f7ee72 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:45:18.720552 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-375b0e5d-86a7-40f7-92e5-938ba7f7ee72 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:18.720992 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-375b0e5d-86a7-40f7-92e5-938ba7f7ee72 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:18.721739 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-375b0e5d-86a7-40f7-92e5-938ba7f7ee72 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:18.722165 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-375b0e5d-86a7-40f7-92e5-938ba7f7ee72 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:18.838642 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-375b0e5d-86a7-40f7-92e5-938ba7f7ee72 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:45:18.846253 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-375b0e5d-86a7-40f7-92e5-938ba7f7ee72 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.136158 Nov 01 01:45:18.846950 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1206/2326] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:45:18 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:45:19.347845 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-02646c9b-f61f-4dd4-90da-4fe2c72b711f tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:45:19.348450 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-02646c9b-f61f-4dd4-90da-4fe2c72b711f tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:45:19.354731 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-02646c9b-f61f-4dd4-90da-4fe2c72b711f tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:19.355177 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-02646c9b-f61f-4dd4-90da-4fe2c72b711f tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:19.355934 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-02646c9b-f61f-4dd4-90da-4fe2c72b711f tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:19.356367 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-02646c9b-f61f-4dd4-90da-4fe2c72b711f tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:19.476635 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-02646c9b-f61f-4dd4-90da-4fe2c72b711f tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:45:19.484388 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-02646c9b-f61f-4dd4-90da-4fe2c72b711f tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1717 microversion: 2.1 time: 0.140136 Nov 01 01:45:19.484965 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1121/2327] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:45:19 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1717 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:45:19.863754 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-e655c798-fbe0-40ad-9457-0343445dd1ab tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:45:19.864293 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-e655c798-fbe0-40ad-9457-0343445dd1ab tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:45:19.870490 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e655c798-fbe0-40ad-9457-0343445dd1ab tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:19.870931 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e655c798-fbe0-40ad-9457-0343445dd1ab tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:19.871671 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e655c798-fbe0-40ad-9457-0343445dd1ab tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:19.872094 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e655c798-fbe0-40ad-9457-0343445dd1ab tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:19.991764 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-e655c798-fbe0-40ad-9457-0343445dd1ab tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:45:19.999369 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-e655c798-fbe0-40ad-9457-0343445dd1ab tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.139824 Nov 01 01:45:19.999924 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1207/2328] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:45:19 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:45:20.501365 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-e80f2bd8-07f0-4a05-a120-d9d34bf8341c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:45:20.501890 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-e80f2bd8-07f0-4a05-a120-d9d34bf8341c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:45:20.508709 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e80f2bd8-07f0-4a05-a120-d9d34bf8341c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:20.509150 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e80f2bd8-07f0-4a05-a120-d9d34bf8341c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:20.509906 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e80f2bd8-07f0-4a05-a120-d9d34bf8341c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:20.510337 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e80f2bd8-07f0-4a05-a120-d9d34bf8341c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:20.627369 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-e80f2bd8-07f0-4a05-a120-d9d34bf8341c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:45:20.635747 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-e80f2bd8-07f0-4a05-a120-d9d34bf8341c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1717 microversion: 2.1 time: 0.138176 Nov 01 01:45:20.636296 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1122/2329] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:45:20 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1717 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:45:21.016140 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-e48e53ab-8bd5-40f9-ad06-43c1aaa872aa tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:45:21.016750 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-e48e53ab-8bd5-40f9-ad06-43c1aaa872aa tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:45:21.022978 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e48e53ab-8bd5-40f9-ad06-43c1aaa872aa tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:21.023417 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e48e53ab-8bd5-40f9-ad06-43c1aaa872aa tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:21.024170 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e48e53ab-8bd5-40f9-ad06-43c1aaa872aa tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:21.024593 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e48e53ab-8bd5-40f9-ad06-43c1aaa872aa tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:21.141624 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-e48e53ab-8bd5-40f9-ad06-43c1aaa872aa tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:45:21.150273 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-e48e53ab-8bd5-40f9-ad06-43c1aaa872aa tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.138007 Nov 01 01:45:21.150864 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1208/2330] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:45:21 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:45:21.652709 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-344fe243-bf7c-4403-9b74-ac6d9966e64a tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:45:21.653244 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-344fe243-bf7c-4403-9b74-ac6d9966e64a tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:45:21.659503 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-344fe243-bf7c-4403-9b74-ac6d9966e64a tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:21.659956 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-344fe243-bf7c-4403-9b74-ac6d9966e64a tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:21.660720 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-344fe243-bf7c-4403-9b74-ac6d9966e64a tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:21.661152 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-344fe243-bf7c-4403-9b74-ac6d9966e64a tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:21.780516 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-344fe243-bf7c-4403-9b74-ac6d9966e64a tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:45:21.788183 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-344fe243-bf7c-4403-9b74-ac6d9966e64a tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1717 microversion: 2.1 time: 0.139310 Nov 01 01:45:21.788734 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1123/2331] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:45:21 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1717 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:45:22.167060 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-667b1014-7e57-4f5a-bc72-41dbfce15dd3 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:45:22.167731 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-667b1014-7e57-4f5a-bc72-41dbfce15dd3 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:45:22.173857 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-667b1014-7e57-4f5a-bc72-41dbfce15dd3 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:22.174303 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-667b1014-7e57-4f5a-bc72-41dbfce15dd3 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:22.175093 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-667b1014-7e57-4f5a-bc72-41dbfce15dd3 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:22.176025 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-667b1014-7e57-4f5a-bc72-41dbfce15dd3 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:22.292945 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-667b1014-7e57-4f5a-bc72-41dbfce15dd3 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:45:22.301146 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-667b1014-7e57-4f5a-bc72-41dbfce15dd3 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.137197 Nov 01 01:45:22.301704 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1209/2332] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:45:22 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:45:22.805532 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-33fdb2ec-4778-4057-971e-707877593436 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:45:22.806144 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-33fdb2ec-4778-4057-971e-707877593436 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:45:22.812491 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-33fdb2ec-4778-4057-971e-707877593436 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:22.812937 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-33fdb2ec-4778-4057-971e-707877593436 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:22.813700 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-33fdb2ec-4778-4057-971e-707877593436 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:22.814134 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-33fdb2ec-4778-4057-971e-707877593436 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:22.930788 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-33fdb2ec-4778-4057-971e-707877593436 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:45:22.938439 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-33fdb2ec-4778-4057-971e-707877593436 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1717 microversion: 2.1 time: 0.136631 Nov 01 01:45:22.939005 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1124/2333] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:45:22 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1717 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:45:23.318793 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-c12b6e6c-ef49-45c6-9001-1f61efba5c45 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:45:23.319350 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-c12b6e6c-ef49-45c6-9001-1f61efba5c45 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:45:23.325784 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c12b6e6c-ef49-45c6-9001-1f61efba5c45 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:23.326227 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c12b6e6c-ef49-45c6-9001-1f61efba5c45 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:23.327024 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c12b6e6c-ef49-45c6-9001-1f61efba5c45 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:23.327456 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c12b6e6c-ef49-45c6-9001-1f61efba5c45 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:23.449545 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-c12b6e6c-ef49-45c6-9001-1f61efba5c45 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:45:23.457263 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-c12b6e6c-ef49-45c6-9001-1f61efba5c45 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.142712 Nov 01 01:45:23.457820 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1210/2334] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:45:23 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:45:23.955047 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-2ac2195a-303b-4324-ac44-53b8546f0f8f tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:45:23.955701 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-2ac2195a-303b-4324-ac44-53b8546f0f8f tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:45:23.961880 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2ac2195a-303b-4324-ac44-53b8546f0f8f tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:23.962330 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2ac2195a-303b-4324-ac44-53b8546f0f8f tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:23.963129 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2ac2195a-303b-4324-ac44-53b8546f0f8f tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:23.963564 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2ac2195a-303b-4324-ac44-53b8546f0f8f tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:24.080968 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-2ac2195a-303b-4324-ac44-53b8546f0f8f tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:45:24.089157 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-2ac2195a-303b-4324-ac44-53b8546f0f8f tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1717 microversion: 2.1 time: 0.137800 Nov 01 01:45:24.089713 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1125/2335] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:45:23 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1717 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:45:24.473970 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-20810d6c-8dfb-4c4b-8890-1ce541d43578 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:45:24.474833 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-20810d6c-8dfb-4c4b-8890-1ce541d43578 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:45:24.480857 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-20810d6c-8dfb-4c4b-8890-1ce541d43578 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:24.481299 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-20810d6c-8dfb-4c4b-8890-1ce541d43578 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:24.482102 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-20810d6c-8dfb-4c4b-8890-1ce541d43578 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:24.482554 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-20810d6c-8dfb-4c4b-8890-1ce541d43578 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:24.606902 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-20810d6c-8dfb-4c4b-8890-1ce541d43578 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:45:24.614513 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-20810d6c-8dfb-4c4b-8890-1ce541d43578 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.145029 Nov 01 01:45:24.615070 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1211/2336] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:45:24 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:45:25.106760 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-5339ba0d-c239-4361-be93-22938d4e9964 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:45:25.107393 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-5339ba0d-c239-4361-be93-22938d4e9964 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:45:25.114258 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5339ba0d-c239-4361-be93-22938d4e9964 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:25.114739 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5339ba0d-c239-4361-be93-22938d4e9964 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:25.115502 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5339ba0d-c239-4361-be93-22938d4e9964 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:25.116118 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5339ba0d-c239-4361-be93-22938d4e9964 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:25.241975 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-5339ba0d-c239-4361-be93-22938d4e9964 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:45:25.249679 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-5339ba0d-c239-4361-be93-22938d4e9964 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1717 microversion: 2.1 time: 0.146778 Nov 01 01:45:25.250248 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1126/2337] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:45:25 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1717 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:45:25.631180 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-93099fbe-69b1-4531-b161-89b111a1c7e7 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:45:25.631706 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-93099fbe-69b1-4531-b161-89b111a1c7e7 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:45:25.637569 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-93099fbe-69b1-4531-b161-89b111a1c7e7 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:25.638012 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-93099fbe-69b1-4531-b161-89b111a1c7e7 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:25.638796 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-93099fbe-69b1-4531-b161-89b111a1c7e7 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:25.639220 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-93099fbe-69b1-4531-b161-89b111a1c7e7 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:25.756565 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-93099fbe-69b1-4531-b161-89b111a1c7e7 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:45:25.764603 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-93099fbe-69b1-4531-b161-89b111a1c7e7 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.137092 Nov 01 01:45:25.765249 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1212/2338] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:45:25 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:45:26.266530 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-2dfe5ab4-3267-4517-a481-69f334ff52ef tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:45:26.267209 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-2dfe5ab4-3267-4517-a481-69f334ff52ef tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:45:26.273652 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2dfe5ab4-3267-4517-a481-69f334ff52ef tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:26.274115 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2dfe5ab4-3267-4517-a481-69f334ff52ef tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:26.274883 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2dfe5ab4-3267-4517-a481-69f334ff52ef tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:26.275317 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2dfe5ab4-3267-4517-a481-69f334ff52ef tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:26.396063 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-2dfe5ab4-3267-4517-a481-69f334ff52ef tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:45:26.403886 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-2dfe5ab4-3267-4517-a481-69f334ff52ef tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1717 microversion: 2.1 time: 0.140964 Nov 01 01:45:26.404442 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1127/2339] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:45:26 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1717 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:45:26.782259 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-1daa15fd-8496-4cc7-bcaf-c3efbce79473 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:45:26.783126 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-1daa15fd-8496-4cc7-bcaf-c3efbce79473 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:45:26.789724 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1daa15fd-8496-4cc7-bcaf-c3efbce79473 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:26.790169 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1daa15fd-8496-4cc7-bcaf-c3efbce79473 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:26.791015 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1daa15fd-8496-4cc7-bcaf-c3efbce79473 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:26.791490 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1daa15fd-8496-4cc7-bcaf-c3efbce79473 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:26.852906 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [req-8025518f-0dc6-440a-ae9e-29a2dc1dea43 req-ed09696a-6c22-48a2-9091-9792bfc68ccb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8", "name": "network-vif-deleted", "tag": "19f68242-dd43-4db0-a30f-928bbd241951"}]} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:45:26.854513 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 01 01:45:26.854513 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: warnings.warn(msg) Nov 01 01:45:26.864337 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [req-8025518f-0dc6-440a-ae9e-29a2dc1dea43 req-ed09696a-6c22-48a2-9091-9792bfc68ccb service nova] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:26.864775 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [req-8025518f-0dc6-440a-ae9e-29a2dc1dea43 req-ed09696a-6c22-48a2-9091-9792bfc68ccb service nova] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:26.886122 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.compute.server_external_events [req-8025518f-0dc6-440a-ae9e-29a2dc1dea43 req-ed09696a-6c22-48a2-9091-9792bfc68ccb service nova] Creating event network-vif-deleted:19f68242-dd43-4db0-a30f-928bbd241951 for instance a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 on hv-cinder-81561 Nov 01 01:45:26.893325 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [req-8025518f-0dc6-440a-ae9e-29a2dc1dea43 req-ed09696a-6c22-48a2-9091-9792bfc68ccb service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120556 Nov 01 01:45:26.894303 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1213/2340] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Nov 1 01:45:26 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:45:26.971761 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-1daa15fd-8496-4cc7-bcaf-c3efbce79473 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:45:26.978143 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-1daa15fd-8496-4cc7-bcaf-c3efbce79473 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.199580 Nov 01 01:45:26.979040 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1128/2341] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:45:26 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:45:27.421305 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-182e8eae-abce-4434-94ce-909fa7f88244 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:45:27.421998 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-182e8eae-abce-4434-94ce-909fa7f88244 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:45:27.428515 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-182e8eae-abce-4434-94ce-909fa7f88244 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:27.428962 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-182e8eae-abce-4434-94ce-909fa7f88244 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:27.429720 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-182e8eae-abce-4434-94ce-909fa7f88244 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:27.430150 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-182e8eae-abce-4434-94ce-909fa7f88244 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:27.496351 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-182e8eae-abce-4434-94ce-909fa7f88244 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:45:27.504061 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-182e8eae-abce-4434-94ce-909fa7f88244 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1368 microversion: 2.1 time: 0.086905 Nov 01 01:45:27.504625 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1214/2342] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:45:27 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:45:27.996125 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-ef123807-4e42-4d02-99c8-93168d71a022 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:45:27.996662 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-ef123807-4e42-4d02-99c8-93168d71a022 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:45:28.002847 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ef123807-4e42-4d02-99c8-93168d71a022 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:28.003289 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ef123807-4e42-4d02-99c8-93168d71a022 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:28.004037 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ef123807-4e42-4d02-99c8-93168d71a022 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:28.004461 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ef123807-4e42-4d02-99c8-93168d71a022 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:28.121191 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-ef123807-4e42-4d02-99c8-93168d71a022 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:45:28.128842 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-ef123807-4e42-4d02-99c8-93168d71a022 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.136465 Nov 01 01:45:28.129393 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1129/2343] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:45:27 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:45:28.522641 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-ff9de7a2-e5a0-4e44-8d3b-27632bd13e75 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:45:28.523254 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-ff9de7a2-e5a0-4e44-8d3b-27632bd13e75 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:45:28.529434 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ff9de7a2-e5a0-4e44-8d3b-27632bd13e75 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:28.529874 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ff9de7a2-e5a0-4e44-8d3b-27632bd13e75 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:28.530667 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ff9de7a2-e5a0-4e44-8d3b-27632bd13e75 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:28.531098 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ff9de7a2-e5a0-4e44-8d3b-27632bd13e75 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:28.589760 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-ff9de7a2-e5a0-4e44-8d3b-27632bd13e75 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:45:28.597435 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-ff9de7a2-e5a0-4e44-8d3b-27632bd13e75 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1368 microversion: 2.1 time: 0.079074 Nov 01 01:45:28.597996 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1215/2344] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:45:28 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:45:29.145479 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-bcbaa94e-0861-44f6-ad78-295a62e6d340 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:45:29.146089 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-bcbaa94e-0861-44f6-ad78-295a62e6d340 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:45:29.153028 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-bcbaa94e-0861-44f6-ad78-295a62e6d340 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:29.153477 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-bcbaa94e-0861-44f6-ad78-295a62e6d340 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:29.154236 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-bcbaa94e-0861-44f6-ad78-295a62e6d340 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:29.154694 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-bcbaa94e-0861-44f6-ad78-295a62e6d340 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:29.273525 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-bcbaa94e-0861-44f6-ad78-295a62e6d340 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:45:29.281234 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-bcbaa94e-0861-44f6-ad78-295a62e6d340 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.139406 Nov 01 01:45:29.281791 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1130/2345] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:45:29 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:45:29.614525 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-4a43152d-db2a-4bcc-a3f5-4677e21eb76a tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:45:29.615133 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-4a43152d-db2a-4bcc-a3f5-4677e21eb76a tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:45:29.621286 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4a43152d-db2a-4bcc-a3f5-4677e21eb76a tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:29.621731 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4a43152d-db2a-4bcc-a3f5-4677e21eb76a tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:29.622500 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4a43152d-db2a-4bcc-a3f5-4677e21eb76a tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:29.622922 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4a43152d-db2a-4bcc-a3f5-4677e21eb76a tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:29.680850 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-4a43152d-db2a-4bcc-a3f5-4677e21eb76a tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:45:29.688372 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-4a43152d-db2a-4bcc-a3f5-4677e21eb76a tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1368 microversion: 2.1 time: 0.078161 Nov 01 01:45:29.688928 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1216/2346] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:45:29 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1368 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:45:30.297792 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-85450343-2648-4b43-b0cb-8deaf1182e96 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:45:30.298399 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-85450343-2648-4b43-b0cb-8deaf1182e96 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:45:30.304626 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-85450343-2648-4b43-b0cb-8deaf1182e96 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:30.305098 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-85450343-2648-4b43-b0cb-8deaf1182e96 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:30.305851 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-85450343-2648-4b43-b0cb-8deaf1182e96 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:30.306283 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-85450343-2648-4b43-b0cb-8deaf1182e96 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:30.423660 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-85450343-2648-4b43-b0cb-8deaf1182e96 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:45:30.431263 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-85450343-2648-4b43-b0cb-8deaf1182e96 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.137220 Nov 01 01:45:30.431828 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1131/2347] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:45:30 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:45:30.705862 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-8e737b04-754e-4187-bdbb-ac120359debe tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:45:30.707293 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-8e737b04-754e-4187-bdbb-ac120359debe tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:45:30.713686 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8e737b04-754e-4187-bdbb-ac120359debe tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:30.714132 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8e737b04-754e-4187-bdbb-ac120359debe tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:30.715012 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8e737b04-754e-4187-bdbb-ac120359debe tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:30.715433 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8e737b04-754e-4187-bdbb-ac120359debe tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:30.775596 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-8e737b04-754e-4187-bdbb-ac120359debe tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:45:30.783504 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-8e737b04-754e-4187-bdbb-ac120359debe tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1368 microversion: 2.1 time: 0.081536 Nov 01 01:45:30.784127 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1217/2348] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:45:30 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:45:31.448140 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-115a5888-42eb-4879-9841-4a50653e495a tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:45:31.448746 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-115a5888-42eb-4879-9841-4a50653e495a tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:45:31.454959 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-115a5888-42eb-4879-9841-4a50653e495a tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:31.455398 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-115a5888-42eb-4879-9841-4a50653e495a tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:31.456145 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-115a5888-42eb-4879-9841-4a50653e495a tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:31.456567 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-115a5888-42eb-4879-9841-4a50653e495a tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:31.576897 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-115a5888-42eb-4879-9841-4a50653e495a tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:45:31.585070 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-115a5888-42eb-4879-9841-4a50653e495a tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.140832 Nov 01 01:45:31.585630 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1132/2349] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:45:31 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:45:31.800070 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-89b2defc-4ce4-410c-8e0f-74708326d3f1 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:45:31.800678 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-89b2defc-4ce4-410c-8e0f-74708326d3f1 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:45:31.807008 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-89b2defc-4ce4-410c-8e0f-74708326d3f1 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:31.807452 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-89b2defc-4ce4-410c-8e0f-74708326d3f1 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:31.808203 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-89b2defc-4ce4-410c-8e0f-74708326d3f1 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:31.808634 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-89b2defc-4ce4-410c-8e0f-74708326d3f1 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:31.868939 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-89b2defc-4ce4-410c-8e0f-74708326d3f1 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:45:31.876623 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-89b2defc-4ce4-410c-8e0f-74708326d3f1 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1368 microversion: 2.1 time: 0.080213 Nov 01 01:45:31.877191 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1218/2350] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:45:31 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:45:32.600875 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-861f6e13-5031-421c-9b2e-1d6ddc03957f tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:45:32.601466 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-861f6e13-5031-421c-9b2e-1d6ddc03957f tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:45:32.607777 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-861f6e13-5031-421c-9b2e-1d6ddc03957f tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:32.608216 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-861f6e13-5031-421c-9b2e-1d6ddc03957f tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:32.609000 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-861f6e13-5031-421c-9b2e-1d6ddc03957f tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:32.609423 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-861f6e13-5031-421c-9b2e-1d6ddc03957f tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:32.666763 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 01 01:45:32.667165 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: Mon Nov 1 01:45:32 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 01 01:45:32.730169 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-861f6e13-5031-421c-9b2e-1d6ddc03957f tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:45:32.738532 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-861f6e13-5031-421c-9b2e-1d6ddc03957f tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.140700 Nov 01 01:45:32.739093 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1133/2351] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:45:32 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:45:32.893138 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-8bd94a08-a06b-428d-b185-dd90b00e920e tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:45:32.893748 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-8bd94a08-a06b-428d-b185-dd90b00e920e tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:45:32.900000 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8bd94a08-a06b-428d-b185-dd90b00e920e tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:32.900436 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8bd94a08-a06b-428d-b185-dd90b00e920e tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:32.901183 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8bd94a08-a06b-428d-b185-dd90b00e920e tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:32.901632 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8bd94a08-a06b-428d-b185-dd90b00e920e tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:32.964292 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-8bd94a08-a06b-428d-b185-dd90b00e920e tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:45:32.971922 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-8bd94a08-a06b-428d-b185-dd90b00e920e tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1368 microversion: 2.1 time: 0.082620 Nov 01 01:45:32.972501 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1219/2352] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:45:32 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:45:33.755042 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-0bb6b57c-9c67-4a1e-94c0-846d0214d848 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:45:33.755645 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-0bb6b57c-9c67-4a1e-94c0-846d0214d848 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:45:33.761752 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0bb6b57c-9c67-4a1e-94c0-846d0214d848 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:33.762193 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0bb6b57c-9c67-4a1e-94c0-846d0214d848 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:33.762973 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0bb6b57c-9c67-4a1e-94c0-846d0214d848 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:33.763404 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0bb6b57c-9c67-4a1e-94c0-846d0214d848 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:33.887036 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-0bb6b57c-9c67-4a1e-94c0-846d0214d848 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:45:33.895038 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-0bb6b57c-9c67-4a1e-94c0-846d0214d848 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.143777 Nov 01 01:45:33.895617 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1134/2353] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:45:33 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:45:33.988844 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-3f569bf1-b30c-4959-8b54-e9561f5af757 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:45:33.989384 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-3f569bf1-b30c-4959-8b54-e9561f5af757 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:45:33.995752 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3f569bf1-b30c-4959-8b54-e9561f5af757 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:33.996186 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3f569bf1-b30c-4959-8b54-e9561f5af757 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:33.996962 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3f569bf1-b30c-4959-8b54-e9561f5af757 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:33.997381 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3f569bf1-b30c-4959-8b54-e9561f5af757 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:34.055768 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-3f569bf1-b30c-4959-8b54-e9561f5af757 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:45:34.063355 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-3f569bf1-b30c-4959-8b54-e9561f5af757 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1368 microversion: 2.1 time: 0.078680 Nov 01 01:45:34.065048 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1220/2354] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:45:33 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:45:34.911289 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-d6ed7a74-0e19-4756-8bf4-857c3b088e37 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:45:34.912545 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-d6ed7a74-0e19-4756-8bf4-857c3b088e37 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:45:34.918800 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d6ed7a74-0e19-4756-8bf4-857c3b088e37 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:34.919242 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d6ed7a74-0e19-4756-8bf4-857c3b088e37 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:34.919989 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d6ed7a74-0e19-4756-8bf4-857c3b088e37 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:34.920414 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d6ed7a74-0e19-4756-8bf4-857c3b088e37 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:35.035568 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-d6ed7a74-0e19-4756-8bf4-857c3b088e37 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:45:35.043216 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-d6ed7a74-0e19-4756-8bf4-857c3b088e37 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.135683 Nov 01 01:45:35.043772 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1135/2355] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:45:34 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:45:35.080717 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-44a27d89-edac-487f-9800-093ca26b1121 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:45:35.081331 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-44a27d89-edac-487f-9800-093ca26b1121 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:45:35.088233 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-44a27d89-edac-487f-9800-093ca26b1121 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:35.088682 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-44a27d89-edac-487f-9800-093ca26b1121 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:35.089441 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-44a27d89-edac-487f-9800-093ca26b1121 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:35.089873 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-44a27d89-edac-487f-9800-093ca26b1121 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:35.152305 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-44a27d89-edac-487f-9800-093ca26b1121 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:45:35.159993 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-44a27d89-edac-487f-9800-093ca26b1121 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1368 microversion: 2.1 time: 0.082921 Nov 01 01:45:35.160543 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1221/2356] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:45:35 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:45:36.059801 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-12dc2ee0-4051-4192-8987-1a05c4683105 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:45:36.060389 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-12dc2ee0-4051-4192-8987-1a05c4683105 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:45:36.066620 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-12dc2ee0-4051-4192-8987-1a05c4683105 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:36.067060 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-12dc2ee0-4051-4192-8987-1a05c4683105 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:36.067808 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-12dc2ee0-4051-4192-8987-1a05c4683105 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:36.068231 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-12dc2ee0-4051-4192-8987-1a05c4683105 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:36.176370 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-5628cb0a-f8a7-492e-949d-5b8d9886c714 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:45:36.177107 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-5628cb0a-f8a7-492e-949d-5b8d9886c714 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:45:36.183452 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-5628cb0a-f8a7-492e-949d-5b8d9886c714 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:36.183939 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-5628cb0a-f8a7-492e-949d-5b8d9886c714 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:36.184706 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-5628cb0a-f8a7-492e-949d-5b8d9886c714 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:36.185132 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-5628cb0a-f8a7-492e-949d-5b8d9886c714 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:36.187745 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-12dc2ee0-4051-4192-8987-1a05c4683105 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:45:36.195421 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-12dc2ee0-4051-4192-8987-1a05c4683105 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.139222 Nov 01 01:45:36.196240 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1136/2357] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:45:36 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:45:36.244464 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-5628cb0a-f8a7-492e-949d-5b8d9886c714 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:45:36.251980 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-5628cb0a-f8a7-492e-949d-5b8d9886c714 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1368 microversion: 2.1 time: 0.079270 Nov 01 01:45:36.252535 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1222/2358] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:45:36 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:45:37.212568 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-9c6fb887-a123-4eda-a857-9f09707c86e9 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:45:37.213158 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-9c6fb887-a123-4eda-a857-9f09707c86e9 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:45:37.219417 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9c6fb887-a123-4eda-a857-9f09707c86e9 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:37.219858 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9c6fb887-a123-4eda-a857-9f09707c86e9 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:37.220604 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9c6fb887-a123-4eda-a857-9f09707c86e9 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:37.221025 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9c6fb887-a123-4eda-a857-9f09707c86e9 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:37.268153 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-c591523f-ad88-4bce-be93-78c032e524c9 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:45:37.268794 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-c591523f-ad88-4bce-be93-78c032e524c9 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:45:37.274932 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c591523f-ad88-4bce-be93-78c032e524c9 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:37.275374 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c591523f-ad88-4bce-be93-78c032e524c9 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:37.276120 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c591523f-ad88-4bce-be93-78c032e524c9 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:37.276541 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c591523f-ad88-4bce-be93-78c032e524c9 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:37.338715 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-c591523f-ad88-4bce-be93-78c032e524c9 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:45:37.348820 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-c591523f-ad88-4bce-be93-78c032e524c9 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1368 microversion: 2.1 time: 0.084192 Nov 01 01:45:37.349941 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1223/2359] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:45:37 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:45:37.364418 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-9c6fb887-a123-4eda-a857-9f09707c86e9 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:45:37.372695 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-9c6fb887-a123-4eda-a857-9f09707c86e9 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.163868 Nov 01 01:45:37.373245 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1137/2360] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:45:37 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:45:38.365043 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-97304296-55b0-4db2-b094-3b6e167ca4e3 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:45:38.365627 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-97304296-55b0-4db2-b094-3b6e167ca4e3 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:45:38.372004 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-97304296-55b0-4db2-b094-3b6e167ca4e3 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:38.372441 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-97304296-55b0-4db2-b094-3b6e167ca4e3 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:38.373205 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-97304296-55b0-4db2-b094-3b6e167ca4e3 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:38.373631 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-97304296-55b0-4db2-b094-3b6e167ca4e3 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:38.390009 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-eee8ce1b-9d5e-4a98-a6a3-93a8579e32f5 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:45:38.390645 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-eee8ce1b-9d5e-4a98-a6a3-93a8579e32f5 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:45:38.397444 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-eee8ce1b-9d5e-4a98-a6a3-93a8579e32f5 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:38.397889 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-eee8ce1b-9d5e-4a98-a6a3-93a8579e32f5 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:38.398680 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-eee8ce1b-9d5e-4a98-a6a3-93a8579e32f5 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:38.399110 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-eee8ce1b-9d5e-4a98-a6a3-93a8579e32f5 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:38.435517 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-97304296-55b0-4db2-b094-3b6e167ca4e3 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:45:38.443486 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-97304296-55b0-4db2-b094-3b6e167ca4e3 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1368 microversion: 2.1 time: 0.082227 Nov 01 01:45:38.444257 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1224/2361] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:45:38 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:45:38.521256 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-eee8ce1b-9d5e-4a98-a6a3-93a8579e32f5 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:45:38.528942 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-eee8ce1b-9d5e-4a98-a6a3-93a8579e32f5 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.142583 Nov 01 01:45:38.529500 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1138/2362] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:45:38 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:45:39.460361 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-558349bf-8232-4772-b312-2b2a624d64e5 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:45:39.460961 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-558349bf-8232-4772-b312-2b2a624d64e5 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:45:39.467166 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-558349bf-8232-4772-b312-2b2a624d64e5 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:39.467604 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-558349bf-8232-4772-b312-2b2a624d64e5 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:39.468342 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-558349bf-8232-4772-b312-2b2a624d64e5 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:39.468764 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-558349bf-8232-4772-b312-2b2a624d64e5 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:39.529754 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-558349bf-8232-4772-b312-2b2a624d64e5 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:45:39.537924 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-558349bf-8232-4772-b312-2b2a624d64e5 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1368 microversion: 2.1 time: 0.081265 Nov 01 01:45:39.538743 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1225/2363] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:45:39 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:45:39.546505 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-fb8135b6-8854-4e81-9e99-40968d56aa4d tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:45:39.547289 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-fb8135b6-8854-4e81-9e99-40968d56aa4d tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:45:39.554097 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-fb8135b6-8854-4e81-9e99-40968d56aa4d tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:39.554562 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-fb8135b6-8854-4e81-9e99-40968d56aa4d tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:39.555312 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-fb8135b6-8854-4e81-9e99-40968d56aa4d tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:39.555736 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-fb8135b6-8854-4e81-9e99-40968d56aa4d tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:39.675731 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-fb8135b6-8854-4e81-9e99-40968d56aa4d tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:45:39.684086 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-fb8135b6-8854-4e81-9e99-40968d56aa4d tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.141691 Nov 01 01:45:39.684656 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1139/2364] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:45:39 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:45:40.554568 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-fcd58b04-89c8-4c0e-85b1-e8c2f0b60932 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:45:40.555179 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-fcd58b04-89c8-4c0e-85b1-e8c2f0b60932 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:45:40.561350 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-fcd58b04-89c8-4c0e-85b1-e8c2f0b60932 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:40.561788 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-fcd58b04-89c8-4c0e-85b1-e8c2f0b60932 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:40.562562 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-fcd58b04-89c8-4c0e-85b1-e8c2f0b60932 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:40.563105 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-fcd58b04-89c8-4c0e-85b1-e8c2f0b60932 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:40.622148 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-fcd58b04-89c8-4c0e-85b1-e8c2f0b60932 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:45:40.629852 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-fcd58b04-89c8-4c0e-85b1-e8c2f0b60932 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1368 microversion: 2.1 time: 0.078935 Nov 01 01:45:40.630462 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1226/2365] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:45:40 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:45:40.700949 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-93128902-53f6-49af-a2df-99688f7b2abc tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:45:40.701680 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-93128902-53f6-49af-a2df-99688f7b2abc tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:45:40.707964 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-93128902-53f6-49af-a2df-99688f7b2abc tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:40.708917 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-93128902-53f6-49af-a2df-99688f7b2abc tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:40.709669 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-93128902-53f6-49af-a2df-99688f7b2abc tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:40.710094 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-93128902-53f6-49af-a2df-99688f7b2abc tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:40.831847 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-93128902-53f6-49af-a2df-99688f7b2abc tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:45:40.840140 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-93128902-53f6-49af-a2df-99688f7b2abc tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.142920 Nov 01 01:45:40.840695 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1140/2366] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:45:40 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:45:41.646783 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-ba6d84bf-2815-444a-8748-105ed75f9031 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:45:41.647343 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-ba6d84bf-2815-444a-8748-105ed75f9031 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:45:41.654367 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ba6d84bf-2815-444a-8748-105ed75f9031 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:41.654839 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ba6d84bf-2815-444a-8748-105ed75f9031 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:41.655595 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ba6d84bf-2815-444a-8748-105ed75f9031 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:41.656023 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ba6d84bf-2815-444a-8748-105ed75f9031 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:41.715398 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-ba6d84bf-2815-444a-8748-105ed75f9031 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:45:41.723051 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-ba6d84bf-2815-444a-8748-105ed75f9031 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1368 microversion: 2.1 time: 0.080021 Nov 01 01:45:41.723603 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1227/2367] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:45:41 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:45:41.857543 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-2a07c5b0-c4bd-4ab7-aa17-9ab77f363ba3 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:45:41.858128 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-2a07c5b0-c4bd-4ab7-aa17-9ab77f363ba3 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:45:41.865073 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2a07c5b0-c4bd-4ab7-aa17-9ab77f363ba3 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:41.865522 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2a07c5b0-c4bd-4ab7-aa17-9ab77f363ba3 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:41.866276 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2a07c5b0-c4bd-4ab7-aa17-9ab77f363ba3 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:41.866739 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2a07c5b0-c4bd-4ab7-aa17-9ab77f363ba3 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:41.986519 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-2a07c5b0-c4bd-4ab7-aa17-9ab77f363ba3 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:45:41.994840 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-2a07c5b0-c4bd-4ab7-aa17-9ab77f363ba3 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.140904 Nov 01 01:45:41.995402 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1141/2368] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:45:41 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:45:42.739376 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-c8b503b1-b42b-4a56-8fa8-778c4cc6cb04 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:45:42.740495 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-c8b503b1-b42b-4a56-8fa8-778c4cc6cb04 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:45:42.746988 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c8b503b1-b42b-4a56-8fa8-778c4cc6cb04 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:42.747432 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c8b503b1-b42b-4a56-8fa8-778c4cc6cb04 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:42.748172 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c8b503b1-b42b-4a56-8fa8-778c4cc6cb04 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:42.748596 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c8b503b1-b42b-4a56-8fa8-778c4cc6cb04 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:42.808125 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-c8b503b1-b42b-4a56-8fa8-778c4cc6cb04 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:45:42.815768 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-c8b503b1-b42b-4a56-8fa8-778c4cc6cb04 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1368 microversion: 2.1 time: 0.080289 Nov 01 01:45:42.816324 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1228/2369] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:45:42 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:45:43.011590 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-5c2a9320-5f34-4c6b-a783-116aa6b93e78 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:45:43.012176 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-5c2a9320-5f34-4c6b-a783-116aa6b93e78 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:45:43.018786 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5c2a9320-5f34-4c6b-a783-116aa6b93e78 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:43.019229 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5c2a9320-5f34-4c6b-a783-116aa6b93e78 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:43.020171 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5c2a9320-5f34-4c6b-a783-116aa6b93e78 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:43.021162 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5c2a9320-5f34-4c6b-a783-116aa6b93e78 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:43.139420 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-5c2a9320-5f34-4c6b-a783-116aa6b93e78 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:45:43.147544 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-5c2a9320-5f34-4c6b-a783-116aa6b93e78 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.139616 Nov 01 01:45:43.148094 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1142/2370] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:45:43 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:45:43.832523 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-5c0fabb7-c09c-450b-aa1d-4f0ea9d6cd1f tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:45:43.833172 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-5c0fabb7-c09c-450b-aa1d-4f0ea9d6cd1f tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:45:43.839427 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-5c0fabb7-c09c-450b-aa1d-4f0ea9d6cd1f tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:43.839875 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-5c0fabb7-c09c-450b-aa1d-4f0ea9d6cd1f tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:43.840630 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-5c0fabb7-c09c-450b-aa1d-4f0ea9d6cd1f tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:43.841057 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-5c0fabb7-c09c-450b-aa1d-4f0ea9d6cd1f tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:43.899511 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-5c0fabb7-c09c-450b-aa1d-4f0ea9d6cd1f tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:45:43.909986 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-5c0fabb7-c09c-450b-aa1d-4f0ea9d6cd1f tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1368 microversion: 2.1 time: 0.081256 Nov 01 01:45:43.910569 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1229/2371] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:45:43 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:45:44.164537 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-71754f8e-7f1b-4f97-96d0-4f556d9e6c29 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:45:44.165075 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-71754f8e-7f1b-4f97-96d0-4f556d9e6c29 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:45:44.171212 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-71754f8e-7f1b-4f97-96d0-4f556d9e6c29 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:44.171655 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-71754f8e-7f1b-4f97-96d0-4f556d9e6c29 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:44.172418 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-71754f8e-7f1b-4f97-96d0-4f556d9e6c29 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:44.172846 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-71754f8e-7f1b-4f97-96d0-4f556d9e6c29 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:44.291752 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-71754f8e-7f1b-4f97-96d0-4f556d9e6c29 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:45:44.299376 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-71754f8e-7f1b-4f97-96d0-4f556d9e6c29 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.139073 Nov 01 01:45:44.299933 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1143/2372] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:45:44 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:45:44.927116 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-4690d4bd-eae0-4de0-badd-90bd95aca421 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:45:44.927768 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-4690d4bd-eae0-4de0-badd-90bd95aca421 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:45:44.933980 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4690d4bd-eae0-4de0-badd-90bd95aca421 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:44.934450 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4690d4bd-eae0-4de0-badd-90bd95aca421 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:44.935218 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4690d4bd-eae0-4de0-badd-90bd95aca421 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:44.935649 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4690d4bd-eae0-4de0-badd-90bd95aca421 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:44.994116 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-4690d4bd-eae0-4de0-badd-90bd95aca421 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:45:45.001820 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-4690d4bd-eae0-4de0-badd-90bd95aca421 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1368 microversion: 2.1 time: 0.078431 Nov 01 01:45:45.002380 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1230/2373] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:45:44 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:45:45.315335 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-33c9a798-7ec2-44af-a8f6-774c2ebba8da tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:45:45.315895 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-33c9a798-7ec2-44af-a8f6-774c2ebba8da tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:45:45.323010 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-33c9a798-7ec2-44af-a8f6-774c2ebba8da tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:45.325376 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-33c9a798-7ec2-44af-a8f6-774c2ebba8da tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:45.325376 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-33c9a798-7ec2-44af-a8f6-774c2ebba8da tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:45.325376 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-33c9a798-7ec2-44af-a8f6-774c2ebba8da tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:45.444605 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-33c9a798-7ec2-44af-a8f6-774c2ebba8da tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:45:45.452486 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-33c9a798-7ec2-44af-a8f6-774c2ebba8da tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.140968 Nov 01 01:45:45.453038 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1144/2374] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:45:45 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:45:46.018997 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-370d5c13-a9c0-4c9a-988a-c6a5c38f8aa9 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:45:46.019635 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-370d5c13-a9c0-4c9a-988a-c6a5c38f8aa9 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:45:46.025845 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-370d5c13-a9c0-4c9a-988a-c6a5c38f8aa9 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:46.026297 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-370d5c13-a9c0-4c9a-988a-c6a5c38f8aa9 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:46.027086 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-370d5c13-a9c0-4c9a-988a-c6a5c38f8aa9 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:46.027521 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-370d5c13-a9c0-4c9a-988a-c6a5c38f8aa9 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:46.087459 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-370d5c13-a9c0-4c9a-988a-c6a5c38f8aa9 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:45:46.095114 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-370d5c13-a9c0-4c9a-988a-c6a5c38f8aa9 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1368 microversion: 2.1 time: 0.079855 Nov 01 01:45:46.095678 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1231/2375] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:45:46 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:45:46.469307 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-8ac6b7a4-df5c-4307-ac1d-ff52f9c2beb8 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:45:46.469915 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-8ac6b7a4-df5c-4307-ac1d-ff52f9c2beb8 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:45:46.476590 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8ac6b7a4-df5c-4307-ac1d-ff52f9c2beb8 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:46.477038 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8ac6b7a4-df5c-4307-ac1d-ff52f9c2beb8 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:46.477794 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8ac6b7a4-df5c-4307-ac1d-ff52f9c2beb8 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:46.478222 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8ac6b7a4-df5c-4307-ac1d-ff52f9c2beb8 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:46.594355 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-8ac6b7a4-df5c-4307-ac1d-ff52f9c2beb8 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:45:46.602729 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-8ac6b7a4-df5c-4307-ac1d-ff52f9c2beb8 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.137116 Nov 01 01:45:46.603295 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1145/2376] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:45:46 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:45:47.111632 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-e2e8b7b5-1112-4ac2-af28-47dffb7ab64c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:45:47.112267 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-e2e8b7b5-1112-4ac2-af28-47dffb7ab64c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:45:47.118663 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e2e8b7b5-1112-4ac2-af28-47dffb7ab64c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:47.119111 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e2e8b7b5-1112-4ac2-af28-47dffb7ab64c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:47.119869 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e2e8b7b5-1112-4ac2-af28-47dffb7ab64c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:47.120331 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e2e8b7b5-1112-4ac2-af28-47dffb7ab64c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:47.181532 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-e2e8b7b5-1112-4ac2-af28-47dffb7ab64c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:45:47.189233 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-e2e8b7b5-1112-4ac2-af28-47dffb7ab64c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1368 microversion: 2.1 time: 0.081241 Nov 01 01:45:47.189795 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1232/2377] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:45:47 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:45:47.618961 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-3e0d8ed3-23cf-4681-ba13-700f3862cfda tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:45:47.619503 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-3e0d8ed3-23cf-4681-ba13-700f3862cfda tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:45:47.625740 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3e0d8ed3-23cf-4681-ba13-700f3862cfda tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:47.626185 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3e0d8ed3-23cf-4681-ba13-700f3862cfda tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:47.627021 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3e0d8ed3-23cf-4681-ba13-700f3862cfda tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:47.627452 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3e0d8ed3-23cf-4681-ba13-700f3862cfda tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:47.745183 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-3e0d8ed3-23cf-4681-ba13-700f3862cfda tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:45:47.752961 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-3e0d8ed3-23cf-4681-ba13-700f3862cfda tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.137696 Nov 01 01:45:47.753522 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1146/2378] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:45:47 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:45:48.206273 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-93f38efb-ded8-4ea8-9099-7f84a2cd0272 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:45:48.207242 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-93f38efb-ded8-4ea8-9099-7f84a2cd0272 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:45:48.213414 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-93f38efb-ded8-4ea8-9099-7f84a2cd0272 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:48.213849 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-93f38efb-ded8-4ea8-9099-7f84a2cd0272 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:48.214627 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-93f38efb-ded8-4ea8-9099-7f84a2cd0272 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:48.215049 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-93f38efb-ded8-4ea8-9099-7f84a2cd0272 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:48.273316 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-93f38efb-ded8-4ea8-9099-7f84a2cd0272 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:45:48.281428 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-93f38efb-ded8-4ea8-9099-7f84a2cd0272 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1368 microversion: 2.1 time: 0.078687 Nov 01 01:45:48.282364 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1233/2379] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:45:48 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:45:48.769703 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-925f861c-45fa-40da-993b-ae385295e16e tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:45:48.770313 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-925f861c-45fa-40da-993b-ae385295e16e tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:45:48.777031 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-925f861c-45fa-40da-993b-ae385295e16e tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:48.777472 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-925f861c-45fa-40da-993b-ae385295e16e tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:48.778229 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-925f861c-45fa-40da-993b-ae385295e16e tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:48.778680 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-925f861c-45fa-40da-993b-ae385295e16e tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:48.895502 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-925f861c-45fa-40da-993b-ae385295e16e tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:45:48.905704 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-925f861c-45fa-40da-993b-ae385295e16e tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.139632 Nov 01 01:45:48.907915 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1147/2380] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:45:48 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:45:49.298491 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-84a68fd3-9116-4ac5-851d-d4c8e5923cf8 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:45:49.299100 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-84a68fd3-9116-4ac5-851d-d4c8e5923cf8 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:45:49.305325 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-84a68fd3-9116-4ac5-851d-d4c8e5923cf8 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:49.305778 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-84a68fd3-9116-4ac5-851d-d4c8e5923cf8 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:49.306572 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-84a68fd3-9116-4ac5-851d-d4c8e5923cf8 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:49.307002 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-84a68fd3-9116-4ac5-851d-d4c8e5923cf8 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:49.608819 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-84a68fd3-9116-4ac5-851d-d4c8e5923cf8 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:45:49.617241 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-84a68fd3-9116-4ac5-851d-d4c8e5923cf8 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1368 microversion: 2.1 time: 0.322449 Nov 01 01:45:49.617799 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1234/2381] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:45:49 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1368 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:45:49.922763 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-4135de48-07fb-4b33-a671-70b02b1024bb tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:45:49.923318 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-4135de48-07fb-4b33-a671-70b02b1024bb tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:45:49.930146 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4135de48-07fb-4b33-a671-70b02b1024bb tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:49.930614 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4135de48-07fb-4b33-a671-70b02b1024bb tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:49.931359 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4135de48-07fb-4b33-a671-70b02b1024bb tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:49.931782 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4135de48-07fb-4b33-a671-70b02b1024bb tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:50.047144 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-4135de48-07fb-4b33-a671-70b02b1024bb tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:45:50.055279 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-4135de48-07fb-4b33-a671-70b02b1024bb tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.136224 Nov 01 01:45:50.055833 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1148/2382] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:45:49 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:45:50.634053 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-cd46c49f-22c8-47d9-ae04-7b31a217fed8 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:45:50.634641 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-cd46c49f-22c8-47d9-ae04-7b31a217fed8 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:45:50.640904 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-cd46c49f-22c8-47d9-ae04-7b31a217fed8 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:50.641349 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-cd46c49f-22c8-47d9-ae04-7b31a217fed8 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:50.642099 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-cd46c49f-22c8-47d9-ae04-7b31a217fed8 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:50.642557 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-cd46c49f-22c8-47d9-ae04-7b31a217fed8 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:50.701055 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-cd46c49f-22c8-47d9-ae04-7b31a217fed8 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:45:50.709620 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-cd46c49f-22c8-47d9-ae04-7b31a217fed8 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1368 microversion: 2.1 time: 0.079103 Nov 01 01:45:50.710183 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1235/2383] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:45:50 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:45:51.072013 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-4620bbac-8ad3-4734-ac69-49eb5191ec59 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:45:51.072619 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-4620bbac-8ad3-4734-ac69-49eb5191ec59 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:45:51.078867 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4620bbac-8ad3-4734-ac69-49eb5191ec59 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:51.079305 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4620bbac-8ad3-4734-ac69-49eb5191ec59 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:51.080052 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4620bbac-8ad3-4734-ac69-49eb5191ec59 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:51.080474 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4620bbac-8ad3-4734-ac69-49eb5191ec59 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:51.198789 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-4620bbac-8ad3-4734-ac69-49eb5191ec59 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:45:51.206606 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-4620bbac-8ad3-4734-ac69-49eb5191ec59 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.138875 Nov 01 01:45:51.207179 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1149/2384] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:45:51 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:45:51.726413 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-121676cd-69f9-4ac7-ab49-dab70314e175 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:45:51.727047 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-121676cd-69f9-4ac7-ab49-dab70314e175 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:45:51.733277 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-121676cd-69f9-4ac7-ab49-dab70314e175 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:51.733716 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-121676cd-69f9-4ac7-ab49-dab70314e175 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:51.734493 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-121676cd-69f9-4ac7-ab49-dab70314e175 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:51.734924 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-121676cd-69f9-4ac7-ab49-dab70314e175 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:51.793808 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-121676cd-69f9-4ac7-ab49-dab70314e175 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:45:51.803511 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-121676cd-69f9-4ac7-ab49-dab70314e175 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1368 microversion: 2.1 time: 0.081212 Nov 01 01:45:51.804077 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1236/2385] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:45:51 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:45:52.223312 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-23a15b26-c3d0-4c1b-a201-207d5f7799c8 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:45:52.223894 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-23a15b26-c3d0-4c1b-a201-207d5f7799c8 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:45:52.230710 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-23a15b26-c3d0-4c1b-a201-207d5f7799c8 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:52.231153 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-23a15b26-c3d0-4c1b-a201-207d5f7799c8 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:52.231896 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-23a15b26-c3d0-4c1b-a201-207d5f7799c8 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:52.232318 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-23a15b26-c3d0-4c1b-a201-207d5f7799c8 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:52.347686 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-23a15b26-c3d0-4c1b-a201-207d5f7799c8 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:45:52.355927 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-23a15b26-c3d0-4c1b-a201-207d5f7799c8 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.136260 Nov 01 01:45:52.356474 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1150/2386] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:45:52 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:45:52.820457 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-d4be8af8-46c8-4dc7-abfe-694fc6300cfe tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:45:52.821061 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-d4be8af8-46c8-4dc7-abfe-694fc6300cfe tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:45:52.827483 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d4be8af8-46c8-4dc7-abfe-694fc6300cfe tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:52.828011 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d4be8af8-46c8-4dc7-abfe-694fc6300cfe tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:52.828745 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d4be8af8-46c8-4dc7-abfe-694fc6300cfe tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:52.829204 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d4be8af8-46c8-4dc7-abfe-694fc6300cfe tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:52.890097 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-d4be8af8-46c8-4dc7-abfe-694fc6300cfe tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:45:52.898356 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-d4be8af8-46c8-4dc7-abfe-694fc6300cfe tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1368 microversion: 2.1 time: 0.081830 Nov 01 01:45:52.898941 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1237/2387] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:45:52 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:45:53.372787 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-a223ccfa-7593-40d8-809d-b77afa320fed tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:45:53.373392 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-a223ccfa-7593-40d8-809d-b77afa320fed tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:45:53.379787 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a223ccfa-7593-40d8-809d-b77afa320fed tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:53.380222 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a223ccfa-7593-40d8-809d-b77afa320fed tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:53.381678 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a223ccfa-7593-40d8-809d-b77afa320fed tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:53.382109 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a223ccfa-7593-40d8-809d-b77afa320fed tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:53.500458 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-a223ccfa-7593-40d8-809d-b77afa320fed tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:45:53.508627 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-a223ccfa-7593-40d8-809d-b77afa320fed tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.139471 Nov 01 01:45:53.509182 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1151/2388] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:45:53 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:45:53.915414 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-e8560c72-a40e-405a-b8c0-c6f0d62096a8 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:45:53.916002 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-e8560c72-a40e-405a-b8c0-c6f0d62096a8 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:45:53.922300 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e8560c72-a40e-405a-b8c0-c6f0d62096a8 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:53.922790 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e8560c72-a40e-405a-b8c0-c6f0d62096a8 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:53.923541 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e8560c72-a40e-405a-b8c0-c6f0d62096a8 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:53.923965 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e8560c72-a40e-405a-b8c0-c6f0d62096a8 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:53.982042 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-e8560c72-a40e-405a-b8c0-c6f0d62096a8 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:45:53.989609 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-e8560c72-a40e-405a-b8c0-c6f0d62096a8 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1368 microversion: 2.1 time: 0.078427 Nov 01 01:45:53.990160 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1238/2389] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:45:53 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:45:54.525733 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-1640acdb-8001-4bb2-9181-107add2f773c tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:45:54.526332 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-1640acdb-8001-4bb2-9181-107add2f773c tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:45:54.532880 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1640acdb-8001-4bb2-9181-107add2f773c tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:54.533319 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1640acdb-8001-4bb2-9181-107add2f773c tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:54.534068 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1640acdb-8001-4bb2-9181-107add2f773c tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:54.534826 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1640acdb-8001-4bb2-9181-107add2f773c tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:54.651363 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-1640acdb-8001-4bb2-9181-107add2f773c tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:45:54.658946 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-1640acdb-8001-4bb2-9181-107add2f773c tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.137604 Nov 01 01:45:54.659670 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1152/2390] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:45:54 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:45:55.007214 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-9b410cbb-b3b0-4884-a418-77567dd33acd tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:45:55.007823 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-9b410cbb-b3b0-4884-a418-77567dd33acd tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:45:55.014031 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9b410cbb-b3b0-4884-a418-77567dd33acd tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:55.014507 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9b410cbb-b3b0-4884-a418-77567dd33acd tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:55.015265 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9b410cbb-b3b0-4884-a418-77567dd33acd tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:55.015693 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9b410cbb-b3b0-4884-a418-77567dd33acd tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:55.076921 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-9b410cbb-b3b0-4884-a418-77567dd33acd tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:45:55.084592 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-9b410cbb-b3b0-4884-a418-77567dd33acd tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1368 microversion: 2.1 time: 0.081641 Nov 01 01:45:55.085151 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1239/2391] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:45:55 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:45:55.675783 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-d51ca1b9-9e0f-4f8b-8b8a-d3b3ca6669a5 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:45:55.676388 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-d51ca1b9-9e0f-4f8b-8b8a-d3b3ca6669a5 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:45:55.683171 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d51ca1b9-9e0f-4f8b-8b8a-d3b3ca6669a5 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:55.683611 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d51ca1b9-9e0f-4f8b-8b8a-d3b3ca6669a5 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:55.684356 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d51ca1b9-9e0f-4f8b-8b8a-d3b3ca6669a5 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:55.684778 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d51ca1b9-9e0f-4f8b-8b8a-d3b3ca6669a5 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:55.801317 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-d51ca1b9-9e0f-4f8b-8b8a-d3b3ca6669a5 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:45:55.809479 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-d51ca1b9-9e0f-4f8b-8b8a-d3b3ca6669a5 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.137349 Nov 01 01:45:55.810040 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1153/2392] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:45:55 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:45:56.101308 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-e98f32c6-a33d-4e48-8748-92b738ba9d2f tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:45:56.101829 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-e98f32c6-a33d-4e48-8748-92b738ba9d2f tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:45:56.107844 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e98f32c6-a33d-4e48-8748-92b738ba9d2f tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:56.108288 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e98f32c6-a33d-4e48-8748-92b738ba9d2f tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:56.109040 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e98f32c6-a33d-4e48-8748-92b738ba9d2f tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:56.109466 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e98f32c6-a33d-4e48-8748-92b738ba9d2f tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:56.167601 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-e98f32c6-a33d-4e48-8748-92b738ba9d2f tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:45:56.175186 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-e98f32c6-a33d-4e48-8748-92b738ba9d2f tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1368 microversion: 2.1 time: 0.078130 Nov 01 01:45:56.175751 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1240/2393] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:45:56 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1368 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:45:56.826638 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-81ff6c89-0a62-4b44-905b-bd58d0687027 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:45:56.827300 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-81ff6c89-0a62-4b44-905b-bd58d0687027 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:45:56.833505 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-81ff6c89-0a62-4b44-905b-bd58d0687027 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:56.833951 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-81ff6c89-0a62-4b44-905b-bd58d0687027 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:56.835304 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-81ff6c89-0a62-4b44-905b-bd58d0687027 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:56.835740 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-81ff6c89-0a62-4b44-905b-bd58d0687027 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:56.950974 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-81ff6c89-0a62-4b44-905b-bd58d0687027 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:45:56.958651 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-81ff6c89-0a62-4b44-905b-bd58d0687027 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.135601 Nov 01 01:45:56.959869 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1154/2394] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:45:56 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:45:57.191884 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-d4a823d5-54b6-4cd4-b643-b7b9c73d490a tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:45:57.192487 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-d4a823d5-54b6-4cd4-b643-b7b9c73d490a tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:45:57.199684 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d4a823d5-54b6-4cd4-b643-b7b9c73d490a tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:57.200073 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d4a823d5-54b6-4cd4-b643-b7b9c73d490a tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:57.200821 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d4a823d5-54b6-4cd4-b643-b7b9c73d490a tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:57.201247 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d4a823d5-54b6-4cd4-b643-b7b9c73d490a tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:57.262412 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-d4a823d5-54b6-4cd4-b643-b7b9c73d490a tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:45:57.270153 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-d4a823d5-54b6-4cd4-b643-b7b9c73d490a tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1368 microversion: 2.1 time: 0.081913 Nov 01 01:45:57.270748 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1241/2395] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:45:57 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:45:57.976536 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-1af2bc2e-56f0-4269-bd4e-5c8303ceb16a tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:45:57.977162 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-1af2bc2e-56f0-4269-bd4e-5c8303ceb16a tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:45:57.983556 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1af2bc2e-56f0-4269-bd4e-5c8303ceb16a tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:57.984235 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1af2bc2e-56f0-4269-bd4e-5c8303ceb16a tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:57.984747 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1af2bc2e-56f0-4269-bd4e-5c8303ceb16a tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:57.985175 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1af2bc2e-56f0-4269-bd4e-5c8303ceb16a tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:58.103177 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-1af2bc2e-56f0-4269-bd4e-5c8303ceb16a tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:45:58.110944 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-1af2bc2e-56f0-4269-bd4e-5c8303ceb16a tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.138538 Nov 01 01:45:58.111512 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1155/2396] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:45:57 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:45:58.286532 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-4f0b2d2a-bd58-4575-a6e2-b9717e679793 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:45:58.287671 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-4f0b2d2a-bd58-4575-a6e2-b9717e679793 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:45:58.293892 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4f0b2d2a-bd58-4575-a6e2-b9717e679793 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:58.294337 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4f0b2d2a-bd58-4575-a6e2-b9717e679793 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:58.295134 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4f0b2d2a-bd58-4575-a6e2-b9717e679793 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:58.295567 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4f0b2d2a-bd58-4575-a6e2-b9717e679793 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:58.371099 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-4f0b2d2a-bd58-4575-a6e2-b9717e679793 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:45:58.379216 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-4f0b2d2a-bd58-4575-a6e2-b9717e679793 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1368 microversion: 2.1 time: 0.096381 Nov 01 01:45:58.379774 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1242/2397] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:45:58 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1368 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:45:59.127438 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-9d18d2bd-106a-405e-bc71-8324d26f1c1c tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:45:59.128053 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-9d18d2bd-106a-405e-bc71-8324d26f1c1c tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:45:59.134914 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9d18d2bd-106a-405e-bc71-8324d26f1c1c tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:59.135360 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9d18d2bd-106a-405e-bc71-8324d26f1c1c tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:59.136120 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9d18d2bd-106a-405e-bc71-8324d26f1c1c tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:59.136551 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9d18d2bd-106a-405e-bc71-8324d26f1c1c tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:59.254990 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-9d18d2bd-106a-405e-bc71-8324d26f1c1c tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:45:59.263150 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-9d18d2bd-106a-405e-bc71-8324d26f1c1c tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.139353 Nov 01 01:45:59.263746 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1156/2398] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:45:59 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:45:59.395733 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-a9cc19a1-e11c-4a19-9d91-ad71bc737f7f tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:45:59.395733 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-a9cc19a1-e11c-4a19-9d91-ad71bc737f7f tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:45:59.402101 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a9cc19a1-e11c-4a19-9d91-ad71bc737f7f tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:59.402580 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a9cc19a1-e11c-4a19-9d91-ad71bc737f7f tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:59.403333 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a9cc19a1-e11c-4a19-9d91-ad71bc737f7f tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:45:59.403758 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a9cc19a1-e11c-4a19-9d91-ad71bc737f7f tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:45:59.462729 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-a9cc19a1-e11c-4a19-9d91-ad71bc737f7f tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:45:59.470553 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-a9cc19a1-e11c-4a19-9d91-ad71bc737f7f tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1368 microversion: 2.1 time: 0.078996 Nov 01 01:45:59.471117 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1243/2399] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:45:59 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:46:00.280303 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-a5993eed-a2ca-4da0-86b6-0dcd75bd091b tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:46:00.280866 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-a5993eed-a2ca-4da0-86b6-0dcd75bd091b tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:46:00.287734 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a5993eed-a2ca-4da0-86b6-0dcd75bd091b tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:00.288185 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a5993eed-a2ca-4da0-86b6-0dcd75bd091b tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:00.288942 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a5993eed-a2ca-4da0-86b6-0dcd75bd091b tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:00.289368 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a5993eed-a2ca-4da0-86b6-0dcd75bd091b tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:00.410502 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-a5993eed-a2ca-4da0-86b6-0dcd75bd091b tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:46:00.418178 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-a5993eed-a2ca-4da0-86b6-0dcd75bd091b tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.141657 Nov 01 01:46:00.418775 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1157/2400] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:46:00 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:46:00.487270 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-cc5220ca-a1b0-467d-82ac-cc20c938d122 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:46:00.487878 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-cc5220ca-a1b0-467d-82ac-cc20c938d122 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:46:00.494026 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-cc5220ca-a1b0-467d-82ac-cc20c938d122 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:00.494508 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-cc5220ca-a1b0-467d-82ac-cc20c938d122 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:00.495258 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-cc5220ca-a1b0-467d-82ac-cc20c938d122 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:00.495679 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-cc5220ca-a1b0-467d-82ac-cc20c938d122 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:00.556078 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-cc5220ca-a1b0-467d-82ac-cc20c938d122 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:46:00.563763 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-cc5220ca-a1b0-467d-82ac-cc20c938d122 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1368 microversion: 2.1 time: 0.080120 Nov 01 01:46:00.564322 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1244/2401] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:46:00 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:46:01.434585 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-ce49cf25-01d8-4a05-8f6b-7ceb4eeca0b1 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:46:01.435193 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-ce49cf25-01d8-4a05-8f6b-7ceb4eeca0b1 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:46:01.441435 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ce49cf25-01d8-4a05-8f6b-7ceb4eeca0b1 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:01.441873 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ce49cf25-01d8-4a05-8f6b-7ceb4eeca0b1 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:01.442653 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ce49cf25-01d8-4a05-8f6b-7ceb4eeca0b1 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:01.443077 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ce49cf25-01d8-4a05-8f6b-7ceb4eeca0b1 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:01.563055 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-ce49cf25-01d8-4a05-8f6b-7ceb4eeca0b1 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:46:01.570842 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-ce49cf25-01d8-4a05-8f6b-7ceb4eeca0b1 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.139963 Nov 01 01:46:01.571396 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1158/2402] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:46:01 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:46:01.580661 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-35b795ff-5fd0-4ee6-8089-5a7cb21a52d9 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:46:01.581265 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-35b795ff-5fd0-4ee6-8089-5a7cb21a52d9 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:46:01.587928 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-35b795ff-5fd0-4ee6-8089-5a7cb21a52d9 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:01.588370 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-35b795ff-5fd0-4ee6-8089-5a7cb21a52d9 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:01.589121 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-35b795ff-5fd0-4ee6-8089-5a7cb21a52d9 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:01.589732 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-35b795ff-5fd0-4ee6-8089-5a7cb21a52d9 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:01.647865 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-35b795ff-5fd0-4ee6-8089-5a7cb21a52d9 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:46:01.655438 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-35b795ff-5fd0-4ee6-8089-5a7cb21a52d9 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1368 microversion: 2.1 time: 0.078415 Nov 01 01:46:01.655996 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1245/2403] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:46:01 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:46:02.587365 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-98ff3eb8-e657-4b7b-8cca-03f8d051f246 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:46:02.587972 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-98ff3eb8-e657-4b7b-8cca-03f8d051f246 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:46:02.594206 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-98ff3eb8-e657-4b7b-8cca-03f8d051f246 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:02.594688 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-98ff3eb8-e657-4b7b-8cca-03f8d051f246 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:02.595453 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-98ff3eb8-e657-4b7b-8cca-03f8d051f246 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:02.595889 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-98ff3eb8-e657-4b7b-8cca-03f8d051f246 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:02.673132 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-3015b63b-6159-43c4-b386-a0a9f8b886a7 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:46:02.673750 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-3015b63b-6159-43c4-b386-a0a9f8b886a7 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:46:02.680761 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3015b63b-6159-43c4-b386-a0a9f8b886a7 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:02.690915 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3015b63b-6159-43c4-b386-a0a9f8b886a7 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:02.690915 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3015b63b-6159-43c4-b386-a0a9f8b886a7 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:02.690915 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3015b63b-6159-43c4-b386-a0a9f8b886a7 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:02.719639 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-98ff3eb8-e657-4b7b-8cca-03f8d051f246 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:46:02.726352 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-98ff3eb8-e657-4b7b-8cca-03f8d051f246 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.142634 Nov 01 01:46:02.726953 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1159/2404] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:46:02 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:46:02.750855 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-3015b63b-6159-43c4-b386-a0a9f8b886a7 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:46:02.758947 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-3015b63b-6159-43c4-b386-a0a9f8b886a7 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1368 microversion: 2.1 time: 0.089630 Nov 01 01:46:02.759518 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1246/2405] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:46:02 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:46:03.743980 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-e5e154f1-b0d0-476d-a660-841419810448 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:46:03.744588 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-e5e154f1-b0d0-476d-a660-841419810448 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:46:03.750944 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e5e154f1-b0d0-476d-a660-841419810448 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:03.751394 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e5e154f1-b0d0-476d-a660-841419810448 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:03.752152 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e5e154f1-b0d0-476d-a660-841419810448 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:03.752584 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e5e154f1-b0d0-476d-a660-841419810448 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:03.776404 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-798240c6-321f-40b7-bed3-c738d29d600a tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:46:03.777004 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-798240c6-321f-40b7-bed3-c738d29d600a tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:46:03.783110 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-798240c6-321f-40b7-bed3-c738d29d600a tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:03.783546 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-798240c6-321f-40b7-bed3-c738d29d600a tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:03.784300 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-798240c6-321f-40b7-bed3-c738d29d600a tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:03.784725 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-798240c6-321f-40b7-bed3-c738d29d600a tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:03.849205 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-798240c6-321f-40b7-bed3-c738d29d600a tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:46:03.860157 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-798240c6-321f-40b7-bed3-c738d29d600a tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1368 microversion: 2.1 time: 0.084768 Nov 01 01:46:03.860157 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1247/2406] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:46:03 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:46:03.896106 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-e5e154f1-b0d0-476d-a660-841419810448 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:46:03.904533 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-e5e154f1-b0d0-476d-a660-841419810448 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.164927 Nov 01 01:46:03.905097 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1160/2407] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:46:03 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:46:04.873965 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-c029c622-a5fd-4893-9349-829a0b53c9cd tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:46:04.874611 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-c029c622-a5fd-4893-9349-829a0b53c9cd tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:46:04.880783 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c029c622-a5fd-4893-9349-829a0b53c9cd tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:04.881219 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c029c622-a5fd-4893-9349-829a0b53c9cd tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:04.881961 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c029c622-a5fd-4893-9349-829a0b53c9cd tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:04.882387 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c029c622-a5fd-4893-9349-829a0b53c9cd tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:04.920874 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-3a252db2-fe07-45d3-a7c1-ee0381088f87 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:46:04.921413 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-3a252db2-fe07-45d3-a7c1-ee0381088f87 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:46:04.928247 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3a252db2-fe07-45d3-a7c1-ee0381088f87 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:04.928688 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3a252db2-fe07-45d3-a7c1-ee0381088f87 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:04.929445 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3a252db2-fe07-45d3-a7c1-ee0381088f87 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:04.929873 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3a252db2-fe07-45d3-a7c1-ee0381088f87 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:04.941012 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-c029c622-a5fd-4893-9349-829a0b53c9cd tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:46:04.948983 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-c029c622-a5fd-4893-9349-829a0b53c9cd tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1368 microversion: 2.1 time: 0.078703 Nov 01 01:46:04.949543 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1248/2408] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:46:04 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:46:05.055035 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-3a252db2-fe07-45d3-a7c1-ee0381088f87 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:46:05.062611 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-3a252db2-fe07-45d3-a7c1-ee0381088f87 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.145431 Nov 01 01:46:05.063172 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1161/2409] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:46:04 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:46:05.965340 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-a95f3515-9030-4234-b1ea-2348ace016a5 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:46:05.965925 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-a95f3515-9030-4234-b1ea-2348ace016a5 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:46:05.972109 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a95f3515-9030-4234-b1ea-2348ace016a5 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:05.972548 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a95f3515-9030-4234-b1ea-2348ace016a5 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:05.973289 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a95f3515-9030-4234-b1ea-2348ace016a5 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:05.973711 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a95f3515-9030-4234-b1ea-2348ace016a5 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:06.032363 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-a95f3515-9030-4234-b1ea-2348ace016a5 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:46:06.040630 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-a95f3515-9030-4234-b1ea-2348ace016a5 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1368 microversion: 2.1 time: 0.078899 Nov 01 01:46:06.041191 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1249/2410] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:46:05 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:46:06.079366 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-1a855748-a7b7-4c5b-84a3-08b59ea4a7e3 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:46:06.079980 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-1a855748-a7b7-4c5b-84a3-08b59ea4a7e3 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:46:06.086641 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1a855748-a7b7-4c5b-84a3-08b59ea4a7e3 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:06.087088 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1a855748-a7b7-4c5b-84a3-08b59ea4a7e3 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:06.087846 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1a855748-a7b7-4c5b-84a3-08b59ea4a7e3 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:06.088276 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1a855748-a7b7-4c5b-84a3-08b59ea4a7e3 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:06.203743 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-1a855748-a7b7-4c5b-84a3-08b59ea4a7e3 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:46:06.211921 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-1a855748-a7b7-4c5b-84a3-08b59ea4a7e3 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.136205 Nov 01 01:46:06.212477 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1162/2411] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:46:06 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:46:07.057417 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-0ec49e20-ce09-4337-a679-78fc3afd2cc7 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:46:07.058028 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-0ec49e20-ce09-4337-a679-78fc3afd2cc7 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:46:07.064238 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0ec49e20-ce09-4337-a679-78fc3afd2cc7 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:07.064678 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0ec49e20-ce09-4337-a679-78fc3afd2cc7 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:07.065431 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0ec49e20-ce09-4337-a679-78fc3afd2cc7 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:07.065859 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0ec49e20-ce09-4337-a679-78fc3afd2cc7 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:07.125399 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-0ec49e20-ce09-4337-a679-78fc3afd2cc7 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:46:07.133122 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-0ec49e20-ce09-4337-a679-78fc3afd2cc7 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1368 microversion: 2.1 time: 0.079370 Nov 01 01:46:07.133688 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1250/2412] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:46:07 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:46:07.228223 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-d9676739-573f-4783-a72f-550573d43fa9 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:46:07.228857 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-d9676739-573f-4783-a72f-550573d43fa9 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:46:07.235003 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d9676739-573f-4783-a72f-550573d43fa9 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:07.235441 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d9676739-573f-4783-a72f-550573d43fa9 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:07.236193 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d9676739-573f-4783-a72f-550573d43fa9 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:07.236619 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d9676739-573f-4783-a72f-550573d43fa9 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:07.357846 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-d9676739-573f-4783-a72f-550573d43fa9 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:46:07.366167 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-d9676739-573f-4783-a72f-550573d43fa9 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.142035 Nov 01 01:46:07.367246 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1163/2413] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:46:07 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:46:08.149678 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-e4c4d6ca-f569-4a8d-882c-2ea365fabf0e tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:46:08.150281 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-e4c4d6ca-f569-4a8d-882c-2ea365fabf0e tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:46:08.156565 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e4c4d6ca-f569-4a8d-882c-2ea365fabf0e tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:08.157010 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e4c4d6ca-f569-4a8d-882c-2ea365fabf0e tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:08.157764 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e4c4d6ca-f569-4a8d-882c-2ea365fabf0e tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:08.158200 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e4c4d6ca-f569-4a8d-882c-2ea365fabf0e tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:08.217801 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-e4c4d6ca-f569-4a8d-882c-2ea365fabf0e tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:46:08.225839 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-e4c4d6ca-f569-4a8d-882c-2ea365fabf0e tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1368 microversion: 2.1 time: 0.080028 Nov 01 01:46:08.226400 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1251/2414] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:46:08 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:46:08.382873 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-d9f799a2-e86f-43d3-8cca-f8786d9d4a67 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:46:08.383474 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-d9f799a2-e86f-43d3-8cca-f8786d9d4a67 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:46:08.389568 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d9f799a2-e86f-43d3-8cca-f8786d9d4a67 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:08.390010 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d9f799a2-e86f-43d3-8cca-f8786d9d4a67 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:08.390784 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d9f799a2-e86f-43d3-8cca-f8786d9d4a67 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:08.391210 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d9f799a2-e86f-43d3-8cca-f8786d9d4a67 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:08.508459 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-d9f799a2-e86f-43d3-8cca-f8786d9d4a67 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:46:08.516098 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-d9f799a2-e86f-43d3-8cca-f8786d9d4a67 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.136873 Nov 01 01:46:08.516656 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1164/2415] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:46:08 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:46:09.242256 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-a5d5873a-032c-4fd5-9a29-f5650cc40bf3 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:46:09.242890 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-a5d5873a-032c-4fd5-9a29-f5650cc40bf3 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:46:09.249080 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a5d5873a-032c-4fd5-9a29-f5650cc40bf3 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:09.249528 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a5d5873a-032c-4fd5-9a29-f5650cc40bf3 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:09.250288 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a5d5873a-032c-4fd5-9a29-f5650cc40bf3 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:09.250737 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a5d5873a-032c-4fd5-9a29-f5650cc40bf3 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:09.312811 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-a5d5873a-032c-4fd5-9a29-f5650cc40bf3 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:46:09.320897 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-a5d5873a-032c-4fd5-9a29-f5650cc40bf3 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1368 microversion: 2.1 time: 0.082324 Nov 01 01:46:09.321481 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1252/2416] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:46:09 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:46:09.532933 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-40195633-a979-4755-8f27-69d135845e85 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:46:09.533462 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-40195633-a979-4755-8f27-69d135845e85 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:46:09.539706 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-40195633-a979-4755-8f27-69d135845e85 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:09.540145 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-40195633-a979-4755-8f27-69d135845e85 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:09.540892 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-40195633-a979-4755-8f27-69d135845e85 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:09.541322 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-40195633-a979-4755-8f27-69d135845e85 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:09.657748 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-40195633-a979-4755-8f27-69d135845e85 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:46:09.665298 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-40195633-a979-4755-8f27-69d135845e85 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.136111 Nov 01 01:46:09.665853 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1165/2417] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:46:09 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:46:10.336841 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-cd77f9bf-92f4-4e5d-a82a-e6e9a233842a tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:46:10.337523 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-cd77f9bf-92f4-4e5d-a82a-e6e9a233842a tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:46:10.343651 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-cd77f9bf-92f4-4e5d-a82a-e6e9a233842a tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:10.344092 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-cd77f9bf-92f4-4e5d-a82a-e6e9a233842a tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:10.344846 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-cd77f9bf-92f4-4e5d-a82a-e6e9a233842a tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:10.345265 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-cd77f9bf-92f4-4e5d-a82a-e6e9a233842a tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:10.404241 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-cd77f9bf-92f4-4e5d-a82a-e6e9a233842a tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:46:10.412673 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-cd77f9bf-92f4-4e5d-a82a-e6e9a233842a tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1368 microversion: 2.1 time: 0.079518 Nov 01 01:46:10.413228 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1253/2418] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:46:10 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:46:10.681839 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-7b88a061-fe11-4cd6-bfa2-3617390164cf tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:46:10.682578 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-7b88a061-fe11-4cd6-bfa2-3617390164cf tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:46:10.688876 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7b88a061-fe11-4cd6-bfa2-3617390164cf tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:10.689317 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7b88a061-fe11-4cd6-bfa2-3617390164cf tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:10.690103 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7b88a061-fe11-4cd6-bfa2-3617390164cf tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:10.690558 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7b88a061-fe11-4cd6-bfa2-3617390164cf tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:10.810276 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-7b88a061-fe11-4cd6-bfa2-3617390164cf tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:46:10.818017 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-7b88a061-fe11-4cd6-bfa2-3617390164cf tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.139799 Nov 01 01:46:10.818606 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1166/2419] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:46:10 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:46:11.428822 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-28858d50-9313-4649-a197-dd2bc36e75bf tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:46:11.429429 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-28858d50-9313-4649-a197-dd2bc36e75bf tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:46:11.435763 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-28858d50-9313-4649-a197-dd2bc36e75bf tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:11.436202 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-28858d50-9313-4649-a197-dd2bc36e75bf tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:11.436952 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-28858d50-9313-4649-a197-dd2bc36e75bf tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:11.437380 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-28858d50-9313-4649-a197-dd2bc36e75bf tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:11.499351 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-28858d50-9313-4649-a197-dd2bc36e75bf tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:46:11.507166 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-28858d50-9313-4649-a197-dd2bc36e75bf tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1368 microversion: 2.1 time: 0.081935 Nov 01 01:46:11.507724 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1254/2420] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:46:11 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:46:11.835604 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-1f593ad7-101c-4aa4-b41e-a82c9daecf1f tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:46:11.836211 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-1f593ad7-101c-4aa4-b41e-a82c9daecf1f tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:46:11.842448 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1f593ad7-101c-4aa4-b41e-a82c9daecf1f tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:11.842904 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1f593ad7-101c-4aa4-b41e-a82c9daecf1f tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:11.843657 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1f593ad7-101c-4aa4-b41e-a82c9daecf1f tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:11.844085 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1f593ad7-101c-4aa4-b41e-a82c9daecf1f tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:11.962028 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-1f593ad7-101c-4aa4-b41e-a82c9daecf1f tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:46:11.969631 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-1f593ad7-101c-4aa4-b41e-a82c9daecf1f tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.138304 Nov 01 01:46:11.970200 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1167/2421] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:46:11 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:46:12.523864 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-0a941231-064d-4b58-b16b-758cc87bcf6a tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:46:12.524449 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-0a941231-064d-4b58-b16b-758cc87bcf6a tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:46:12.530886 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0a941231-064d-4b58-b16b-758cc87bcf6a tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:12.531335 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0a941231-064d-4b58-b16b-758cc87bcf6a tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:12.532158 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0a941231-064d-4b58-b16b-758cc87bcf6a tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:12.532588 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0a941231-064d-4b58-b16b-758cc87bcf6a tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:12.591505 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-0a941231-064d-4b58-b16b-758cc87bcf6a tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:46:12.599695 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-0a941231-064d-4b58-b16b-758cc87bcf6a tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1368 microversion: 2.1 time: 0.079102 Nov 01 01:46:12.600252 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1255/2422] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:46:12 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:46:12.986207 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-2dace1ad-0ea2-4102-b0fe-4302a607eb53 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:46:12.986856 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-2dace1ad-0ea2-4102-b0fe-4302a607eb53 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:46:12.993016 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2dace1ad-0ea2-4102-b0fe-4302a607eb53 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:12.993451 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2dace1ad-0ea2-4102-b0fe-4302a607eb53 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:12.994223 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2dace1ad-0ea2-4102-b0fe-4302a607eb53 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:12.994673 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2dace1ad-0ea2-4102-b0fe-4302a607eb53 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:13.115381 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-2dace1ad-0ea2-4102-b0fe-4302a607eb53 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:46:13.123257 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-2dace1ad-0ea2-4102-b0fe-4302a607eb53 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.140621 Nov 01 01:46:13.123816 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1168/2423] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:46:12 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:46:13.622853 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-b81a3082-45fa-4a71-9750-b248d1dcc3cd tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:46:13.623390 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-b81a3082-45fa-4a71-9750-b248d1dcc3cd tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:46:13.629695 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b81a3082-45fa-4a71-9750-b248d1dcc3cd tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:13.630136 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b81a3082-45fa-4a71-9750-b248d1dcc3cd tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:13.631515 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b81a3082-45fa-4a71-9750-b248d1dcc3cd tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:13.631944 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b81a3082-45fa-4a71-9750-b248d1dcc3cd tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:13.689792 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-b81a3082-45fa-4a71-9750-b248d1dcc3cd tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:46:13.698273 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-b81a3082-45fa-4a71-9750-b248d1dcc3cd tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1368 microversion: 2.1 time: 0.079154 Nov 01 01:46:13.698865 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1256/2424] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:46:13 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:46:14.140311 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-e569f842-7482-4632-87fa-7bb07542e081 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:46:14.140905 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-e569f842-7482-4632-87fa-7bb07542e081 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:46:14.147141 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e569f842-7482-4632-87fa-7bb07542e081 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:14.147586 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e569f842-7482-4632-87fa-7bb07542e081 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:14.148342 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e569f842-7482-4632-87fa-7bb07542e081 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:14.148772 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e569f842-7482-4632-87fa-7bb07542e081 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:14.264903 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-e569f842-7482-4632-87fa-7bb07542e081 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:46:14.272998 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-e569f842-7482-4632-87fa-7bb07542e081 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.136338 Nov 01 01:46:14.273551 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1169/2425] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:46:14 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:46:14.717391 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-8516555c-50c6-4dca-a7a2-44d7e730d284 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:46:14.717991 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-8516555c-50c6-4dca-a7a2-44d7e730d284 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:46:14.724306 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8516555c-50c6-4dca-a7a2-44d7e730d284 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:14.724748 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8516555c-50c6-4dca-a7a2-44d7e730d284 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:14.725497 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8516555c-50c6-4dca-a7a2-44d7e730d284 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:14.725925 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8516555c-50c6-4dca-a7a2-44d7e730d284 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:14.788535 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-8516555c-50c6-4dca-a7a2-44d7e730d284 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:46:14.796162 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-8516555c-50c6-4dca-a7a2-44d7e730d284 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1368 microversion: 2.1 time: 0.082520 Nov 01 01:46:14.796720 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1257/2426] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:46:14 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:46:15.289881 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-0d710aba-2543-4d8b-b575-89ff6bf24a17 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:46:15.296362 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-0d710aba-2543-4d8b-b575-89ff6bf24a17 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:46:15.297073 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0d710aba-2543-4d8b-b575-89ff6bf24a17 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:15.297674 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0d710aba-2543-4d8b-b575-89ff6bf24a17 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:15.298447 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0d710aba-2543-4d8b-b575-89ff6bf24a17 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:15.298878 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0d710aba-2543-4d8b-b575-89ff6bf24a17 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:15.431686 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-0d710aba-2543-4d8b-b575-89ff6bf24a17 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:46:15.441055 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-0d710aba-2543-4d8b-b575-89ff6bf24a17 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.154899 Nov 01 01:46:15.441649 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1170/2427] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:46:15 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:46:15.812556 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-29b1bdb9-e4c0-44af-a74a-f933338d6646 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:46:15.813154 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-29b1bdb9-e4c0-44af-a74a-f933338d6646 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:46:15.819657 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-29b1bdb9-e4c0-44af-a74a-f933338d6646 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:15.820095 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-29b1bdb9-e4c0-44af-a74a-f933338d6646 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:15.820871 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-29b1bdb9-e4c0-44af-a74a-f933338d6646 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:15.821295 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-29b1bdb9-e4c0-44af-a74a-f933338d6646 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:15.879265 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-29b1bdb9-e4c0-44af-a74a-f933338d6646 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:46:15.886891 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-29b1bdb9-e4c0-44af-a74a-f933338d6646 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1368 microversion: 2.1 time: 0.077977 Nov 01 01:46:15.887446 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1258/2428] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:46:15 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1368 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:46:16.458006 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-5deb1619-aa1f-4bfe-be3b-3c96145bd60a tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:46:16.459174 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-5deb1619-aa1f-4bfe-be3b-3c96145bd60a tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:46:16.465280 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5deb1619-aa1f-4bfe-be3b-3c96145bd60a tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:16.465721 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5deb1619-aa1f-4bfe-be3b-3c96145bd60a tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:16.466497 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5deb1619-aa1f-4bfe-be3b-3c96145bd60a tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:16.466924 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5deb1619-aa1f-4bfe-be3b-3c96145bd60a tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:16.584156 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-5deb1619-aa1f-4bfe-be3b-3c96145bd60a tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:46:16.591683 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-5deb1619-aa1f-4bfe-be3b-3c96145bd60a tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.137318 Nov 01 01:46:16.592234 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1171/2429] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:46:16 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:46:16.903831 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-48e51611-859b-42fe-b637-9c986fb13533 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:46:16.904430 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-48e51611-859b-42fe-b637-9c986fb13533 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:46:16.910639 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-48e51611-859b-42fe-b637-9c986fb13533 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:16.911080 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-48e51611-859b-42fe-b637-9c986fb13533 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:16.911868 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-48e51611-859b-42fe-b637-9c986fb13533 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:16.912291 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-48e51611-859b-42fe-b637-9c986fb13533 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:16.974143 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-48e51611-859b-42fe-b637-9c986fb13533 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:46:16.981768 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-48e51611-859b-42fe-b637-9c986fb13533 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1368 microversion: 2.1 time: 0.081554 Nov 01 01:46:16.982327 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1259/2430] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:46:16 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:46:17.608434 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-e477acb5-b443-4a3e-9368-186ab6e7cbe3 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:46:17.609039 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-e477acb5-b443-4a3e-9368-186ab6e7cbe3 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:46:17.615228 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e477acb5-b443-4a3e-9368-186ab6e7cbe3 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:17.615665 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e477acb5-b443-4a3e-9368-186ab6e7cbe3 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:17.616458 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e477acb5-b443-4a3e-9368-186ab6e7cbe3 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:17.616834 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e477acb5-b443-4a3e-9368-186ab6e7cbe3 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:17.735455 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-e477acb5-b443-4a3e-9368-186ab6e7cbe3 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:46:17.743074 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-e477acb5-b443-4a3e-9368-186ab6e7cbe3 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.138308 Nov 01 01:46:17.743629 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1172/2431] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:46:17 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:46:17.998140 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-492ff1d1-0e4e-4b3d-8d19-fbcc5757afb5 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:46:17.998766 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-492ff1d1-0e4e-4b3d-8d19-fbcc5757afb5 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:46:18.004935 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-492ff1d1-0e4e-4b3d-8d19-fbcc5757afb5 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:18.005951 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-492ff1d1-0e4e-4b3d-8d19-fbcc5757afb5 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:18.006724 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-492ff1d1-0e4e-4b3d-8d19-fbcc5757afb5 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:18.007148 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-492ff1d1-0e4e-4b3d-8d19-fbcc5757afb5 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:18.064579 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-492ff1d1-0e4e-4b3d-8d19-fbcc5757afb5 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:46:18.073153 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-492ff1d1-0e4e-4b3d-8d19-fbcc5757afb5 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1368 microversion: 2.1 time: 0.078680 Nov 01 01:46:18.073713 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1260/2432] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:46:17 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:46:18.759992 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-93e5b5ae-fe4c-4473-886b-a99f7b574af9 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:46:18.760621 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-93e5b5ae-fe4c-4473-886b-a99f7b574af9 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:46:18.766881 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-93e5b5ae-fe4c-4473-886b-a99f7b574af9 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:18.767320 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-93e5b5ae-fe4c-4473-886b-a99f7b574af9 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:18.768065 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-93e5b5ae-fe4c-4473-886b-a99f7b574af9 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:18.768486 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-93e5b5ae-fe4c-4473-886b-a99f7b574af9 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:18.885547 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-93e5b5ae-fe4c-4473-886b-a99f7b574af9 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:46:18.893232 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-93e5b5ae-fe4c-4473-886b-a99f7b574af9 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.136862 Nov 01 01:46:18.893784 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1173/2433] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:46:18 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:46:19.090099 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-ca0944ef-ad93-449d-9b80-bac899144625 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:46:19.090668 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-ca0944ef-ad93-449d-9b80-bac899144625 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:46:19.096812 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ca0944ef-ad93-449d-9b80-bac899144625 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:19.097254 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ca0944ef-ad93-449d-9b80-bac899144625 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:19.097999 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ca0944ef-ad93-449d-9b80-bac899144625 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:19.098443 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ca0944ef-ad93-449d-9b80-bac899144625 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:19.164182 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-ca0944ef-ad93-449d-9b80-bac899144625 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:46:19.171935 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-ca0944ef-ad93-449d-9b80-bac899144625 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1368 microversion: 2.1 time: 0.085572 Nov 01 01:46:19.172501 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1261/2434] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:46:19 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:46:19.909708 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-abed9240-b1e6-4e27-87c0-b08c53f27625 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:46:19.910292 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-abed9240-b1e6-4e27-87c0-b08c53f27625 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:46:19.916551 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-abed9240-b1e6-4e27-87c0-b08c53f27625 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:19.916988 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-abed9240-b1e6-4e27-87c0-b08c53f27625 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:19.917732 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-abed9240-b1e6-4e27-87c0-b08c53f27625 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:19.918153 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-abed9240-b1e6-4e27-87c0-b08c53f27625 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:20.035911 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-abed9240-b1e6-4e27-87c0-b08c53f27625 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:46:20.043568 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-abed9240-b1e6-4e27-87c0-b08c53f27625 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.137497 Nov 01 01:46:20.044125 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1174/2435] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:46:19 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:46:20.188428 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-626ce51f-8af9-4403-9330-bff1dcf3997e tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:46:20.189035 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-626ce51f-8af9-4403-9330-bff1dcf3997e tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:46:20.196177 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-626ce51f-8af9-4403-9330-bff1dcf3997e tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:20.196623 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-626ce51f-8af9-4403-9330-bff1dcf3997e tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:20.197384 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-626ce51f-8af9-4403-9330-bff1dcf3997e tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:20.197820 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-626ce51f-8af9-4403-9330-bff1dcf3997e tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:20.257767 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-626ce51f-8af9-4403-9330-bff1dcf3997e tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:46:20.265559 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-626ce51f-8af9-4403-9330-bff1dcf3997e tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1368 microversion: 2.1 time: 0.080781 Nov 01 01:46:20.266128 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1262/2436] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:46:20 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:46:21.060386 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-76d15c93-d4f8-47a0-8b56-fdce11b7ce41 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:46:21.060943 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-76d15c93-d4f8-47a0-8b56-fdce11b7ce41 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:46:21.067054 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-76d15c93-d4f8-47a0-8b56-fdce11b7ce41 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:21.068055 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-76d15c93-d4f8-47a0-8b56-fdce11b7ce41 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:21.068810 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-76d15c93-d4f8-47a0-8b56-fdce11b7ce41 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:21.069500 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-76d15c93-d4f8-47a0-8b56-fdce11b7ce41 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:21.188289 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-76d15c93-d4f8-47a0-8b56-fdce11b7ce41 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:46:21.196713 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-76d15c93-d4f8-47a0-8b56-fdce11b7ce41 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.140042 Nov 01 01:46:21.197268 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1175/2437] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:46:21 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:46:21.281819 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-8dd93309-224a-4835-aa92-ab40d0e660e7 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:46:21.282437 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-8dd93309-224a-4835-aa92-ab40d0e660e7 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:46:21.288593 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8dd93309-224a-4835-aa92-ab40d0e660e7 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:21.289037 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8dd93309-224a-4835-aa92-ab40d0e660e7 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:21.289784 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8dd93309-224a-4835-aa92-ab40d0e660e7 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:21.290211 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8dd93309-224a-4835-aa92-ab40d0e660e7 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:21.349547 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-8dd93309-224a-4835-aa92-ab40d0e660e7 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:46:21.357259 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-8dd93309-224a-4835-aa92-ab40d0e660e7 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1368 microversion: 2.1 time: 0.079041 Nov 01 01:46:21.357793 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1263/2438] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:46:21 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:46:22.214001 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-f07ff1e1-250c-4946-a841-35c6141e0ace tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:46:22.214647 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-f07ff1e1-250c-4946-a841-35c6141e0ace tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:46:22.220810 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f07ff1e1-250c-4946-a841-35c6141e0ace tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:22.221253 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f07ff1e1-250c-4946-a841-35c6141e0ace tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:22.222632 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f07ff1e1-250c-4946-a841-35c6141e0ace tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:22.223063 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f07ff1e1-250c-4946-a841-35c6141e0ace tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:22.345999 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-f07ff1e1-250c-4946-a841-35c6141e0ace tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:46:22.353812 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-f07ff1e1-250c-4946-a841-35c6141e0ace tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.143475 Nov 01 01:46:22.354369 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1176/2439] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:46:22 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:46:22.374108 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-fc586a97-c0ba-425f-b221-82446541b16c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:46:22.374751 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-fc586a97-c0ba-425f-b221-82446541b16c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:46:22.381428 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-fc586a97-c0ba-425f-b221-82446541b16c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:22.381864 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-fc586a97-c0ba-425f-b221-82446541b16c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:22.382652 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-fc586a97-c0ba-425f-b221-82446541b16c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:22.383075 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-fc586a97-c0ba-425f-b221-82446541b16c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:22.443339 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-fc586a97-c0ba-425f-b221-82446541b16c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:46:22.451276 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-fc586a97-c0ba-425f-b221-82446541b16c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1368 microversion: 2.1 time: 0.080742 Nov 01 01:46:22.451939 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1264/2440] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:46:22 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:46:23.370153 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-51663eea-936d-4857-a0b9-edee8d66101b tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:46:23.370815 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-51663eea-936d-4857-a0b9-edee8d66101b tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:46:23.377149 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-51663eea-936d-4857-a0b9-edee8d66101b tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:23.377593 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-51663eea-936d-4857-a0b9-edee8d66101b tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:23.378355 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-51663eea-936d-4857-a0b9-edee8d66101b tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:23.378814 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-51663eea-936d-4857-a0b9-edee8d66101b tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:23.467691 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-dd27b1b0-374c-45e8-8a8a-af6a9d6e80cf tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:46:23.468298 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-dd27b1b0-374c-45e8-8a8a-af6a9d6e80cf tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:46:23.475431 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-dd27b1b0-374c-45e8-8a8a-af6a9d6e80cf tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:23.475878 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-dd27b1b0-374c-45e8-8a8a-af6a9d6e80cf tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:23.476644 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-dd27b1b0-374c-45e8-8a8a-af6a9d6e80cf tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:23.477073 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-dd27b1b0-374c-45e8-8a8a-af6a9d6e80cf tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:23.499736 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-51663eea-936d-4857-a0b9-edee8d66101b tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:46:23.507425 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-51663eea-936d-4857-a0b9-edee8d66101b tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.140939 Nov 01 01:46:23.507989 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1177/2441] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:46:23 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:46:23.538656 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-dd27b1b0-374c-45e8-8a8a-af6a9d6e80cf tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:46:23.546220 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-dd27b1b0-374c-45e8-8a8a-af6a9d6e80cf tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1368 microversion: 2.1 time: 0.082211 Nov 01 01:46:23.546816 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1265/2442] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:46:23 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:46:24.524197 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-b8be8e49-2b6a-49c8-84e0-3c5a7fa8240f tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:46:24.524801 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-b8be8e49-2b6a-49c8-84e0-3c5a7fa8240f tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:46:24.531161 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b8be8e49-2b6a-49c8-84e0-3c5a7fa8240f tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:24.531600 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b8be8e49-2b6a-49c8-84e0-3c5a7fa8240f tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:24.532356 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b8be8e49-2b6a-49c8-84e0-3c5a7fa8240f tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:24.532784 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b8be8e49-2b6a-49c8-84e0-3c5a7fa8240f tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:24.562436 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-2d4ae36c-5600-427f-b7f2-b7ac2489c4a9 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:46:24.563149 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-2d4ae36c-5600-427f-b7f2-b7ac2489c4a9 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:46:24.569739 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-2d4ae36c-5600-427f-b7f2-b7ac2489c4a9 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:24.570261 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-2d4ae36c-5600-427f-b7f2-b7ac2489c4a9 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:24.571131 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-2d4ae36c-5600-427f-b7f2-b7ac2489c4a9 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:24.571567 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-2d4ae36c-5600-427f-b7f2-b7ac2489c4a9 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:24.651524 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-2d4ae36c-5600-427f-b7f2-b7ac2489c4a9 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:46:24.665979 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-2d4ae36c-5600-427f-b7f2-b7ac2489c4a9 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1368 microversion: 2.1 time: 0.107117 Nov 01 01:46:24.666593 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1266/2443] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:46:24 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1368 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:46:24.671018 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-b8be8e49-2b6a-49c8-84e0-3c5a7fa8240f tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:46:24.679633 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-b8be8e49-2b6a-49c8-84e0-3c5a7fa8240f tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.159183 Nov 01 01:46:24.680187 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1178/2444] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:46:24 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:46:25.682290 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-39c2e3a4-158c-499c-887c-a260247e738a tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:46:25.682959 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-39c2e3a4-158c-499c-887c-a260247e738a tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:46:25.688846 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-39c2e3a4-158c-499c-887c-a260247e738a tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:25.689286 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-39c2e3a4-158c-499c-887c-a260247e738a tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:25.690032 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-39c2e3a4-158c-499c-887c-a260247e738a tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:25.690475 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-39c2e3a4-158c-499c-887c-a260247e738a tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:25.696375 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-6a5f622c-79f9-4b0d-8584-50f09fef882e tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:46:25.697735 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-6a5f622c-79f9-4b0d-8584-50f09fef882e tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:46:25.704148 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6a5f622c-79f9-4b0d-8584-50f09fef882e tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:25.704853 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6a5f622c-79f9-4b0d-8584-50f09fef882e tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:25.705785 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6a5f622c-79f9-4b0d-8584-50f09fef882e tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:25.706315 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6a5f622c-79f9-4b0d-8584-50f09fef882e tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:25.753359 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-39c2e3a4-158c-499c-887c-a260247e738a tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:46:25.762083 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-39c2e3a4-158c-499c-887c-a260247e738a tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1368 microversion: 2.1 time: 0.083335 Nov 01 01:46:25.763407 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1267/2445] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:46:25 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:46:25.838799 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-6a5f622c-79f9-4b0d-8584-50f09fef882e tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:46:25.846716 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-6a5f622c-79f9-4b0d-8584-50f09fef882e tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.154187 Nov 01 01:46:25.847276 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1179/2446] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:46:25 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:46:26.779540 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-de0f87af-4d0b-42f5-8385-dc7237d78d82 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:46:26.780177 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-de0f87af-4d0b-42f5-8385-dc7237d78d82 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:46:26.786470 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-de0f87af-4d0b-42f5-8385-dc7237d78d82 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:26.786930 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-de0f87af-4d0b-42f5-8385-dc7237d78d82 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:26.787687 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-de0f87af-4d0b-42f5-8385-dc7237d78d82 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:26.788119 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-de0f87af-4d0b-42f5-8385-dc7237d78d82 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:26.846795 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-de0f87af-4d0b-42f5-8385-dc7237d78d82 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:46:26.854412 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-de0f87af-4d0b-42f5-8385-dc7237d78d82 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1368 microversion: 2.1 time: 0.078590 Nov 01 01:46:26.855001 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1268/2447] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:46:26 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:46:26.863840 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-0f51b219-ca15-43bb-8858-37237c3426bf tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:46:26.864449 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-0f51b219-ca15-43bb-8858-37237c3426bf tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:46:26.870602 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0f51b219-ca15-43bb-8858-37237c3426bf tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:26.871048 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0f51b219-ca15-43bb-8858-37237c3426bf tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:26.871798 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0f51b219-ca15-43bb-8858-37237c3426bf tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:26.872252 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0f51b219-ca15-43bb-8858-37237c3426bf tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:26.991519 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-0f51b219-ca15-43bb-8858-37237c3426bf tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:46:26.999199 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-0f51b219-ca15-43bb-8858-37237c3426bf tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.139034 Nov 01 01:46:26.999761 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1180/2448] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:46:26 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:46:27.871416 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-b923130a-7554-4416-8449-8f70ed48c0b4 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:46:27.872007 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-b923130a-7554-4416-8449-8f70ed48c0b4 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:46:27.878291 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b923130a-7554-4416-8449-8f70ed48c0b4 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:27.878762 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b923130a-7554-4416-8449-8f70ed48c0b4 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:27.879508 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b923130a-7554-4416-8449-8f70ed48c0b4 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:27.879928 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b923130a-7554-4416-8449-8f70ed48c0b4 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:27.988641 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-b923130a-7554-4416-8449-8f70ed48c0b4 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:46:27.996799 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-b923130a-7554-4416-8449-8f70ed48c0b4 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1368 microversion: 2.1 time: 0.129057 Nov 01 01:46:27.997352 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1269/2449] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:46:27 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1368 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:46:28.016413 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-12efd476-62b2-4990-bdbe-724bdc95b6f3 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:46:28.017015 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-12efd476-62b2-4990-bdbe-724bdc95b6f3 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:46:28.023174 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-12efd476-62b2-4990-bdbe-724bdc95b6f3 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:28.023613 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-12efd476-62b2-4990-bdbe-724bdc95b6f3 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:28.024360 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-12efd476-62b2-4990-bdbe-724bdc95b6f3 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:28.024782 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-12efd476-62b2-4990-bdbe-724bdc95b6f3 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:28.140484 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-12efd476-62b2-4990-bdbe-724bdc95b6f3 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:46:28.148089 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-12efd476-62b2-4990-bdbe-724bdc95b6f3 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.135429 Nov 01 01:46:28.148640 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1181/2450] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:46:28 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:46:29.013660 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-be0884c5-8444-426e-9cf4-f33421578904 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:46:29.014214 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-be0884c5-8444-426e-9cf4-f33421578904 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:46:29.020462 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-be0884c5-8444-426e-9cf4-f33421578904 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:29.020905 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-be0884c5-8444-426e-9cf4-f33421578904 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:29.022259 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-be0884c5-8444-426e-9cf4-f33421578904 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:29.022711 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-be0884c5-8444-426e-9cf4-f33421578904 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:29.083220 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-be0884c5-8444-426e-9cf4-f33421578904 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:46:29.091667 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-be0884c5-8444-426e-9cf4-f33421578904 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1368 microversion: 2.1 time: 0.081772 Nov 01 01:46:29.092229 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1270/2451] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:46:29 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:46:29.165128 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-e9550633-8cf9-489a-b1df-09ed0229a983 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:46:29.165732 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-e9550633-8cf9-489a-b1df-09ed0229a983 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:46:29.174375 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e9550633-8cf9-489a-b1df-09ed0229a983 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:29.174846 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e9550633-8cf9-489a-b1df-09ed0229a983 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:29.175612 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e9550633-8cf9-489a-b1df-09ed0229a983 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:29.176042 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e9550633-8cf9-489a-b1df-09ed0229a983 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:29.292291 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-e9550633-8cf9-489a-b1df-09ed0229a983 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:46:29.299873 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-e9550633-8cf9-489a-b1df-09ed0229a983 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.138508 Nov 01 01:46:29.300430 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1182/2452] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:46:29 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:46:30.107462 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-3ff1f85d-2aab-4a76-9a14-3d34e540c2c4 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:46:30.108068 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-3ff1f85d-2aab-4a76-9a14-3d34e540c2c4 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:46:30.114549 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3ff1f85d-2aab-4a76-9a14-3d34e540c2c4 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:30.115000 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3ff1f85d-2aab-4a76-9a14-3d34e540c2c4 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:30.115756 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3ff1f85d-2aab-4a76-9a14-3d34e540c2c4 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:30.116184 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3ff1f85d-2aab-4a76-9a14-3d34e540c2c4 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:30.176113 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-3ff1f85d-2aab-4a76-9a14-3d34e540c2c4 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:46:30.183779 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-3ff1f85d-2aab-4a76-9a14-3d34e540c2c4 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1368 microversion: 2.1 time: 0.079983 Nov 01 01:46:30.184338 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1271/2453] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:46:30 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:46:30.317020 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-34ba54ef-fad8-4b4e-9686-254f46b867b2 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:46:30.317587 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-34ba54ef-fad8-4b4e-9686-254f46b867b2 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:46:30.324095 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-34ba54ef-fad8-4b4e-9686-254f46b867b2 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:30.324695 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-34ba54ef-fad8-4b4e-9686-254f46b867b2 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:30.325499 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-34ba54ef-fad8-4b4e-9686-254f46b867b2 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:30.325963 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-34ba54ef-fad8-4b4e-9686-254f46b867b2 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:30.442570 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-34ba54ef-fad8-4b4e-9686-254f46b867b2 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:46:30.451187 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-34ba54ef-fad8-4b4e-9686-254f46b867b2 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.137846 Nov 01 01:46:30.451743 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1183/2454] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:46:30 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:46:31.200294 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-7071ce7b-f17e-4fad-b138-68790b06f78e tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:46:31.200937 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-7071ce7b-f17e-4fad-b138-68790b06f78e tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:46:31.207122 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-7071ce7b-f17e-4fad-b138-68790b06f78e tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:31.207567 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-7071ce7b-f17e-4fad-b138-68790b06f78e tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:31.208328 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-7071ce7b-f17e-4fad-b138-68790b06f78e tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:31.208756 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-7071ce7b-f17e-4fad-b138-68790b06f78e tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:31.270230 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-7071ce7b-f17e-4fad-b138-68790b06f78e tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:46:31.277882 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-7071ce7b-f17e-4fad-b138-68790b06f78e tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1368 microversion: 2.1 time: 0.081215 Nov 01 01:46:31.278454 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1272/2455] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:46:31 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:46:31.468468 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-08a438cc-f14a-44a3-a583-96f7b7a71b86 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:46:31.469001 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-08a438cc-f14a-44a3-a583-96f7b7a71b86 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:46:31.475866 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-08a438cc-f14a-44a3-a583-96f7b7a71b86 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:31.476307 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-08a438cc-f14a-44a3-a583-96f7b7a71b86 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:31.477049 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-08a438cc-f14a-44a3-a583-96f7b7a71b86 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:31.477472 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-08a438cc-f14a-44a3-a583-96f7b7a71b86 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:31.594582 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-08a438cc-f14a-44a3-a583-96f7b7a71b86 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:46:31.602789 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-08a438cc-f14a-44a3-a583-96f7b7a71b86 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.137990 Nov 01 01:46:31.603336 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1184/2456] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:46:31 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:46:32.295063 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-32164c19-acad-4bb2-b189-21fedd4398a2 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:46:32.295673 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-32164c19-acad-4bb2-b189-21fedd4398a2 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:46:32.301864 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-32164c19-acad-4bb2-b189-21fedd4398a2 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:32.302308 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-32164c19-acad-4bb2-b189-21fedd4398a2 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:32.303089 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-32164c19-acad-4bb2-b189-21fedd4398a2 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:32.304018 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-32164c19-acad-4bb2-b189-21fedd4398a2 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:32.369863 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-32164c19-acad-4bb2-b189-21fedd4398a2 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:46:32.377613 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-32164c19-acad-4bb2-b189-21fedd4398a2 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1368 microversion: 2.1 time: 0.086208 Nov 01 01:46:32.378166 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1273/2457] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:46:32 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:46:32.619890 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-c54f5d5c-b90d-4827-9373-76e525b21c83 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:46:32.620447 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-c54f5d5c-b90d-4827-9373-76e525b21c83 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:46:32.626575 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c54f5d5c-b90d-4827-9373-76e525b21c83 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:32.627017 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c54f5d5c-b90d-4827-9373-76e525b21c83 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:32.627762 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c54f5d5c-b90d-4827-9373-76e525b21c83 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:32.628185 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c54f5d5c-b90d-4827-9373-76e525b21c83 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:32.759152 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-c54f5d5c-b90d-4827-9373-76e525b21c83 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:46:32.767482 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-c54f5d5c-b90d-4827-9373-76e525b21c83 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.151825 Nov 01 01:46:32.768041 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1185/2458] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:46:32 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:46:33.394191 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-5c018f57-fbd3-40b4-a542-e7b8acb5171c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:46:33.394831 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-5c018f57-fbd3-40b4-a542-e7b8acb5171c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:46:33.401659 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-5c018f57-fbd3-40b4-a542-e7b8acb5171c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:33.402100 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-5c018f57-fbd3-40b4-a542-e7b8acb5171c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:33.402883 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-5c018f57-fbd3-40b4-a542-e7b8acb5171c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:33.403315 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-5c018f57-fbd3-40b4-a542-e7b8acb5171c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:33.461794 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-5c018f57-fbd3-40b4-a542-e7b8acb5171c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:46:33.469398 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-5c018f57-fbd3-40b4-a542-e7b8acb5171c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1368 microversion: 2.1 time: 0.078815 Nov 01 01:46:33.469898 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1274/2459] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:46:33 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:46:33.784181 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-e5f551e0-cb61-4870-8978-db85eee618c9 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:46:33.784726 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-e5f551e0-cb61-4870-8978-db85eee618c9 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:46:33.791200 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e5f551e0-cb61-4870-8978-db85eee618c9 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:33.791636 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e5f551e0-cb61-4870-8978-db85eee618c9 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:33.792381 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e5f551e0-cb61-4870-8978-db85eee618c9 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:33.792831 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e5f551e0-cb61-4870-8978-db85eee618c9 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:33.910775 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-e5f551e0-cb61-4870-8978-db85eee618c9 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:46:33.919845 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-e5f551e0-cb61-4870-8978-db85eee618c9 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.138003 Nov 01 01:46:33.919845 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1186/2460] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:46:33 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:46:34.485747 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-b94b8ee9-527a-4bc8-a4cd-3ca9132a4a0e tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:46:34.486343 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-b94b8ee9-527a-4bc8-a4cd-3ca9132a4a0e tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:46:34.492619 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b94b8ee9-527a-4bc8-a4cd-3ca9132a4a0e tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:34.493058 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b94b8ee9-527a-4bc8-a4cd-3ca9132a4a0e tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:34.493800 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b94b8ee9-527a-4bc8-a4cd-3ca9132a4a0e tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:34.494227 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b94b8ee9-527a-4bc8-a4cd-3ca9132a4a0e tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:34.558152 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-b94b8ee9-527a-4bc8-a4cd-3ca9132a4a0e tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:46:34.565941 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-b94b8ee9-527a-4bc8-a4cd-3ca9132a4a0e tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1368 microversion: 2.1 time: 0.083870 Nov 01 01:46:34.566519 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1275/2461] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:46:34 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:46:34.935053 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-09cd2d5e-9920-4cab-9b0b-ca1628a63dbf tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:46:34.935602 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-09cd2d5e-9920-4cab-9b0b-ca1628a63dbf tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:46:34.941795 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-09cd2d5e-9920-4cab-9b0b-ca1628a63dbf tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:34.942238 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-09cd2d5e-9920-4cab-9b0b-ca1628a63dbf tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:34.943031 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-09cd2d5e-9920-4cab-9b0b-ca1628a63dbf tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:34.943461 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-09cd2d5e-9920-4cab-9b0b-ca1628a63dbf tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:35.062562 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-09cd2d5e-9920-4cab-9b0b-ca1628a63dbf tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:46:35.071013 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-09cd2d5e-9920-4cab-9b0b-ca1628a63dbf tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.139709 Nov 01 01:46:35.071572 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1187/2462] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:46:34 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:46:35.582399 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-baf6ac23-051b-4357-93a1-1813a71a727e tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:46:35.582994 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-baf6ac23-051b-4357-93a1-1813a71a727e tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:46:35.589240 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-baf6ac23-051b-4357-93a1-1813a71a727e tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:35.589682 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-baf6ac23-051b-4357-93a1-1813a71a727e tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:35.590434 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-baf6ac23-051b-4357-93a1-1813a71a727e tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:35.590877 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-baf6ac23-051b-4357-93a1-1813a71a727e tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:35.649878 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-baf6ac23-051b-4357-93a1-1813a71a727e tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:46:35.657464 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-baf6ac23-051b-4357-93a1-1813a71a727e tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1368 microversion: 2.1 time: 0.078871 Nov 01 01:46:35.658020 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1276/2463] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:46:35 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:46:36.087829 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-178db0a0-02aa-4bca-b413-9097ce983899 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:46:36.088440 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-178db0a0-02aa-4bca-b413-9097ce983899 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:46:36.094795 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-178db0a0-02aa-4bca-b413-9097ce983899 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:36.095259 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-178db0a0-02aa-4bca-b413-9097ce983899 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:36.095998 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-178db0a0-02aa-4bca-b413-9097ce983899 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:36.096427 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-178db0a0-02aa-4bca-b413-9097ce983899 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:36.211892 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-178db0a0-02aa-4bca-b413-9097ce983899 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:46:36.219686 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-178db0a0-02aa-4bca-b413-9097ce983899 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.135627 Nov 01 01:46:36.220244 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1188/2464] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:46:36 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:46:36.674403 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-60e3e543-6151-4854-b9ab-5e285baf21e1 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:46:36.674967 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-60e3e543-6151-4854-b9ab-5e285baf21e1 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:46:36.681626 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-60e3e543-6151-4854-b9ab-5e285baf21e1 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:36.682070 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-60e3e543-6151-4854-b9ab-5e285baf21e1 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:36.682863 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-60e3e543-6151-4854-b9ab-5e285baf21e1 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:36.683298 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-60e3e543-6151-4854-b9ab-5e285baf21e1 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:36.749599 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-60e3e543-6151-4854-b9ab-5e285baf21e1 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:46:36.757830 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-60e3e543-6151-4854-b9ab-5e285baf21e1 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1368 microversion: 2.1 time: 0.087129 Nov 01 01:46:36.758390 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1277/2465] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:46:36 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:46:37.237388 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-d2f9811b-a2f8-4c55-8beb-03ea29a83460 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:46:37.237989 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-d2f9811b-a2f8-4c55-8beb-03ea29a83460 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:46:37.244804 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d2f9811b-a2f8-4c55-8beb-03ea29a83460 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:37.245243 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d2f9811b-a2f8-4c55-8beb-03ea29a83460 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:37.246016 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d2f9811b-a2f8-4c55-8beb-03ea29a83460 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:37.246462 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d2f9811b-a2f8-4c55-8beb-03ea29a83460 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:37.361902 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-d2f9811b-a2f8-4c55-8beb-03ea29a83460 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:46:37.370344 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-d2f9811b-a2f8-4c55-8beb-03ea29a83460 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.136596 Nov 01 01:46:37.371048 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1189/2466] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:46:37 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:46:37.774787 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-0d610683-2650-40cc-ac98-b397bfb3352c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:46:37.775425 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-0d610683-2650-40cc-ac98-b397bfb3352c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:46:37.781791 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0d610683-2650-40cc-ac98-b397bfb3352c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:37.782236 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0d610683-2650-40cc-ac98-b397bfb3352c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:37.783051 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0d610683-2650-40cc-ac98-b397bfb3352c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:37.783483 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0d610683-2650-40cc-ac98-b397bfb3352c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:37.842829 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-0d610683-2650-40cc-ac98-b397bfb3352c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:46:37.850828 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-0d610683-2650-40cc-ac98-b397bfb3352c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1368 microversion: 2.1 time: 0.080107 Nov 01 01:46:37.851395 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1278/2467] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:46:37 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:46:38.387506 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-75c1951b-5c84-4d08-acce-6c10557c1b89 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:46:38.388111 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-75c1951b-5c84-4d08-acce-6c10557c1b89 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:46:38.394204 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-75c1951b-5c84-4d08-acce-6c10557c1b89 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:38.394680 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-75c1951b-5c84-4d08-acce-6c10557c1b89 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:38.395429 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-75c1951b-5c84-4d08-acce-6c10557c1b89 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:38.395853 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-75c1951b-5c84-4d08-acce-6c10557c1b89 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:38.511779 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-75c1951b-5c84-4d08-acce-6c10557c1b89 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:46:38.519595 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-75c1951b-5c84-4d08-acce-6c10557c1b89 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.135666 Nov 01 01:46:38.520148 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1190/2468] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:46:38 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:46:38.867787 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-2cc434ef-8eee-49e3-b748-0da24a55e7ef tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:46:38.868400 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-2cc434ef-8eee-49e3-b748-0da24a55e7ef tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:46:38.874689 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-2cc434ef-8eee-49e3-b748-0da24a55e7ef tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:38.875138 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-2cc434ef-8eee-49e3-b748-0da24a55e7ef tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:38.875897 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-2cc434ef-8eee-49e3-b748-0da24a55e7ef tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:38.876331 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-2cc434ef-8eee-49e3-b748-0da24a55e7ef tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:38.937892 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-2cc434ef-8eee-49e3-b748-0da24a55e7ef tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:46:38.946287 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-2cc434ef-8eee-49e3-b748-0da24a55e7ef tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1368 microversion: 2.1 time: 0.082736 Nov 01 01:46:38.946929 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1279/2469] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:46:38 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:46:39.535776 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-e65f2046-7ae0-4813-a864-0a0574ffdf7e tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:46:39.536380 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-e65f2046-7ae0-4813-a864-0a0574ffdf7e tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:46:39.543100 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e65f2046-7ae0-4813-a864-0a0574ffdf7e tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:39.543542 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e65f2046-7ae0-4813-a864-0a0574ffdf7e tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:39.544285 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e65f2046-7ae0-4813-a864-0a0574ffdf7e tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:39.544712 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e65f2046-7ae0-4813-a864-0a0574ffdf7e tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:39.664873 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-e65f2046-7ae0-4813-a864-0a0574ffdf7e tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:46:39.672472 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-e65f2046-7ae0-4813-a864-0a0574ffdf7e tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.140445 Nov 01 01:46:39.673027 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1191/2470] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:46:39 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:46:39.963349 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-2f137fad-896a-473f-83a3-2d6ae32daf34 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:46:39.963943 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-2f137fad-896a-473f-83a3-2d6ae32daf34 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:46:39.970111 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-2f137fad-896a-473f-83a3-2d6ae32daf34 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:39.970594 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-2f137fad-896a-473f-83a3-2d6ae32daf34 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:39.971356 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-2f137fad-896a-473f-83a3-2d6ae32daf34 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:39.971790 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-2f137fad-896a-473f-83a3-2d6ae32daf34 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:40.031456 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-2f137fad-896a-473f-83a3-2d6ae32daf34 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:46:40.039821 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-2f137fad-896a-473f-83a3-2d6ae32daf34 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1368 microversion: 2.1 time: 0.079985 Nov 01 01:46:40.040385 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1280/2471] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:46:39 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:46:40.689106 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-da62b335-781e-4335-84a2-a0c2f582ee3d tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:46:40.689573 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-da62b335-781e-4335-84a2-a0c2f582ee3d tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:46:40.696648 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-da62b335-781e-4335-84a2-a0c2f582ee3d tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:40.697093 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-da62b335-781e-4335-84a2-a0c2f582ee3d tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:40.697851 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-da62b335-781e-4335-84a2-a0c2f582ee3d tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:40.698280 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-da62b335-781e-4335-84a2-a0c2f582ee3d tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:40.827999 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-da62b335-781e-4335-84a2-a0c2f582ee3d tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:46:40.836068 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-da62b335-781e-4335-84a2-a0c2f582ee3d tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.150703 Nov 01 01:46:40.836625 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1192/2472] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:46:40 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:46:41.056650 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-3709ab80-f20b-4c3e-8163-5f65f40777c8 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:46:41.057172 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-3709ab80-f20b-4c3e-8163-5f65f40777c8 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:46:41.063368 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3709ab80-f20b-4c3e-8163-5f65f40777c8 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:41.063811 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3709ab80-f20b-4c3e-8163-5f65f40777c8 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:41.064557 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3709ab80-f20b-4c3e-8163-5f65f40777c8 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:41.064981 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3709ab80-f20b-4c3e-8163-5f65f40777c8 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:41.123425 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-3709ab80-f20b-4c3e-8163-5f65f40777c8 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:46:41.131003 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-3709ab80-f20b-4c3e-8163-5f65f40777c8 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1368 microversion: 2.1 time: 0.078627 Nov 01 01:46:41.131559 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1281/2473] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:46:41 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:46:41.852545 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-2028c292-278e-4281-9970-8d5f35cf33f0 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:46:41.853140 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-2028c292-278e-4281-9970-8d5f35cf33f0 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:46:41.859362 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2028c292-278e-4281-9970-8d5f35cf33f0 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:41.859799 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2028c292-278e-4281-9970-8d5f35cf33f0 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:41.860545 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2028c292-278e-4281-9970-8d5f35cf33f0 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:41.860967 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2028c292-278e-4281-9970-8d5f35cf33f0 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:41.977847 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-2028c292-278e-4281-9970-8d5f35cf33f0 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:46:41.985521 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-2028c292-278e-4281-9970-8d5f35cf33f0 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.136582 Nov 01 01:46:41.986079 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1193/2474] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:46:41 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:46:42.147338 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-2d11a2d7-f0e2-43c5-be11-a8f3369794bf tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:46:42.147856 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-2d11a2d7-f0e2-43c5-be11-a8f3369794bf tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:46:42.154113 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-2d11a2d7-f0e2-43c5-be11-a8f3369794bf tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:42.154600 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-2d11a2d7-f0e2-43c5-be11-a8f3369794bf tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:42.155360 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-2d11a2d7-f0e2-43c5-be11-a8f3369794bf tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:42.155787 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-2d11a2d7-f0e2-43c5-be11-a8f3369794bf tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:42.214677 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-2d11a2d7-f0e2-43c5-be11-a8f3369794bf tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:46:42.222260 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-2d11a2d7-f0e2-43c5-be11-a8f3369794bf tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1368 microversion: 2.1 time: 0.078622 Nov 01 01:46:42.222861 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1282/2475] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:46:42 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:46:43.001730 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-38be1ac7-35f4-4df2-8f12-0f04cd119233 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:46:43.002284 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-38be1ac7-35f4-4df2-8f12-0f04cd119233 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:46:43.008555 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-38be1ac7-35f4-4df2-8f12-0f04cd119233 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:43.008980 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-38be1ac7-35f4-4df2-8f12-0f04cd119233 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:43.009722 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-38be1ac7-35f4-4df2-8f12-0f04cd119233 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:43.010147 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-38be1ac7-35f4-4df2-8f12-0f04cd119233 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:43.128321 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-38be1ac7-35f4-4df2-8f12-0f04cd119233 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:46:43.136492 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-38be1ac7-35f4-4df2-8f12-0f04cd119233 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.138462 Nov 01 01:46:43.137042 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1194/2476] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:46:42 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:46:43.238740 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-0f278f58-5c45-4996-a009-05d3f1c3ce33 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:46:43.239351 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-0f278f58-5c45-4996-a009-05d3f1c3ce33 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:46:43.245692 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0f278f58-5c45-4996-a009-05d3f1c3ce33 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:43.246140 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0f278f58-5c45-4996-a009-05d3f1c3ce33 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:43.246934 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0f278f58-5c45-4996-a009-05d3f1c3ce33 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:43.247369 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0f278f58-5c45-4996-a009-05d3f1c3ce33 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:43.305753 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-0f278f58-5c45-4996-a009-05d3f1c3ce33 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:46:43.313475 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-0f278f58-5c45-4996-a009-05d3f1c3ce33 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1368 microversion: 2.1 time: 0.078371 Nov 01 01:46:43.314039 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1283/2477] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:46:43 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:46:44.153348 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-130e63d4-852b-48fe-9586-758cecb7fba0 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:46:44.153972 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-130e63d4-852b-48fe-9586-758cecb7fba0 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:46:44.160158 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-130e63d4-852b-48fe-9586-758cecb7fba0 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:44.160594 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-130e63d4-852b-48fe-9586-758cecb7fba0 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:44.161343 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-130e63d4-852b-48fe-9586-758cecb7fba0 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:44.161766 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-130e63d4-852b-48fe-9586-758cecb7fba0 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:44.281081 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-130e63d4-852b-48fe-9586-758cecb7fba0 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:46:44.288638 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-130e63d4-852b-48fe-9586-758cecb7fba0 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.139481 Nov 01 01:46:44.289189 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1195/2478] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:46:44 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:46:44.329915 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-4aee4baa-e977-449b-ba3a-7ce1ddc8de8f tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:46:44.330558 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-4aee4baa-e977-449b-ba3a-7ce1ddc8de8f tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:46:44.337317 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4aee4baa-e977-449b-ba3a-7ce1ddc8de8f tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:44.337765 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4aee4baa-e977-449b-ba3a-7ce1ddc8de8f tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:44.338550 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4aee4baa-e977-449b-ba3a-7ce1ddc8de8f tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:44.338982 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4aee4baa-e977-449b-ba3a-7ce1ddc8de8f tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:44.408373 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-4aee4baa-e977-449b-ba3a-7ce1ddc8de8f tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:46:44.416636 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-4aee4baa-e977-449b-ba3a-7ce1ddc8de8f tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1368 microversion: 2.1 time: 0.090324 Nov 01 01:46:44.417187 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1284/2479] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:46:44 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:46:45.306122 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-1d41de60-f6b8-4a89-86c6-0449e87d947d tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:46:45.306778 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-1d41de60-f6b8-4a89-86c6-0449e87d947d tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:46:45.312973 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1d41de60-f6b8-4a89-86c6-0449e87d947d tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:45.313418 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1d41de60-f6b8-4a89-86c6-0449e87d947d tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:45.314172 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1d41de60-f6b8-4a89-86c6-0449e87d947d tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:45.314754 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1d41de60-f6b8-4a89-86c6-0449e87d947d tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:45.433499 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-231b5303-b0d7-47a2-ae26-8f1a2df911bb tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:46:45.434162 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-231b5303-b0d7-47a2-ae26-8f1a2df911bb tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:46:45.434294 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-1d41de60-f6b8-4a89-86c6-0449e87d947d tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:46:45.440496 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-231b5303-b0d7-47a2-ae26-8f1a2df911bb tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:45.440946 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-231b5303-b0d7-47a2-ae26-8f1a2df911bb tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:45.441739 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-231b5303-b0d7-47a2-ae26-8f1a2df911bb tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:45.442177 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-231b5303-b0d7-47a2-ae26-8f1a2df911bb tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:45.442367 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-1d41de60-f6b8-4a89-86c6-0449e87d947d tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.140656 Nov 01 01:46:45.442968 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1196/2480] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:46:45 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:46:45.501583 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-231b5303-b0d7-47a2-ae26-8f1a2df911bb tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:46:45.509455 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-231b5303-b0d7-47a2-ae26-8f1a2df911bb tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1368 microversion: 2.1 time: 0.080193 Nov 01 01:46:45.510021 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1285/2481] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:46:45 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:46:46.459468 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-4de8f313-82bd-4ea1-a7c6-9c91f8ee1df5 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:46:46.460077 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-4de8f313-82bd-4ea1-a7c6-9c91f8ee1df5 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:46:46.466842 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4de8f313-82bd-4ea1-a7c6-9c91f8ee1df5 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:46.467283 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4de8f313-82bd-4ea1-a7c6-9c91f8ee1df5 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:46.468043 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4de8f313-82bd-4ea1-a7c6-9c91f8ee1df5 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:46.468472 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4de8f313-82bd-4ea1-a7c6-9c91f8ee1df5 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:46.527088 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-bb1e82e1-5b33-4f64-9f2f-7491dd1a662b tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:46:46.527675 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-bb1e82e1-5b33-4f64-9f2f-7491dd1a662b tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:46:46.533609 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-bb1e82e1-5b33-4f64-9f2f-7491dd1a662b tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:46.534054 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-bb1e82e1-5b33-4f64-9f2f-7491dd1a662b tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:46.534841 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-bb1e82e1-5b33-4f64-9f2f-7491dd1a662b tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:46.535277 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-bb1e82e1-5b33-4f64-9f2f-7491dd1a662b tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:46.608792 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-bb1e82e1-5b33-4f64-9f2f-7491dd1a662b tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:46:46.615810 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-4de8f313-82bd-4ea1-a7c6-9c91f8ee1df5 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:46:46.616658 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-bb1e82e1-5b33-4f64-9f2f-7491dd1a662b tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1368 microversion: 2.1 time: 0.094158 Nov 01 01:46:46.617276 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1286/2482] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:46:46 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1368 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:46:46.623597 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-4de8f313-82bd-4ea1-a7c6-9c91f8ee1df5 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.167844 Nov 01 01:46:46.624144 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1197/2483] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:46:46 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:46:47.632872 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-9ac52f13-fdbc-4b02-b6b1-f6f85f3a8c04 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:46:47.633407 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-9ac52f13-fdbc-4b02-b6b1-f6f85f3a8c04 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:46:47.639639 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9ac52f13-fdbc-4b02-b6b1-f6f85f3a8c04 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:47.639910 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-29df8112-a994-448c-8caa-15eca7f5eb0a tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:46:47.640336 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9ac52f13-fdbc-4b02-b6b1-f6f85f3a8c04 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:47.640524 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-29df8112-a994-448c-8caa-15eca7f5eb0a tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:46:47.640807 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9ac52f13-fdbc-4b02-b6b1-f6f85f3a8c04 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:47.641231 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9ac52f13-fdbc-4b02-b6b1-f6f85f3a8c04 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:47.646742 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-29df8112-a994-448c-8caa-15eca7f5eb0a tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:47.647195 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-29df8112-a994-448c-8caa-15eca7f5eb0a tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:47.647959 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-29df8112-a994-448c-8caa-15eca7f5eb0a tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:47.648392 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-29df8112-a994-448c-8caa-15eca7f5eb0a tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:47.706855 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-9ac52f13-fdbc-4b02-b6b1-f6f85f3a8c04 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:46:47.714611 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-9ac52f13-fdbc-4b02-b6b1-f6f85f3a8c04 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1368 microversion: 2.1 time: 0.085364 Nov 01 01:46:47.715180 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1287/2484] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:46:47 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:46:47.779244 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-29df8112-a994-448c-8caa-15eca7f5eb0a tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:46:47.786969 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-29df8112-a994-448c-8caa-15eca7f5eb0a tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.150743 Nov 01 01:46:47.787534 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1198/2485] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:46:47 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:46:48.731297 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-75f20274-b8bc-440f-b5d7-ca1b585dcde3 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:46:48.731911 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-75f20274-b8bc-440f-b5d7-ca1b585dcde3 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:46:48.738157 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-75f20274-b8bc-440f-b5d7-ca1b585dcde3 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:48.738642 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-75f20274-b8bc-440f-b5d7-ca1b585dcde3 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:48.739398 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-75f20274-b8bc-440f-b5d7-ca1b585dcde3 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:48.739826 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-75f20274-b8bc-440f-b5d7-ca1b585dcde3 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:48.803978 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-b9c641fe-5cd9-495c-af0d-ae39f89dc45c tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:46:48.804578 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-b9c641fe-5cd9-495c-af0d-ae39f89dc45c tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:46:48.808454 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-75f20274-b8bc-440f-b5d7-ca1b585dcde3 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:46:48.810605 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b9c641fe-5cd9-495c-af0d-ae39f89dc45c tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:48.811054 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b9c641fe-5cd9-495c-af0d-ae39f89dc45c tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:48.811826 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b9c641fe-5cd9-495c-af0d-ae39f89dc45c tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:48.812255 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b9c641fe-5cd9-495c-af0d-ae39f89dc45c tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:48.816451 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-75f20274-b8bc-440f-b5d7-ca1b585dcde3 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1368 microversion: 2.1 time: 0.089390 Nov 01 01:46:48.817014 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1288/2486] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:46:48 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:46:48.929238 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-b9c641fe-5cd9-495c-af0d-ae39f89dc45c tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:46:48.937160 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-b9c641fe-5cd9-495c-af0d-ae39f89dc45c tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.136763 Nov 01 01:46:48.937722 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1199/2487] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:46:48 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:46:49.833252 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-1a9de560-71b4-4825-89b2-72c4b620b2e9 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:46:49.833860 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-1a9de560-71b4-4825-89b2-72c4b620b2e9 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:46:49.840162 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-1a9de560-71b4-4825-89b2-72c4b620b2e9 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:49.840604 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-1a9de560-71b4-4825-89b2-72c4b620b2e9 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:49.841356 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-1a9de560-71b4-4825-89b2-72c4b620b2e9 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:49.841789 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-1a9de560-71b4-4825-89b2-72c4b620b2e9 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:49.899751 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-1a9de560-71b4-4825-89b2-72c4b620b2e9 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:46:49.907431 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-1a9de560-71b4-4825-89b2-72c4b620b2e9 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1368 microversion: 2.1 time: 0.077883 Nov 01 01:46:49.907994 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1289/2488] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:46:49 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1368 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:46:49.953428 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-645b6cf2-75f3-4ede-81e4-daef489c0ad6 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:46:49.954030 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-645b6cf2-75f3-4ede-81e4-daef489c0ad6 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:46:49.960335 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-645b6cf2-75f3-4ede-81e4-daef489c0ad6 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:49.960778 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-645b6cf2-75f3-4ede-81e4-daef489c0ad6 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:49.961529 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-645b6cf2-75f3-4ede-81e4-daef489c0ad6 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:49.961952 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-645b6cf2-75f3-4ede-81e4-daef489c0ad6 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:50.076856 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-645b6cf2-75f3-4ede-81e4-daef489c0ad6 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:46:50.084504 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-645b6cf2-75f3-4ede-81e4-daef489c0ad6 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.134635 Nov 01 01:46:50.085003 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1200/2489] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:46:49 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:46:50.924014 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-ec4e1e74-9587-4995-844e-cb3d71dff54e tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:46:50.924611 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-ec4e1e74-9587-4995-844e-cb3d71dff54e tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:46:50.930832 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ec4e1e74-9587-4995-844e-cb3d71dff54e tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:50.931272 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ec4e1e74-9587-4995-844e-cb3d71dff54e tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:50.932018 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ec4e1e74-9587-4995-844e-cb3d71dff54e tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:50.932443 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ec4e1e74-9587-4995-844e-cb3d71dff54e tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:50.995352 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-ec4e1e74-9587-4995-844e-cb3d71dff54e tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:46:51.003484 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-ec4e1e74-9587-4995-844e-cb3d71dff54e tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1368 microversion: 2.1 time: 0.083224 Nov 01 01:46:51.004043 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1290/2490] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:46:50 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:46:51.100789 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-d8711084-93af-4c4f-8fd0-5866c73e77ea tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:46:51.101390 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-d8711084-93af-4c4f-8fd0-5866c73e77ea tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:46:51.108086 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d8711084-93af-4c4f-8fd0-5866c73e77ea tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:51.108567 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d8711084-93af-4c4f-8fd0-5866c73e77ea tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:51.109315 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d8711084-93af-4c4f-8fd0-5866c73e77ea tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:51.109738 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d8711084-93af-4c4f-8fd0-5866c73e77ea tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:51.226001 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-d8711084-93af-4c4f-8fd0-5866c73e77ea tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:46:51.234305 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-d8711084-93af-4c4f-8fd0-5866c73e77ea tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.137186 Nov 01 01:46:51.234915 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1201/2491] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:46:51 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:46:52.020367 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-6755b38e-a8c4-4f1b-8817-8520882e2eaf tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:46:52.020969 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-6755b38e-a8c4-4f1b-8817-8520882e2eaf tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:46:52.027099 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-6755b38e-a8c4-4f1b-8817-8520882e2eaf tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:52.027533 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-6755b38e-a8c4-4f1b-8817-8520882e2eaf tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:52.028276 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-6755b38e-a8c4-4f1b-8817-8520882e2eaf tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:52.028697 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-6755b38e-a8c4-4f1b-8817-8520882e2eaf tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:52.086718 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-6755b38e-a8c4-4f1b-8817-8520882e2eaf tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:46:52.095047 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-6755b38e-a8c4-4f1b-8817-8520882e2eaf tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1368 microversion: 2.1 time: 0.078304 Nov 01 01:46:52.095609 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1291/2492] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:46:52 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1368 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:46:52.251447 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-c1a8c1f1-77fd-4898-bc82-acae77f85b5d tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:46:52.252057 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-c1a8c1f1-77fd-4898-bc82-acae77f85b5d tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:46:52.258223 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c1a8c1f1-77fd-4898-bc82-acae77f85b5d tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:52.258693 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c1a8c1f1-77fd-4898-bc82-acae77f85b5d tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:52.259443 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c1a8c1f1-77fd-4898-bc82-acae77f85b5d tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:52.259870 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c1a8c1f1-77fd-4898-bc82-acae77f85b5d tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:52.383030 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-c1a8c1f1-77fd-4898-bc82-acae77f85b5d tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:46:52.391370 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-c1a8c1f1-77fd-4898-bc82-acae77f85b5d tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.144009 Nov 01 01:46:52.391940 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1202/2493] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:46:52 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:46:53.112264 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-9caffa16-0876-411c-a980-c2fed3487df4 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:46:53.112831 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-9caffa16-0876-411c-a980-c2fed3487df4 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:46:53.119056 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9caffa16-0876-411c-a980-c2fed3487df4 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:53.119504 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9caffa16-0876-411c-a980-c2fed3487df4 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:53.120263 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9caffa16-0876-411c-a980-c2fed3487df4 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:53.120696 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9caffa16-0876-411c-a980-c2fed3487df4 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:53.182259 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-9caffa16-0876-411c-a980-c2fed3487df4 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:46:53.189953 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-9caffa16-0876-411c-a980-c2fed3487df4 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1368 microversion: 2.1 time: 0.081463 Nov 01 01:46:53.190542 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1292/2494] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:46:53 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:46:53.408540 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-a8cbbcf5-c71e-4291-9c2a-569345ef3f32 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:46:53.409142 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-a8cbbcf5-c71e-4291-9c2a-569345ef3f32 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:46:53.415355 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a8cbbcf5-c71e-4291-9c2a-569345ef3f32 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:53.415795 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a8cbbcf5-c71e-4291-9c2a-569345ef3f32 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:53.416541 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a8cbbcf5-c71e-4291-9c2a-569345ef3f32 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:53.416965 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a8cbbcf5-c71e-4291-9c2a-569345ef3f32 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:53.532579 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-a8cbbcf5-c71e-4291-9c2a-569345ef3f32 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:46:53.540171 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-a8cbbcf5-c71e-4291-9c2a-569345ef3f32 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.135805 Nov 01 01:46:53.540724 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1203/2495] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:46:53 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:46:54.206750 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-7c584c66-bb59-46b5-92b3-062458edf4c8 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:46:54.207356 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-7c584c66-bb59-46b5-92b3-062458edf4c8 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:46:54.213760 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-7c584c66-bb59-46b5-92b3-062458edf4c8 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:54.214233 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-7c584c66-bb59-46b5-92b3-062458edf4c8 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:54.215025 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-7c584c66-bb59-46b5-92b3-062458edf4c8 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:54.215456 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-7c584c66-bb59-46b5-92b3-062458edf4c8 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:54.274224 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-7c584c66-bb59-46b5-92b3-062458edf4c8 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:46:54.281978 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-7c584c66-bb59-46b5-92b3-062458edf4c8 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1368 microversion: 2.1 time: 0.078888 Nov 01 01:46:54.282568 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1293/2496] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:46:54 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:46:54.556914 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-04489581-2272-4708-88d7-46293049c53d tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:46:54.557437 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-04489581-2272-4708-88d7-46293049c53d tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:46:54.563633 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-04489581-2272-4708-88d7-46293049c53d tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:54.564077 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-04489581-2272-4708-88d7-46293049c53d tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:54.564873 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-04489581-2272-4708-88d7-46293049c53d tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:54.565300 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-04489581-2272-4708-88d7-46293049c53d tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:54.684070 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-04489581-2272-4708-88d7-46293049c53d tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:46:54.691787 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-04489581-2272-4708-88d7-46293049c53d tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.138563 Nov 01 01:46:54.692380 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1204/2497] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:46:54 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:46:55.298350 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-4e16d8e2-243f-446a-8eb7-5de33ab11567 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:46:55.298975 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-4e16d8e2-243f-446a-8eb7-5de33ab11567 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:46:55.305139 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4e16d8e2-243f-446a-8eb7-5de33ab11567 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:55.305585 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4e16d8e2-243f-446a-8eb7-5de33ab11567 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:55.306335 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4e16d8e2-243f-446a-8eb7-5de33ab11567 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:55.306794 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4e16d8e2-243f-446a-8eb7-5de33ab11567 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:55.366087 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-4e16d8e2-243f-446a-8eb7-5de33ab11567 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:46:55.373873 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-4e16d8e2-243f-446a-8eb7-5de33ab11567 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1368 microversion: 2.1 time: 0.079166 Nov 01 01:46:55.374975 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1294/2498] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:46:55 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:46:55.709284 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-da067975-de98-4c43-a190-2d9b6689d2fc tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:46:55.709886 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-da067975-de98-4c43-a190-2d9b6689d2fc tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:46:55.716109 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-da067975-de98-4c43-a190-2d9b6689d2fc tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:55.716545 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-da067975-de98-4c43-a190-2d9b6689d2fc tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:55.717289 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-da067975-de98-4c43-a190-2d9b6689d2fc tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:55.717710 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-da067975-de98-4c43-a190-2d9b6689d2fc tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:55.836845 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-da067975-de98-4c43-a190-2d9b6689d2fc tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:46:55.844479 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-da067975-de98-4c43-a190-2d9b6689d2fc tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.138910 Nov 01 01:46:55.845039 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1205/2499] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:46:55 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:46:56.391944 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-837bbf1e-8e43-4dab-9806-a7e9a4ad8ec3 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:46:56.392544 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-837bbf1e-8e43-4dab-9806-a7e9a4ad8ec3 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:46:56.398272 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-837bbf1e-8e43-4dab-9806-a7e9a4ad8ec3 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:56.398742 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-837bbf1e-8e43-4dab-9806-a7e9a4ad8ec3 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:56.399496 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-837bbf1e-8e43-4dab-9806-a7e9a4ad8ec3 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:56.399923 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-837bbf1e-8e43-4dab-9806-a7e9a4ad8ec3 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:56.458975 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-837bbf1e-8e43-4dab-9806-a7e9a4ad8ec3 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:46:56.466573 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-837bbf1e-8e43-4dab-9806-a7e9a4ad8ec3 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1368 microversion: 2.1 time: 0.078883 Nov 01 01:46:56.467143 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1295/2500] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:46:56 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:46:56.861214 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-c7a5ccde-4802-48ee-86dd-c079ef6c0d8e tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:46:56.861812 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-c7a5ccde-4802-48ee-86dd-c079ef6c0d8e tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:46:56.867978 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c7a5ccde-4802-48ee-86dd-c079ef6c0d8e tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:56.868420 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c7a5ccde-4802-48ee-86dd-c079ef6c0d8e tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:56.869163 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c7a5ccde-4802-48ee-86dd-c079ef6c0d8e tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:56.869584 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c7a5ccde-4802-48ee-86dd-c079ef6c0d8e tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:56.987971 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-c7a5ccde-4802-48ee-86dd-c079ef6c0d8e tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:46:56.995714 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-c7a5ccde-4802-48ee-86dd-c079ef6c0d8e tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.138189 Nov 01 01:46:56.996280 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1206/2501] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:46:56 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:46:57.483740 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-9dff551e-f133-4fef-b19d-6f8e22e9d950 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:46:57.484343 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-9dff551e-f133-4fef-b19d-6f8e22e9d950 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:46:57.491262 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9dff551e-f133-4fef-b19d-6f8e22e9d950 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:57.491704 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9dff551e-f133-4fef-b19d-6f8e22e9d950 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:57.492453 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9dff551e-f133-4fef-b19d-6f8e22e9d950 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:57.492880 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9dff551e-f133-4fef-b19d-6f8e22e9d950 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:57.550958 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-9dff551e-f133-4fef-b19d-6f8e22e9d950 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:46:57.558604 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-9dff551e-f133-4fef-b19d-6f8e22e9d950 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1368 microversion: 2.1 time: 0.078467 Nov 01 01:46:57.559170 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1296/2502] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:46:57 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:46:58.012782 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-2d253587-4fa5-42d4-9cbe-4f88fedbb952 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:46:58.013402 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-2d253587-4fa5-42d4-9cbe-4f88fedbb952 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:46:58.020154 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2d253587-4fa5-42d4-9cbe-4f88fedbb952 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:58.020592 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2d253587-4fa5-42d4-9cbe-4f88fedbb952 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:58.021340 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2d253587-4fa5-42d4-9cbe-4f88fedbb952 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:58.021763 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2d253587-4fa5-42d4-9cbe-4f88fedbb952 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:58.137776 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-2d253587-4fa5-42d4-9cbe-4f88fedbb952 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:46:58.145479 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-2d253587-4fa5-42d4-9cbe-4f88fedbb952 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.136333 Nov 01 01:46:58.146038 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1207/2503] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:46:58 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:46:58.575162 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-469fa92a-e712-40e4-a9bb-db00b20ae540 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:46:58.575759 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-469fa92a-e712-40e4-a9bb-db00b20ae540 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:46:58.582517 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-469fa92a-e712-40e4-a9bb-db00b20ae540 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:58.582958 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-469fa92a-e712-40e4-a9bb-db00b20ae540 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:58.583702 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-469fa92a-e712-40e4-a9bb-db00b20ae540 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:58.584123 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-469fa92a-e712-40e4-a9bb-db00b20ae540 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:58.646505 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-469fa92a-e712-40e4-a9bb-db00b20ae540 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:46:58.654124 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-469fa92a-e712-40e4-a9bb-db00b20ae540 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1368 microversion: 2.1 time: 0.082648 Nov 01 01:46:58.654720 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1297/2504] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:46:58 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:46:59.162133 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-d1d43d18-e283-452d-bcf6-86e0a8b4b5a1 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:46:59.162811 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-d1d43d18-e283-452d-bcf6-86e0a8b4b5a1 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:46:59.169134 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d1d43d18-e283-452d-bcf6-86e0a8b4b5a1 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:59.169573 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d1d43d18-e283-452d-bcf6-86e0a8b4b5a1 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:59.170322 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d1d43d18-e283-452d-bcf6-86e0a8b4b5a1 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:59.170773 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d1d43d18-e283-452d-bcf6-86e0a8b4b5a1 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:59.291152 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-d1d43d18-e283-452d-bcf6-86e0a8b4b5a1 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:46:59.299485 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-d1d43d18-e283-452d-bcf6-86e0a8b4b5a1 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.141024 Nov 01 01:46:59.300047 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1208/2505] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:46:59 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:46:59.671620 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-5b482a6c-45dc-42b4-8cce-0af4db75e067 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:46:59.672209 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-5b482a6c-45dc-42b4-8cce-0af4db75e067 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:46:59.679197 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-5b482a6c-45dc-42b4-8cce-0af4db75e067 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:59.679635 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-5b482a6c-45dc-42b4-8cce-0af4db75e067 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:59.680427 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-5b482a6c-45dc-42b4-8cce-0af4db75e067 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:46:59.680849 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-5b482a6c-45dc-42b4-8cce-0af4db75e067 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:46:59.739160 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-5b482a6c-45dc-42b4-8cce-0af4db75e067 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:46:59.746792 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-5b482a6c-45dc-42b4-8cce-0af4db75e067 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1368 microversion: 2.1 time: 0.079081 Nov 01 01:46:59.747344 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1298/2506] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:46:59 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:47:00.315598 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-ddea0b27-390f-4252-842b-1cbd83e03201 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:47:00.316159 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-ddea0b27-390f-4252-842b-1cbd83e03201 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:47:00.322595 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ddea0b27-390f-4252-842b-1cbd83e03201 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:47:00.323048 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ddea0b27-390f-4252-842b-1cbd83e03201 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:47:00.323806 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ddea0b27-390f-4252-842b-1cbd83e03201 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:47:00.324238 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ddea0b27-390f-4252-842b-1cbd83e03201 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:47:00.443681 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-ddea0b27-390f-4252-842b-1cbd83e03201 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:47:00.451415 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-ddea0b27-390f-4252-842b-1cbd83e03201 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.139575 Nov 01 01:47:00.451989 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1209/2507] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:47:00 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:47:00.763318 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-6ec5c867-2b0c-49ea-b156-590431b02096 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:47:00.763990 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-6ec5c867-2b0c-49ea-b156-590431b02096 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:47:00.770700 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-6ec5c867-2b0c-49ea-b156-590431b02096 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:47:00.771140 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-6ec5c867-2b0c-49ea-b156-590431b02096 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:47:00.771886 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-6ec5c867-2b0c-49ea-b156-590431b02096 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:47:00.772377 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-6ec5c867-2b0c-49ea-b156-590431b02096 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:47:00.834346 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-6ec5c867-2b0c-49ea-b156-590431b02096 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:47:00.842242 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-6ec5c867-2b0c-49ea-b156-590431b02096 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1368 microversion: 2.1 time: 0.082579 Nov 01 01:47:00.842854 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1299/2508] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:47:00 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:47:01.468681 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-249ef865-0113-4228-bf94-f03180e21b40 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:47:01.469290 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-249ef865-0113-4228-bf94-f03180e21b40 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:47:01.475555 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-249ef865-0113-4228-bf94-f03180e21b40 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:47:01.476000 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-249ef865-0113-4228-bf94-f03180e21b40 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:47:01.476760 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-249ef865-0113-4228-bf94-f03180e21b40 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:47:01.477189 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-249ef865-0113-4228-bf94-f03180e21b40 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:47:01.604318 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-249ef865-0113-4228-bf94-f03180e21b40 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:47:01.612681 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-249ef865-0113-4228-bf94-f03180e21b40 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.147666 Nov 01 01:47:01.613238 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1210/2509] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:47:01 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:47:01.859564 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-a9516142-970f-4031-a027-10db898cbc7e tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:47:01.860169 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-a9516142-970f-4031-a027-10db898cbc7e tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:47:01.866921 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a9516142-970f-4031-a027-10db898cbc7e tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:47:01.867364 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a9516142-970f-4031-a027-10db898cbc7e tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:47:01.868114 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a9516142-970f-4031-a027-10db898cbc7e tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:47:01.868549 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a9516142-970f-4031-a027-10db898cbc7e tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:47:01.928827 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-a9516142-970f-4031-a027-10db898cbc7e tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:47:01.936444 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-a9516142-970f-4031-a027-10db898cbc7e tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1368 microversion: 2.1 time: 0.080539 Nov 01 01:47:01.937005 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1300/2510] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:47:01 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:47:02.628860 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-3d08e8a3-38c8-473e-8f08-9c7b62976834 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:47:02.629395 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-3d08e8a3-38c8-473e-8f08-9c7b62976834 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:47:02.635558 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3d08e8a3-38c8-473e-8f08-9c7b62976834 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:47:02.635999 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3d08e8a3-38c8-473e-8f08-9c7b62976834 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:47:02.636747 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3d08e8a3-38c8-473e-8f08-9c7b62976834 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:47:02.637176 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3d08e8a3-38c8-473e-8f08-9c7b62976834 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:47:02.760633 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-3d08e8a3-38c8-473e-8f08-9c7b62976834 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:47:02.769098 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-3d08e8a3-38c8-473e-8f08-9c7b62976834 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.144494 Nov 01 01:47:02.778581 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1211/2511] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:47:02 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:47:02.953143 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-ced0f0e0-e1dc-45a8-ba37-e04a0dbea323 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:47:02.953858 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-ced0f0e0-e1dc-45a8-ba37-e04a0dbea323 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:47:02.960743 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ced0f0e0-e1dc-45a8-ba37-e04a0dbea323 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:47:02.961181 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ced0f0e0-e1dc-45a8-ba37-e04a0dbea323 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:47:02.961975 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ced0f0e0-e1dc-45a8-ba37-e04a0dbea323 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:47:02.962404 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ced0f0e0-e1dc-45a8-ba37-e04a0dbea323 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:47:03.021572 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-ced0f0e0-e1dc-45a8-ba37-e04a0dbea323 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:47:03.029183 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-ced0f0e0-e1dc-45a8-ba37-e04a0dbea323 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1368 microversion: 2.1 time: 0.079674 Nov 01 01:47:03.029739 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1301/2512] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:47:02 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:47:03.785881 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-234d8cca-b1ea-4902-a020-0ad5fbdffb08 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:47:03.786584 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-234d8cca-b1ea-4902-a020-0ad5fbdffb08 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:47:03.792688 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-234d8cca-b1ea-4902-a020-0ad5fbdffb08 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:47:03.793135 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-234d8cca-b1ea-4902-a020-0ad5fbdffb08 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:47:03.793883 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-234d8cca-b1ea-4902-a020-0ad5fbdffb08 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:47:03.794308 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-234d8cca-b1ea-4902-a020-0ad5fbdffb08 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:47:03.911423 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-234d8cca-b1ea-4902-a020-0ad5fbdffb08 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:47:03.920260 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-234d8cca-b1ea-4902-a020-0ad5fbdffb08 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.138002 Nov 01 01:47:03.920881 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1212/2513] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:47:03 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:47:04.045839 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-70ce04d3-1d77-4b0d-9912-68a80b316813 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:47:04.046388 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-70ce04d3-1d77-4b0d-9912-68a80b316813 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:47:04.053440 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-70ce04d3-1d77-4b0d-9912-68a80b316813 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:47:04.053888 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-70ce04d3-1d77-4b0d-9912-68a80b316813 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:47:04.054691 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-70ce04d3-1d77-4b0d-9912-68a80b316813 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:47:04.055127 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-70ce04d3-1d77-4b0d-9912-68a80b316813 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:47:04.114154 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-70ce04d3-1d77-4b0d-9912-68a80b316813 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:47:04.122110 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-70ce04d3-1d77-4b0d-9912-68a80b316813 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1368 microversion: 2.1 time: 0.079937 Nov 01 01:47:04.122708 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1302/2514] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:47:04 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:47:04.937308 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-f4f1d7a0-c553-4c32-a62f-d01c8680dbae tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:47:04.937912 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-f4f1d7a0-c553-4c32-a62f-d01c8680dbae tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:47:04.944955 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f4f1d7a0-c553-4c32-a62f-d01c8680dbae tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:47:04.945395 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f4f1d7a0-c553-4c32-a62f-d01c8680dbae tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:47:04.946141 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f4f1d7a0-c553-4c32-a62f-d01c8680dbae tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:47:04.946592 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f4f1d7a0-c553-4c32-a62f-d01c8680dbae tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:47:05.065819 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-f4f1d7a0-c553-4c32-a62f-d01c8680dbae tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:47:05.073760 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-f4f1d7a0-c553-4c32-a62f-d01c8680dbae tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.140149 Nov 01 01:47:05.074315 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1213/2515] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:47:04 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:47:05.138560 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-5388df89-5a0c-4472-9ada-f9cde0935f3e tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:47:05.139169 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-5388df89-5a0c-4472-9ada-f9cde0935f3e tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:47:05.145427 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-5388df89-5a0c-4472-9ada-f9cde0935f3e tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:47:05.145873 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-5388df89-5a0c-4472-9ada-f9cde0935f3e tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:47:05.146658 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-5388df89-5a0c-4472-9ada-f9cde0935f3e tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:47:05.147092 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-5388df89-5a0c-4472-9ada-f9cde0935f3e tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:47:05.205460 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-5388df89-5a0c-4472-9ada-f9cde0935f3e tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:47:05.213061 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-5388df89-5a0c-4472-9ada-f9cde0935f3e tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1368 microversion: 2.1 time: 0.078114 Nov 01 01:47:05.213611 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1303/2516] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:47:05 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1368 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:47:06.090058 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-7df45bf4-723c-4589-9a26-7fd979640b0b tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:47:06.090826 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-7df45bf4-723c-4589-9a26-7fd979640b0b tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:47:06.097072 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7df45bf4-723c-4589-9a26-7fd979640b0b tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:47:06.097520 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7df45bf4-723c-4589-9a26-7fd979640b0b tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:47:06.098275 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7df45bf4-723c-4589-9a26-7fd979640b0b tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:47:06.098737 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7df45bf4-723c-4589-9a26-7fd979640b0b tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:47:06.214254 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-7df45bf4-723c-4589-9a26-7fd979640b0b tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:47:06.221874 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-7df45bf4-723c-4589-9a26-7fd979640b0b tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.135432 Nov 01 01:47:06.222438 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1214/2517] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:47:06 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:47:06.229726 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-c5f2b718-bc87-4f93-87bb-8a1bd005b646 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:47:06.230497 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-c5f2b718-bc87-4f93-87bb-8a1bd005b646 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:47:06.237348 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c5f2b718-bc87-4f93-87bb-8a1bd005b646 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:47:06.238007 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c5f2b718-bc87-4f93-87bb-8a1bd005b646 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:47:06.238854 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c5f2b718-bc87-4f93-87bb-8a1bd005b646 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:47:06.239284 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c5f2b718-bc87-4f93-87bb-8a1bd005b646 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:47:06.307893 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-c5f2b718-bc87-4f93-87bb-8a1bd005b646 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:47:06.316324 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-c5f2b718-bc87-4f93-87bb-8a1bd005b646 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1368 microversion: 2.1 time: 0.090103 Nov 01 01:47:06.316885 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1304/2518] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:47:06 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:47:07.238807 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-0e9f9401-cca9-4619-bddb-038b62375196 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:47:07.239410 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-0e9f9401-cca9-4619-bddb-038b62375196 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:47:07.245609 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0e9f9401-cca9-4619-bddb-038b62375196 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:47:07.246047 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0e9f9401-cca9-4619-bddb-038b62375196 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:47:07.246819 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0e9f9401-cca9-4619-bddb-038b62375196 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:47:07.247245 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0e9f9401-cca9-4619-bddb-038b62375196 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:47:07.333435 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-d571c737-999c-4be0-a769-79a9dbdbef3f tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:47:07.334172 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-d571c737-999c-4be0-a769-79a9dbdbef3f tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:47:07.340511 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d571c737-999c-4be0-a769-79a9dbdbef3f tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:47:07.341074 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d571c737-999c-4be0-a769-79a9dbdbef3f tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:47:07.341919 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d571c737-999c-4be0-a769-79a9dbdbef3f tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:47:07.342447 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d571c737-999c-4be0-a769-79a9dbdbef3f tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:47:07.366056 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-0e9f9401-cca9-4619-bddb-038b62375196 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:47:07.373873 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-0e9f9401-cca9-4619-bddb-038b62375196 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.138769 Nov 01 01:47:07.374445 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1215/2519] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:47:07 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:47:07.405662 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-d571c737-999c-4be0-a769-79a9dbdbef3f tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:47:07.413522 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-d571c737-999c-4be0-a769-79a9dbdbef3f tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1368 microversion: 2.1 time: 0.084318 Nov 01 01:47:07.414080 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1305/2520] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:47:07 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:47:08.390395 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-9198b5e1-6423-4a72-97ae-72521abd872e tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:47:08.391021 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-9198b5e1-6423-4a72-97ae-72521abd872e tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:47:08.397657 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9198b5e1-6423-4a72-97ae-72521abd872e tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:47:08.398096 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9198b5e1-6423-4a72-97ae-72521abd872e tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:47:08.398874 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9198b5e1-6423-4a72-97ae-72521abd872e tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:47:08.399304 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9198b5e1-6423-4a72-97ae-72521abd872e tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:47:08.429965 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-b129a89d-c6b5-45c1-891e-806bcf1b3ff8 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:47:08.430655 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-b129a89d-c6b5-45c1-891e-806bcf1b3ff8 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:47:08.436993 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b129a89d-c6b5-45c1-891e-806bcf1b3ff8 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:47:08.437444 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b129a89d-c6b5-45c1-891e-806bcf1b3ff8 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:47:08.438203 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b129a89d-c6b5-45c1-891e-806bcf1b3ff8 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:47:08.438671 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b129a89d-c6b5-45c1-891e-806bcf1b3ff8 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:47:08.509934 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-b129a89d-c6b5-45c1-891e-806bcf1b3ff8 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:47:08.518476 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-b129a89d-c6b5-45c1-891e-806bcf1b3ff8 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1368 microversion: 2.1 time: 0.092049 Nov 01 01:47:08.519059 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1306/2521] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:47:08 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1368 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:47:08.545637 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-9198b5e1-6423-4a72-97ae-72521abd872e tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:47:08.553370 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-9198b5e1-6423-4a72-97ae-72521abd872e tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.166646 Nov 01 01:47:08.553924 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1216/2522] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:47:08 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:47:09.534601 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-2d46d26b-8aea-477f-9567-796e8de868fd tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:47:09.535128 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-2d46d26b-8aea-477f-9567-796e8de868fd tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:47:09.541281 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-2d46d26b-8aea-477f-9567-796e8de868fd tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:47:09.541720 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-2d46d26b-8aea-477f-9567-796e8de868fd tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:47:09.542485 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-2d46d26b-8aea-477f-9567-796e8de868fd tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:47:09.542912 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-2d46d26b-8aea-477f-9567-796e8de868fd tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:47:09.570921 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-e53e4bc2-fc3c-457f-939e-471a9e208e64 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:47:09.571528 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-e53e4bc2-fc3c-457f-939e-471a9e208e64 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:47:09.577864 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e53e4bc2-fc3c-457f-939e-471a9e208e64 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:47:09.578309 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e53e4bc2-fc3c-457f-939e-471a9e208e64 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:47:09.579104 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e53e4bc2-fc3c-457f-939e-471a9e208e64 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:47:09.579533 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e53e4bc2-fc3c-457f-939e-471a9e208e64 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:47:09.602132 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-2d46d26b-8aea-477f-9567-796e8de868fd tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:47:09.609836 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-2d46d26b-8aea-477f-9567-796e8de868fd tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1368 microversion: 2.1 time: 0.078968 Nov 01 01:47:09.610494 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1307/2523] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:47:09 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:47:09.696525 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-e53e4bc2-fc3c-457f-939e-471a9e208e64 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:47:09.704116 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-e53e4bc2-fc3c-457f-939e-471a9e208e64 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.137219 Nov 01 01:47:09.704867 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1217/2524] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:47:09 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:47:10.626608 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-c9df6384-baff-46d1-89c4-52c0a1c2a3de tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:47:10.627127 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-c9df6384-baff-46d1-89c4-52c0a1c2a3de tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:47:10.633374 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c9df6384-baff-46d1-89c4-52c0a1c2a3de tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:47:10.633816 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c9df6384-baff-46d1-89c4-52c0a1c2a3de tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:47:10.634610 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c9df6384-baff-46d1-89c4-52c0a1c2a3de tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:47:10.635039 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c9df6384-baff-46d1-89c4-52c0a1c2a3de tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:47:10.693462 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-c9df6384-baff-46d1-89c4-52c0a1c2a3de tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:47:10.701600 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-c9df6384-baff-46d1-89c4-52c0a1c2a3de tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1368 microversion: 2.1 time: 0.078398 Nov 01 01:47:10.701740 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1308/2525] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:47:10 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:47:10.721403 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-d5dff366-50ec-460b-85ba-d07cba6e03fe tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:47:10.722007 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-d5dff366-50ec-460b-85ba-d07cba6e03fe tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:47:10.728253 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d5dff366-50ec-460b-85ba-d07cba6e03fe tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:47:10.728694 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d5dff366-50ec-460b-85ba-d07cba6e03fe tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:47:10.729451 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d5dff366-50ec-460b-85ba-d07cba6e03fe tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:47:10.729872 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d5dff366-50ec-460b-85ba-d07cba6e03fe tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:47:10.855665 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-d5dff366-50ec-460b-85ba-d07cba6e03fe tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:47:10.863381 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-d5dff366-50ec-460b-85ba-d07cba6e03fe tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.146327 Nov 01 01:47:10.863956 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1218/2526] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:47:10 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:47:11.718188 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-dcca7823-7039-45c3-abf4-cbd6d71e5cd6 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:47:11.718883 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-dcca7823-7039-45c3-abf4-cbd6d71e5cd6 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:47:11.725615 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-dcca7823-7039-45c3-abf4-cbd6d71e5cd6 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:47:11.726059 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-dcca7823-7039-45c3-abf4-cbd6d71e5cd6 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:47:11.726841 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-dcca7823-7039-45c3-abf4-cbd6d71e5cd6 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:47:11.727272 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-dcca7823-7039-45c3-abf4-cbd6d71e5cd6 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:47:11.785837 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-dcca7823-7039-45c3-abf4-cbd6d71e5cd6 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:47:11.793450 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-dcca7823-7039-45c3-abf4-cbd6d71e5cd6 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1368 microversion: 2.1 time: 0.078893 Nov 01 01:47:11.794014 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1309/2527] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:47:11 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:47:11.880013 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-6f541d31-fc0d-4f51-b762-514d618cce89 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:47:11.880613 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-6f541d31-fc0d-4f51-b762-514d618cce89 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:47:11.886770 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6f541d31-fc0d-4f51-b762-514d618cce89 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:47:11.887222 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6f541d31-fc0d-4f51-b762-514d618cce89 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:47:11.888030 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6f541d31-fc0d-4f51-b762-514d618cce89 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:47:11.888451 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6f541d31-fc0d-4f51-b762-514d618cce89 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:47:12.003900 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-6f541d31-fc0d-4f51-b762-514d618cce89 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:47:12.011486 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-6f541d31-fc0d-4f51-b762-514d618cce89 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.135067 Nov 01 01:47:12.012046 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1219/2528] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:47:11 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:47:12.810130 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-81407408-ffd1-4da6-a0e3-f7e8e54008c8 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:47:12.810831 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-81407408-ffd1-4da6-a0e3-f7e8e54008c8 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:47:12.817166 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-81407408-ffd1-4da6-a0e3-f7e8e54008c8 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:47:12.817986 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-81407408-ffd1-4da6-a0e3-f7e8e54008c8 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:47:12.818753 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-81407408-ffd1-4da6-a0e3-f7e8e54008c8 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:47:12.819189 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-81407408-ffd1-4da6-a0e3-f7e8e54008c8 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:47:12.884927 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-81407408-ffd1-4da6-a0e3-f7e8e54008c8 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:47:12.893450 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-81407408-ffd1-4da6-a0e3-f7e8e54008c8 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1368 microversion: 2.1 time: 0.086864 Nov 01 01:47:12.893850 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1310/2529] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:47:12 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:47:13.028587 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-1051cf75-6870-491f-85cc-f5ae7c3f9f70 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:47:13.029123 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-1051cf75-6870-491f-85cc-f5ae7c3f9f70 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:47:13.035970 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1051cf75-6870-491f-85cc-f5ae7c3f9f70 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:47:13.036411 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1051cf75-6870-491f-85cc-f5ae7c3f9f70 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:47:13.037174 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1051cf75-6870-491f-85cc-f5ae7c3f9f70 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:47:13.037604 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1051cf75-6870-491f-85cc-f5ae7c3f9f70 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:47:13.152736 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-1051cf75-6870-491f-85cc-f5ae7c3f9f70 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:47:13.160342 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-1051cf75-6870-491f-85cc-f5ae7c3f9f70 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.135414 Nov 01 01:47:13.160901 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1220/2530] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:47:13 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:47:13.909386 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-3c8206cf-b284-4025-8c64-61aa1bbf4860 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:47:13.909968 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-3c8206cf-b284-4025-8c64-61aa1bbf4860 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:47:13.916186 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3c8206cf-b284-4025-8c64-61aa1bbf4860 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:47:13.916635 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3c8206cf-b284-4025-8c64-61aa1bbf4860 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:47:13.917368 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3c8206cf-b284-4025-8c64-61aa1bbf4860 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:47:13.917793 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3c8206cf-b284-4025-8c64-61aa1bbf4860 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:47:13.975883 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-3c8206cf-b284-4025-8c64-61aa1bbf4860 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:47:13.983779 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-3c8206cf-b284-4025-8c64-61aa1bbf4860 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1368 microversion: 2.1 time: 0.078569 Nov 01 01:47:13.984336 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1311/2531] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:47:13 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:47:14.177244 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-fb4a9f18-3c07-4fb4-97ec-a88a834736be tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:47:14.177853 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-fb4a9f18-3c07-4fb4-97ec-a88a834736be tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:47:14.184071 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-fb4a9f18-3c07-4fb4-97ec-a88a834736be tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:47:14.184517 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-fb4a9f18-3c07-4fb4-97ec-a88a834736be tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:47:14.185271 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-fb4a9f18-3c07-4fb4-97ec-a88a834736be tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:47:14.185702 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-fb4a9f18-3c07-4fb4-97ec-a88a834736be tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:47:14.300432 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-fb4a9f18-3c07-4fb4-97ec-a88a834736be tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:47:14.308114 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-fb4a9f18-3c07-4fb4-97ec-a88a834736be tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.135056 Nov 01 01:47:14.308672 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1221/2532] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:47:14 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:47:14.318523 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 01 01:47:14.318717 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: Mon Nov 1 01:47:14 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 01 01:47:15.001397 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-e4851826-1c14-438e-acaf-afd71752c57b tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:47:15.002598 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-e4851826-1c14-438e-acaf-afd71752c57b tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:47:15.009420 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e4851826-1c14-438e-acaf-afd71752c57b tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:47:15.009864 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e4851826-1c14-438e-acaf-afd71752c57b tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:47:15.010658 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e4851826-1c14-438e-acaf-afd71752c57b tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:47:15.011085 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e4851826-1c14-438e-acaf-afd71752c57b tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:47:15.073743 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-e4851826-1c14-438e-acaf-afd71752c57b tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:47:15.081498 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-e4851826-1c14-438e-acaf-afd71752c57b tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1368 microversion: 2.1 time: 0.083922 Nov 01 01:47:15.082058 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1312/2533] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:47:14 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:47:15.324485 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-b6f34ba9-00a2-4b06-a3cc-207907149d8f tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:47:15.325032 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-b6f34ba9-00a2-4b06-a3cc-207907149d8f tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:47:15.331254 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b6f34ba9-00a2-4b06-a3cc-207907149d8f tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:47:15.331685 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b6f34ba9-00a2-4b06-a3cc-207907149d8f tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:47:15.332441 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b6f34ba9-00a2-4b06-a3cc-207907149d8f tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:47:15.332872 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b6f34ba9-00a2-4b06-a3cc-207907149d8f tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:47:15.495473 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-b6f34ba9-00a2-4b06-a3cc-207907149d8f tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:47:15.503139 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-b6f34ba9-00a2-4b06-a3cc-207907149d8f tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.182429 Nov 01 01:47:15.503701 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1222/2534] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:47:15 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:47:16.098298 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-1bb3c8c0-d76e-4ad2-88a1-5aefbb86ff54 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:47:16.098917 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-1bb3c8c0-d76e-4ad2-88a1-5aefbb86ff54 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:47:16.105226 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-1bb3c8c0-d76e-4ad2-88a1-5aefbb86ff54 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:47:16.105705 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-1bb3c8c0-d76e-4ad2-88a1-5aefbb86ff54 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:47:16.106474 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-1bb3c8c0-d76e-4ad2-88a1-5aefbb86ff54 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:47:16.106899 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-1bb3c8c0-d76e-4ad2-88a1-5aefbb86ff54 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:47:16.168204 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-1bb3c8c0-d76e-4ad2-88a1-5aefbb86ff54 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:47:16.176655 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-1bb3c8c0-d76e-4ad2-88a1-5aefbb86ff54 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1368 microversion: 2.1 time: 0.082192 Nov 01 01:47:16.177225 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1313/2535] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:47:16 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:47:16.519533 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-d00be28b-3a80-4159-a4d7-af3140354056 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:47:16.520127 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-d00be28b-3a80-4159-a4d7-af3140354056 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:47:16.526409 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d00be28b-3a80-4159-a4d7-af3140354056 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:47:16.526886 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d00be28b-3a80-4159-a4d7-af3140354056 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:47:16.527641 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d00be28b-3a80-4159-a4d7-af3140354056 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:47:16.528072 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d00be28b-3a80-4159-a4d7-af3140354056 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:47:16.648302 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-d00be28b-3a80-4159-a4d7-af3140354056 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:47:16.655906 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-d00be28b-3a80-4159-a4d7-af3140354056 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.140691 Nov 01 01:47:16.656466 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1223/2536] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:47:16 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:47:17.193900 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-47071d54-ea27-4f8f-a2da-371f02a87b4c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:47:17.194531 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-47071d54-ea27-4f8f-a2da-371f02a87b4c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:47:17.200758 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-47071d54-ea27-4f8f-a2da-371f02a87b4c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:47:17.201202 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-47071d54-ea27-4f8f-a2da-371f02a87b4c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:47:17.201958 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-47071d54-ea27-4f8f-a2da-371f02a87b4c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:47:17.202385 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-47071d54-ea27-4f8f-a2da-371f02a87b4c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:47:17.260457 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-47071d54-ea27-4f8f-a2da-371f02a87b4c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:47:17.268667 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-47071d54-ea27-4f8f-a2da-371f02a87b4c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1368 microversion: 2.1 time: 0.078648 Nov 01 01:47:17.269218 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1314/2537] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:47:17 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:47:17.672582 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-4b872418-ca28-4d6a-9a51-06753c9335e4 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:47:17.673116 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-4b872418-ca28-4d6a-9a51-06753c9335e4 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:47:17.680011 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4b872418-ca28-4d6a-9a51-06753c9335e4 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:47:17.680453 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4b872418-ca28-4d6a-9a51-06753c9335e4 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:47:17.681206 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4b872418-ca28-4d6a-9a51-06753c9335e4 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:47:17.681637 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4b872418-ca28-4d6a-9a51-06753c9335e4 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:47:17.800049 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-4b872418-ca28-4d6a-9a51-06753c9335e4 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:47:17.807724 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-4b872418-ca28-4d6a-9a51-06753c9335e4 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.138903 Nov 01 01:47:17.808290 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1224/2538] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:47:17 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:47:18.285530 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-4dbd564a-fd3c-4390-983e-40b2b317ab9e tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:47:18.286128 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-4dbd564a-fd3c-4390-983e-40b2b317ab9e tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:47:18.292645 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4dbd564a-fd3c-4390-983e-40b2b317ab9e tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:47:18.293090 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4dbd564a-fd3c-4390-983e-40b2b317ab9e tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:47:18.293835 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4dbd564a-fd3c-4390-983e-40b2b317ab9e tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:47:18.294263 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4dbd564a-fd3c-4390-983e-40b2b317ab9e tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:47:18.354745 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-4dbd564a-fd3c-4390-983e-40b2b317ab9e tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:47:18.362766 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-4dbd564a-fd3c-4390-983e-40b2b317ab9e tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1368 microversion: 2.1 time: 0.081384 Nov 01 01:47:18.363338 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1315/2539] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:47:18 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:47:18.824397 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-83f43acd-631c-4c5c-9b22-d3505df5fd38 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:47:18.825002 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-83f43acd-631c-4c5c-9b22-d3505df5fd38 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:47:18.831396 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-83f43acd-631c-4c5c-9b22-d3505df5fd38 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:47:18.831840 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-83f43acd-631c-4c5c-9b22-d3505df5fd38 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:47:18.832627 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-83f43acd-631c-4c5c-9b22-d3505df5fd38 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:47:18.833055 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-83f43acd-631c-4c5c-9b22-d3505df5fd38 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:47:18.956419 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-83f43acd-631c-4c5c-9b22-d3505df5fd38 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:47:18.964057 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-83f43acd-631c-4c5c-9b22-d3505df5fd38 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.143314 Nov 01 01:47:18.964646 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1225/2540] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:47:18 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:47:19.378933 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-0e6fe3f0-faca-4814-99a5-8354a5439477 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:47:19.379534 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-0e6fe3f0-faca-4814-99a5-8354a5439477 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:47:19.385722 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0e6fe3f0-faca-4814-99a5-8354a5439477 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:47:19.386159 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0e6fe3f0-faca-4814-99a5-8354a5439477 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:47:19.386945 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0e6fe3f0-faca-4814-99a5-8354a5439477 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:47:19.387364 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0e6fe3f0-faca-4814-99a5-8354a5439477 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:47:19.445720 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-0e6fe3f0-faca-4814-99a5-8354a5439477 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:47:19.454491 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-0e6fe3f0-faca-4814-99a5-8354a5439477 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1368 microversion: 2.1 time: 0.079207 Nov 01 01:47:19.455192 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1316/2541] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:47:19 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:47:19.979954 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-32d374ae-bb74-491b-b8f3-ac3a222c8f73 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:47:19.980585 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-32d374ae-bb74-491b-b8f3-ac3a222c8f73 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:47:19.986749 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-32d374ae-bb74-491b-b8f3-ac3a222c8f73 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:47:19.987185 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-32d374ae-bb74-491b-b8f3-ac3a222c8f73 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:47:19.987933 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-32d374ae-bb74-491b-b8f3-ac3a222c8f73 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:47:19.988353 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-32d374ae-bb74-491b-b8f3-ac3a222c8f73 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:47:20.094033 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 01 01:47:20.094220 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: Mon Nov 1 01:47:20 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b (ip 10.222.0.47) !!! Nov 01 01:47:20.106225 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-32d374ae-bb74-491b-b8f3-ac3a222c8f73 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:47:20.115345 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-32d374ae-bb74-491b-b8f3-ac3a222c8f73 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.139048 Nov 01 01:47:20.116260 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1226/2542] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:47:19 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:47:20.470931 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-9531c9fe-3179-4a75-be25-40a115b929a9 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:47:20.471517 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-9531c9fe-3179-4a75-be25-40a115b929a9 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:47:20.477704 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9531c9fe-3179-4a75-be25-40a115b929a9 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:47:20.478151 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9531c9fe-3179-4a75-be25-40a115b929a9 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:47:20.478931 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9531c9fe-3179-4a75-be25-40a115b929a9 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:47:20.479354 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9531c9fe-3179-4a75-be25-40a115b929a9 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:47:20.541440 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-9531c9fe-3179-4a75-be25-40a115b929a9 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:47:20.549573 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-9531c9fe-3179-4a75-be25-40a115b929a9 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1368 microversion: 2.1 time: 0.082247 Nov 01 01:47:20.550134 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1317/2543] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:47:20 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:47:21.132675 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-0f476b44-fb92-49ac-a95d-153e120a27ca tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:47:21.133301 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-0f476b44-fb92-49ac-a95d-153e120a27ca tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:47:21.139614 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0f476b44-fb92-49ac-a95d-153e120a27ca tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:47:21.140055 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0f476b44-fb92-49ac-a95d-153e120a27ca tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:47:21.140800 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0f476b44-fb92-49ac-a95d-153e120a27ca tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:47:21.141223 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0f476b44-fb92-49ac-a95d-153e120a27ca tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:47:21.490508 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-0f476b44-fb92-49ac-a95d-153e120a27ca tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:47:21.498138 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-0f476b44-fb92-49ac-a95d-153e120a27ca tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.369122 Nov 01 01:47:21.498754 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1227/2544] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:47:21 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:47:21.565952 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-8a9ee1d6-c0db-405f-b31c-59796ab513f0 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:47:21.566585 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-8a9ee1d6-c0db-405f-b31c-59796ab513f0 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:47:21.572973 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8a9ee1d6-c0db-405f-b31c-59796ab513f0 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:47:21.573413 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8a9ee1d6-c0db-405f-b31c-59796ab513f0 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:47:21.574164 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8a9ee1d6-c0db-405f-b31c-59796ab513f0 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:47:21.574624 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8a9ee1d6-c0db-405f-b31c-59796ab513f0 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:47:21.632996 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-8a9ee1d6-c0db-405f-b31c-59796ab513f0 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:47:21.640664 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-8a9ee1d6-c0db-405f-b31c-59796ab513f0 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1368 microversion: 2.1 time: 0.078454 Nov 01 01:47:21.641220 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1318/2545] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:47:21 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:47:22.514806 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-e046211b-e1ff-40a6-8832-cbfa534d7403 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:47:22.515432 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-e046211b-e1ff-40a6-8832-cbfa534d7403 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:47:22.522148 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e046211b-e1ff-40a6-8832-cbfa534d7403 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:47:22.522615 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e046211b-e1ff-40a6-8832-cbfa534d7403 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:47:22.523370 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e046211b-e1ff-40a6-8832-cbfa534d7403 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:47:22.523793 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e046211b-e1ff-40a6-8832-cbfa534d7403 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:47:22.639581 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-e046211b-e1ff-40a6-8832-cbfa534d7403 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:47:22.647193 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-e046211b-e1ff-40a6-8832-cbfa534d7403 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.136062 Nov 01 01:47:22.647742 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1228/2546] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:47:22 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:47:22.656726 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-de2e4589-5314-412a-b135-3d707ce31832 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:47:22.657356 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-de2e4589-5314-412a-b135-3d707ce31832 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:47:22.663526 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-de2e4589-5314-412a-b135-3d707ce31832 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:47:22.663969 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-de2e4589-5314-412a-b135-3d707ce31832 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:47:22.664709 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-de2e4589-5314-412a-b135-3d707ce31832 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:47:22.665133 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-de2e4589-5314-412a-b135-3d707ce31832 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:47:22.726746 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-de2e4589-5314-412a-b135-3d707ce31832 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:47:22.734511 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-de2e4589-5314-412a-b135-3d707ce31832 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1368 microversion: 2.1 time: 0.081346 Nov 01 01:47:22.735073 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1319/2547] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:47:22 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:47:23.709550 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-1a1513a0-1231-4cb8-9d52-75bc0d65a0c8 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:47:23.710155 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-1a1513a0-1231-4cb8-9d52-75bc0d65a0c8 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:47:23.715877 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1a1513a0-1231-4cb8-9d52-75bc0d65a0c8 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:47:23.716314 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1a1513a0-1231-4cb8-9d52-75bc0d65a0c8 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:47:23.717058 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1a1513a0-1231-4cb8-9d52-75bc0d65a0c8 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:47:23.717478 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1a1513a0-1231-4cb8-9d52-75bc0d65a0c8 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:47:23.751984 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-7823ae9d-4366-4936-b769-671d5146fe0b tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:47:23.752584 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-7823ae9d-4366-4936-b769-671d5146fe0b tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:47:23.758836 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-7823ae9d-4366-4936-b769-671d5146fe0b tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:47:23.759280 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-7823ae9d-4366-4936-b769-671d5146fe0b tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:47:23.760035 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-7823ae9d-4366-4936-b769-671d5146fe0b tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:47:23.760462 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-7823ae9d-4366-4936-b769-671d5146fe0b tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:47:23.833094 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-7823ae9d-4366-4936-b769-671d5146fe0b tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:47:23.840841 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-7823ae9d-4366-4936-b769-671d5146fe0b tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1368 microversion: 2.1 time: 0.092963 Nov 01 01:47:23.841417 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1320/2548] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:47:23 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1368 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:47:23.851732 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-1a1513a0-1231-4cb8-9d52-75bc0d65a0c8 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:47:23.859376 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-1a1513a0-1231-4cb8-9d52-75bc0d65a0c8 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.199613 Nov 01 01:47:23.859932 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1229/2549] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:47:23 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:47:24.856986 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-d0a85bc0-5ded-4040-b3ba-929b4bc6d0e0 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:47:24.857600 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-d0a85bc0-5ded-4040-b3ba-929b4bc6d0e0 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:47:24.863861 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d0a85bc0-5ded-4040-b3ba-929b4bc6d0e0 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:47:24.864309 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d0a85bc0-5ded-4040-b3ba-929b4bc6d0e0 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:47:24.865062 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d0a85bc0-5ded-4040-b3ba-929b4bc6d0e0 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:47:24.865491 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d0a85bc0-5ded-4040-b3ba-929b4bc6d0e0 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:47:24.875785 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-ed4f5068-aea4-48f7-b32e-5c4cf6b5101c tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:47:24.876389 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-ed4f5068-aea4-48f7-b32e-5c4cf6b5101c tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: 0eb63a66-7e46-40fb-9087-543fbf9cad4b] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:47:24.882553 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ed4f5068-aea4-48f7-b32e-5c4cf6b5101c tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:47:24.883001 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ed4f5068-aea4-48f7-b32e-5c4cf6b5101c tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:47:24.883754 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ed4f5068-aea4-48f7-b32e-5c4cf6b5101c tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:47:24.884184 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ed4f5068-aea4-48f7-b32e-5c4cf6b5101c tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:47:24.929162 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-d0a85bc0-5ded-4040-b3ba-929b4bc6d0e0 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:47:24.937026 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-d0a85bc0-5ded-4040-b3ba-929b4bc6d0e0 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1368 microversion: 2.1 time: 0.083660 Nov 01 01:47:24.937592 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1321/2550] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:47:24 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:47:25.013404 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-ed4f5068-aea4-48f7-b32e-5c4cf6b5101c tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:47:25.021080 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-ed4f5068-aea4-48f7-b32e-5c4cf6b5101c tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b" status: 200 len: 1559 microversion: 2.1 time: 0.148888 Nov 01 01:47:25.021638 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1230/2551] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:47:24 2021] GET /compute/v2.1/servers/0eb63a66-7e46-40fb-9087-543fbf9cad4b => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:47:25.955145 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-5ad66ff8-c06a-4dc7-b2a5-ca7e64fa81f1 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:47:25.955741 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-5ad66ff8-c06a-4dc7-b2a5-ca7e64fa81f1 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:47:25.961561 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-5ad66ff8-c06a-4dc7-b2a5-ca7e64fa81f1 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:47:25.962004 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-5ad66ff8-c06a-4dc7-b2a5-ca7e64fa81f1 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:47:25.962787 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-5ad66ff8-c06a-4dc7-b2a5-ca7e64fa81f1 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:47:25.963218 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-5ad66ff8-c06a-4dc7-b2a5-ca7e64fa81f1 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:47:26.023776 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-5ad66ff8-c06a-4dc7-b2a5-ca7e64fa81f1 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:47:26.031577 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-5ad66ff8-c06a-4dc7-b2a5-ca7e64fa81f1 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1368 microversion: 2.1 time: 0.080879 Nov 01 01:47:26.032332 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1322/2552] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:47:25 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:47:27.047865 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-83f56a81-a531-491b-902e-6ef4ba6e315c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:47:27.048469 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-83f56a81-a531-491b-902e-6ef4ba6e315c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:47:27.054285 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-83f56a81-a531-491b-902e-6ef4ba6e315c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:47:27.054766 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-83f56a81-a531-491b-902e-6ef4ba6e315c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:47:27.055513 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-83f56a81-a531-491b-902e-6ef4ba6e315c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:47:27.055935 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-83f56a81-a531-491b-902e-6ef4ba6e315c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:47:27.117474 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-83f56a81-a531-491b-902e-6ef4ba6e315c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:47:27.125066 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-83f56a81-a531-491b-902e-6ef4ba6e315c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1368 microversion: 2.1 time: 0.080782 Nov 01 01:47:27.125624 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1231/2553] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:47:27 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:47:28.140691 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-8b3bbfe5-c60b-46b1-9478-595f953f7193 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:47:28.141299 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-8b3bbfe5-c60b-46b1-9478-595f953f7193 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:47:28.147562 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8b3bbfe5-c60b-46b1-9478-595f953f7193 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:47:28.148016 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8b3bbfe5-c60b-46b1-9478-595f953f7193 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:47:28.148768 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8b3bbfe5-c60b-46b1-9478-595f953f7193 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:47:28.149200 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8b3bbfe5-c60b-46b1-9478-595f953f7193 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:47:28.206993 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-8b3bbfe5-c60b-46b1-9478-595f953f7193 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:47:28.214640 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-8b3bbfe5-c60b-46b1-9478-595f953f7193 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1368 microversion: 2.1 time: 0.077555 Nov 01 01:47:28.215203 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1323/2554] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:47:28 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1368 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:47:29.231436 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-0fa6f21e-c597-4a68-a35b-2a5ec6aaf683 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:47:29.232033 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-0fa6f21e-c597-4a68-a35b-2a5ec6aaf683 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:47:29.238247 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0fa6f21e-c597-4a68-a35b-2a5ec6aaf683 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:47:29.238721 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0fa6f21e-c597-4a68-a35b-2a5ec6aaf683 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:47:29.239470 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0fa6f21e-c597-4a68-a35b-2a5ec6aaf683 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:47:29.239895 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0fa6f21e-c597-4a68-a35b-2a5ec6aaf683 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:47:29.301151 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-0fa6f21e-c597-4a68-a35b-2a5ec6aaf683 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:47:29.308912 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-0fa6f21e-c597-4a68-a35b-2a5ec6aaf683 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1368 microversion: 2.1 time: 0.081147 Nov 01 01:47:29.309474 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1232/2555] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:47:29 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:47:30.326506 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-aafa4657-9b34-4618-8996-c0990fac8bf5 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:47:30.327056 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-aafa4657-9b34-4618-8996-c0990fac8bf5 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:47:30.333269 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-aafa4657-9b34-4618-8996-c0990fac8bf5 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:47:30.333737 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-aafa4657-9b34-4618-8996-c0990fac8bf5 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:47:30.334502 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-aafa4657-9b34-4618-8996-c0990fac8bf5 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:47:30.334941 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-aafa4657-9b34-4618-8996-c0990fac8bf5 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:47:30.397936 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-aafa4657-9b34-4618-8996-c0990fac8bf5 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:47:30.405610 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-aafa4657-9b34-4618-8996-c0990fac8bf5 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1368 microversion: 2.1 time: 0.082803 Nov 01 01:47:30.406177 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1324/2556] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:47:30 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:47:31.423120 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-4c3a2c07-2e10-4492-ab20-c22f8e7a3636 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:47:31.423839 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-4c3a2c07-2e10-4492-ab20-c22f8e7a3636 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:47:31.431049 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4c3a2c07-2e10-4492-ab20-c22f8e7a3636 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:47:31.431490 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4c3a2c07-2e10-4492-ab20-c22f8e7a3636 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:47:31.432258 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4c3a2c07-2e10-4492-ab20-c22f8e7a3636 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:47:31.432691 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4c3a2c07-2e10-4492-ab20-c22f8e7a3636 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:47:31.490935 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-4c3a2c07-2e10-4492-ab20-c22f8e7a3636 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:47:31.499072 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-4c3a2c07-2e10-4492-ab20-c22f8e7a3636 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1368 microversion: 2.1 time: 0.079700 Nov 01 01:47:31.499645 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1233/2557] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:47:31 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:47:32.516090 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-1eac8cd1-1221-4f98-940a-05a8d8e3e3b7 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:47:32.516692 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-1eac8cd1-1221-4f98-940a-05a8d8e3e3b7 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:47:32.523188 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-1eac8cd1-1221-4f98-940a-05a8d8e3e3b7 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:47:32.523629 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-1eac8cd1-1221-4f98-940a-05a8d8e3e3b7 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:47:32.524378 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-1eac8cd1-1221-4f98-940a-05a8d8e3e3b7 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:47:32.524800 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-1eac8cd1-1221-4f98-940a-05a8d8e3e3b7 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:47:32.583692 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-1eac8cd1-1221-4f98-940a-05a8d8e3e3b7 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:47:32.591330 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-1eac8cd1-1221-4f98-940a-05a8d8e3e3b7 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1368 microversion: 2.1 time: 0.078966 Nov 01 01:47:32.591894 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1325/2558] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:47:32 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:47:33.608252 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-d04a9506-6694-480c-ba5d-108ca539b9f6 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:47:33.608851 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-d04a9506-6694-480c-ba5d-108ca539b9f6 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:47:33.615145 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d04a9506-6694-480c-ba5d-108ca539b9f6 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:47:33.615585 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d04a9506-6694-480c-ba5d-108ca539b9f6 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:47:33.616384 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d04a9506-6694-480c-ba5d-108ca539b9f6 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:47:33.616763 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d04a9506-6694-480c-ba5d-108ca539b9f6 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:47:33.675039 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-d04a9506-6694-480c-ba5d-108ca539b9f6 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:47:33.682675 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-d04a9506-6694-480c-ba5d-108ca539b9f6 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1368 microversion: 2.1 time: 0.078031 Nov 01 01:47:33.683238 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1234/2559] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:47:33 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1368 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:47:34.699362 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-4f774000-ee11-467e-b200-fe6bfb58b298 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:47:34.699987 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-4f774000-ee11-467e-b200-fe6bfb58b298 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:47:34.706305 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4f774000-ee11-467e-b200-fe6bfb58b298 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:47:34.706781 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4f774000-ee11-467e-b200-fe6bfb58b298 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:47:34.707537 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4f774000-ee11-467e-b200-fe6bfb58b298 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:47:34.707970 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4f774000-ee11-467e-b200-fe6bfb58b298 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:47:34.766184 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-4f774000-ee11-467e-b200-fe6bfb58b298 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:47:34.773993 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-4f774000-ee11-467e-b200-fe6bfb58b298 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1368 microversion: 2.1 time: 0.078297 Nov 01 01:47:34.774589 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1326/2560] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:47:34 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1368 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:47:35.790356 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-e2c64eed-02d6-42d3-9a47-d77502d323c1 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:47:35.790986 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-e2c64eed-02d6-42d3-9a47-d77502d323c1 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:47:35.797328 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e2c64eed-02d6-42d3-9a47-d77502d323c1 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:47:35.797772 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e2c64eed-02d6-42d3-9a47-d77502d323c1 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:47:35.798545 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e2c64eed-02d6-42d3-9a47-d77502d323c1 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:47:35.798971 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e2c64eed-02d6-42d3-9a47-d77502d323c1 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:47:35.859871 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-e2c64eed-02d6-42d3-9a47-d77502d323c1 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:47:35.867485 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-e2c64eed-02d6-42d3-9a47-d77502d323c1 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1368 microversion: 2.1 time: 0.080741 Nov 01 01:47:35.868047 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1235/2561] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:47:35 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:47:36.884859 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-2fcd8dc5-8766-4b9d-a563-8eff619292d8 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:47:36.885468 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-2fcd8dc5-8766-4b9d-a563-8eff619292d8 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:47:36.891747 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-2fcd8dc5-8766-4b9d-a563-8eff619292d8 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:47:36.892190 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-2fcd8dc5-8766-4b9d-a563-8eff619292d8 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:47:36.893445 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-2fcd8dc5-8766-4b9d-a563-8eff619292d8 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:47:36.893873 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-2fcd8dc5-8766-4b9d-a563-8eff619292d8 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:47:36.951697 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-2fcd8dc5-8766-4b9d-a563-8eff619292d8 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:47:36.959761 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-2fcd8dc5-8766-4b9d-a563-8eff619292d8 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1368 microversion: 2.1 time: 0.079332 Nov 01 01:47:36.960317 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1327/2562] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:47:36 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:47:37.976627 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-cef85556-2d4e-4b85-bf76-7469af6cd300 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:47:37.977234 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-cef85556-2d4e-4b85-bf76-7469af6cd300 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:47:37.983479 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-cef85556-2d4e-4b85-bf76-7469af6cd300 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:47:37.983927 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-cef85556-2d4e-4b85-bf76-7469af6cd300 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:47:37.984684 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-cef85556-2d4e-4b85-bf76-7469af6cd300 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:47:37.985114 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-cef85556-2d4e-4b85-bf76-7469af6cd300 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:47:38.042991 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-cef85556-2d4e-4b85-bf76-7469af6cd300 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:47:38.051293 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-cef85556-2d4e-4b85-bf76-7469af6cd300 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1368 microversion: 2.1 time: 0.078303 Nov 01 01:47:38.051853 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1236/2563] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:47:37 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1368 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:47:39.068752 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-98f40287-7bca-4e27-9af6-bfe8a24c00b2 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:47:39.069303 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-98f40287-7bca-4e27-9af6-bfe8a24c00b2 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:47:39.075622 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-98f40287-7bca-4e27-9af6-bfe8a24c00b2 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:47:39.076076 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-98f40287-7bca-4e27-9af6-bfe8a24c00b2 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:47:39.077131 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-98f40287-7bca-4e27-9af6-bfe8a24c00b2 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:47:39.077252 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-98f40287-7bca-4e27-9af6-bfe8a24c00b2 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:47:39.136058 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-98f40287-7bca-4e27-9af6-bfe8a24c00b2 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:47:39.144087 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-98f40287-7bca-4e27-9af6-bfe8a24c00b2 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1368 microversion: 2.1 time: 0.079978 Nov 01 01:47:39.144681 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1328/2564] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:47:39 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:47:40.161099 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-1fadb57f-9840-4f89-9c60-5e76e3958af1 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:47:40.161692 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-1fadb57f-9840-4f89-9c60-5e76e3958af1 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:47:40.168001 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1fadb57f-9840-4f89-9c60-5e76e3958af1 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:47:40.168442 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1fadb57f-9840-4f89-9c60-5e76e3958af1 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:47:40.169194 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1fadb57f-9840-4f89-9c60-5e76e3958af1 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:47:40.169619 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1fadb57f-9840-4f89-9c60-5e76e3958af1 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:47:40.229432 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-1fadb57f-9840-4f89-9c60-5e76e3958af1 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:47:40.237747 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-1fadb57f-9840-4f89-9c60-5e76e3958af1 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1368 microversion: 2.1 time: 0.080168 Nov 01 01:47:40.238315 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1237/2565] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:47:40 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:47:41.254227 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-f5d4d588-4574-4ce2-9411-bac0297e565e tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:47:41.254858 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-f5d4d588-4574-4ce2-9411-bac0297e565e tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:47:41.261048 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f5d4d588-4574-4ce2-9411-bac0297e565e tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:47:41.261481 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f5d4d588-4574-4ce2-9411-bac0297e565e tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:47:41.262225 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f5d4d588-4574-4ce2-9411-bac0297e565e tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:47:41.262676 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f5d4d588-4574-4ce2-9411-bac0297e565e tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:47:41.320717 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-f5d4d588-4574-4ce2-9411-bac0297e565e tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:47:41.328293 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-f5d4d588-4574-4ce2-9411-bac0297e565e tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1368 microversion: 2.1 time: 0.077709 Nov 01 01:47:41.328840 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1329/2566] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:47:41 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1368 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:47:42.344711 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-24f9183d-c110-4760-a591-bc0e38e4ba6c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:47:42.345311 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-24f9183d-c110-4760-a591-bc0e38e4ba6c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:47:42.351590 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-24f9183d-c110-4760-a591-bc0e38e4ba6c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:47:42.352034 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-24f9183d-c110-4760-a591-bc0e38e4ba6c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:47:42.352793 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-24f9183d-c110-4760-a591-bc0e38e4ba6c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:47:42.353220 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-24f9183d-c110-4760-a591-bc0e38e4ba6c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:47:42.414122 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-24f9183d-c110-4760-a591-bc0e38e4ba6c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:47:42.422002 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-24f9183d-c110-4760-a591-bc0e38e4ba6c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1368 microversion: 2.1 time: 0.080947 Nov 01 01:47:42.422587 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1238/2567] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:47:42 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:47:43.438590 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-aceefe5d-acf5-45e2-bf75-029d367fdeb4 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:47:43.439189 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-aceefe5d-acf5-45e2-bf75-029d367fdeb4 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:47:43.445764 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-aceefe5d-acf5-45e2-bf75-029d367fdeb4 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:47:43.446200 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-aceefe5d-acf5-45e2-bf75-029d367fdeb4 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:47:43.446994 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-aceefe5d-acf5-45e2-bf75-029d367fdeb4 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:47:43.447417 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-aceefe5d-acf5-45e2-bf75-029d367fdeb4 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:47:43.506321 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-aceefe5d-acf5-45e2-bf75-029d367fdeb4 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:47:43.513903 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-aceefe5d-acf5-45e2-bf75-029d367fdeb4 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1368 microversion: 2.1 time: 0.078967 Nov 01 01:47:43.514476 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1330/2568] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:47:43 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:47:44.530893 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-6f6303ae-a893-4849-a2e1-78ddee2b7452 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:47:44.531521 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-6f6303ae-a893-4849-a2e1-78ddee2b7452 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:47:44.538351 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6f6303ae-a893-4849-a2e1-78ddee2b7452 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:47:44.538823 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6f6303ae-a893-4849-a2e1-78ddee2b7452 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:47:44.539581 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6f6303ae-a893-4849-a2e1-78ddee2b7452 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:47:44.540010 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6f6303ae-a893-4849-a2e1-78ddee2b7452 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:47:44.597851 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-6f6303ae-a893-4849-a2e1-78ddee2b7452 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:47:44.609315 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-6f6303ae-a893-4849-a2e1-78ddee2b7452 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1368 microversion: 2.1 time: 0.082085 Nov 01 01:47:44.609881 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1239/2569] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:47:44 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:47:45.625779 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-0a0af50d-d695-4cd6-a60c-e2dc20a4b7c3 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:47:45.626327 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-0a0af50d-d695-4cd6-a60c-e2dc20a4b7c3 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:47:45.633106 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0a0af50d-d695-4cd6-a60c-e2dc20a4b7c3 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:47:45.633551 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0a0af50d-d695-4cd6-a60c-e2dc20a4b7c3 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:47:45.634303 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0a0af50d-d695-4cd6-a60c-e2dc20a4b7c3 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:47:45.634771 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0a0af50d-d695-4cd6-a60c-e2dc20a4b7c3 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:47:45.693340 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-0a0af50d-d695-4cd6-a60c-e2dc20a4b7c3 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:47:45.701052 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-0a0af50d-d695-4cd6-a60c-e2dc20a4b7c3 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1368 microversion: 2.1 time: 0.079115 Nov 01 01:47:45.701617 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1331/2570] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:47:45 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:47:46.717222 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-c270d585-39dc-406f-8e44-3195efcfbdf0 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:47:46.717821 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-c270d585-39dc-406f-8e44-3195efcfbdf0 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:47:46.724437 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c270d585-39dc-406f-8e44-3195efcfbdf0 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:47:46.724877 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c270d585-39dc-406f-8e44-3195efcfbdf0 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:47:46.725625 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c270d585-39dc-406f-8e44-3195efcfbdf0 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:47:46.726050 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c270d585-39dc-406f-8e44-3195efcfbdf0 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:47:46.783347 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-c270d585-39dc-406f-8e44-3195efcfbdf0 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:47:46.791444 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-c270d585-39dc-406f-8e44-3195efcfbdf0 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1368 microversion: 2.1 time: 0.077901 Nov 01 01:47:46.791998 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1240/2571] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:47:46 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1368 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:47:47.807215 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-44956fa6-98df-47d6-ae73-34c9de811798 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:47:47.807818 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-44956fa6-98df-47d6-ae73-34c9de811798 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:47:47.814058 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-44956fa6-98df-47d6-ae73-34c9de811798 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:47:47.814528 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-44956fa6-98df-47d6-ae73-34c9de811798 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:47:47.815283 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-44956fa6-98df-47d6-ae73-34c9de811798 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:47:47.815717 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-44956fa6-98df-47d6-ae73-34c9de811798 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:47:47.874034 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-44956fa6-98df-47d6-ae73-34c9de811798 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:47:47.881704 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-44956fa6-98df-47d6-ae73-34c9de811798 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1368 microversion: 2.1 time: 0.078234 Nov 01 01:47:47.882274 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1332/2572] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:47:47 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1368 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:47:48.898119 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-1d3e693a-7c3d-4977-b4fd-66aa3863bbd4 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:47:48.898745 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-1d3e693a-7c3d-4977-b4fd-66aa3863bbd4 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:47:48.905179 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1d3e693a-7c3d-4977-b4fd-66aa3863bbd4 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:47:48.905615 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1d3e693a-7c3d-4977-b4fd-66aa3863bbd4 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:47:48.906700 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1d3e693a-7c3d-4977-b4fd-66aa3863bbd4 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:47:48.907134 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1d3e693a-7c3d-4977-b4fd-66aa3863bbd4 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:47:48.968486 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-1d3e693a-7c3d-4977-b4fd-66aa3863bbd4 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:47:48.976265 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-1d3e693a-7c3d-4977-b4fd-66aa3863bbd4 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1368 microversion: 2.1 time: 0.081752 Nov 01 01:47:48.976760 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1241/2573] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:47:48 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:47:49.992606 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-fb2915fd-01b6-423b-ae1f-e29bc5f52ee1 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:47:49.993215 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-fb2915fd-01b6-423b-ae1f-e29bc5f52ee1 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:47:49.999463 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-fb2915fd-01b6-423b-ae1f-e29bc5f52ee1 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:47:49.999915 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-fb2915fd-01b6-423b-ae1f-e29bc5f52ee1 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:47:50.000670 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-fb2915fd-01b6-423b-ae1f-e29bc5f52ee1 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:47:50.001104 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-fb2915fd-01b6-423b-ae1f-e29bc5f52ee1 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:47:50.059392 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-fb2915fd-01b6-423b-ae1f-e29bc5f52ee1 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:47:50.067900 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-fb2915fd-01b6-423b-ae1f-e29bc5f52ee1 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1368 microversion: 2.1 time: 0.078949 Nov 01 01:47:50.068464 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1333/2574] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:47:49 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:47:51.085014 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-3785e5d1-0383-4712-814a-40bc6e2a1b77 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:47:51.085576 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-3785e5d1-0383-4712-814a-40bc6e2a1b77 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:47:51.091752 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3785e5d1-0383-4712-814a-40bc6e2a1b77 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:47:51.092202 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3785e5d1-0383-4712-814a-40bc6e2a1b77 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:47:51.092963 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3785e5d1-0383-4712-814a-40bc6e2a1b77 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:47:51.093395 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3785e5d1-0383-4712-814a-40bc6e2a1b77 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:47:51.151369 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-3785e5d1-0383-4712-814a-40bc6e2a1b77 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:47:51.158979 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-3785e5d1-0383-4712-814a-40bc6e2a1b77 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1368 microversion: 2.1 time: 0.078316 Nov 01 01:47:51.159541 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1242/2575] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:47:51 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1368 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:47:52.176676 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-d114c43c-e677-43a9-9ec9-779990ee0d33 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:47:52.177894 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-d114c43c-e677-43a9-9ec9-779990ee0d33 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:47:52.184126 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d114c43c-e677-43a9-9ec9-779990ee0d33 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:47:52.184563 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d114c43c-e677-43a9-9ec9-779990ee0d33 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:47:52.185303 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d114c43c-e677-43a9-9ec9-779990ee0d33 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:47:52.185728 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d114c43c-e677-43a9-9ec9-779990ee0d33 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:47:52.245691 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-d114c43c-e677-43a9-9ec9-779990ee0d33 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:47:52.253410 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-d114c43c-e677-43a9-9ec9-779990ee0d33 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1368 microversion: 2.1 time: 0.080370 Nov 01 01:47:52.253970 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1334/2576] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:47:52 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:47:53.269699 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-ca6cb584-1c69-4ace-8b02-b90b38eafba3 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:47:53.270292 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-ca6cb584-1c69-4ace-8b02-b90b38eafba3 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:47:53.276581 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ca6cb584-1c69-4ace-8b02-b90b38eafba3 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:47:53.277018 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ca6cb584-1c69-4ace-8b02-b90b38eafba3 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:47:53.277766 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ca6cb584-1c69-4ace-8b02-b90b38eafba3 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:47:53.278194 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ca6cb584-1c69-4ace-8b02-b90b38eafba3 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:47:53.336276 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-ca6cb584-1c69-4ace-8b02-b90b38eafba3 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:47:53.343954 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-ca6cb584-1c69-4ace-8b02-b90b38eafba3 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1368 microversion: 2.1 time: 0.077881 Nov 01 01:47:53.344509 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1243/2577] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:47:53 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1368 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:47:54.360530 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-34ce3c5a-e14a-4a84-a89e-d64b6af36da0 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:47:54.361154 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-34ce3c5a-e14a-4a84-a89e-d64b6af36da0 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:47:54.367475 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-34ce3c5a-e14a-4a84-a89e-d64b6af36da0 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:47:54.367923 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-34ce3c5a-e14a-4a84-a89e-d64b6af36da0 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:47:54.368685 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-34ce3c5a-e14a-4a84-a89e-d64b6af36da0 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:47:54.369117 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-34ce3c5a-e14a-4a84-a89e-d64b6af36da0 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:47:54.427211 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-34ce3c5a-e14a-4a84-a89e-d64b6af36da0 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:47:54.434823 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-34ce3c5a-e14a-4a84-a89e-d64b6af36da0 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1368 microversion: 2.1 time: 0.078056 Nov 01 01:47:54.435387 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1335/2578] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:47:54 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1368 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:47:55.451814 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-9e47fb38-d0ca-4de0-856d-fbf8133508a6 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:47:55.452426 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-9e47fb38-d0ca-4de0-856d-fbf8133508a6 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:47:55.459178 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9e47fb38-d0ca-4de0-856d-fbf8133508a6 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:47:55.459626 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9e47fb38-d0ca-4de0-856d-fbf8133508a6 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:47:55.460390 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9e47fb38-d0ca-4de0-856d-fbf8133508a6 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:47:55.460818 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9e47fb38-d0ca-4de0-856d-fbf8133508a6 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:47:55.522970 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-9e47fb38-d0ca-4de0-856d-fbf8133508a6 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:47:55.530651 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-9e47fb38-d0ca-4de0-856d-fbf8133508a6 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1368 microversion: 2.1 time: 0.082499 Nov 01 01:47:55.531215 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1244/2579] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:47:55 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:47:56.547632 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-82058f59-4476-44bd-9e6a-bfd781a35ea3 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:47:56.548318 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-82058f59-4476-44bd-9e6a-bfd781a35ea3 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:47:56.554883 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-82058f59-4476-44bd-9e6a-bfd781a35ea3 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:47:56.555322 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-82058f59-4476-44bd-9e6a-bfd781a35ea3 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:47:56.556064 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-82058f59-4476-44bd-9e6a-bfd781a35ea3 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:47:56.556486 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-82058f59-4476-44bd-9e6a-bfd781a35ea3 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:47:56.613993 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-82058f59-4476-44bd-9e6a-bfd781a35ea3 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:47:56.622322 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-82058f59-4476-44bd-9e6a-bfd781a35ea3 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1368 microversion: 2.1 time: 0.078341 Nov 01 01:47:56.622862 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1336/2580] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:47:56 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:47:57.638369 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-52cb5272-a30c-4a6f-b432-4cb1c903f488 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:47:57.638932 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-52cb5272-a30c-4a6f-b432-4cb1c903f488 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:47:57.644854 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-52cb5272-a30c-4a6f-b432-4cb1c903f488 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:47:57.645295 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-52cb5272-a30c-4a6f-b432-4cb1c903f488 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:47:57.646584 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-52cb5272-a30c-4a6f-b432-4cb1c903f488 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:47:57.647010 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-52cb5272-a30c-4a6f-b432-4cb1c903f488 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:47:57.704484 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-52cb5272-a30c-4a6f-b432-4cb1c903f488 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:47:57.712600 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-52cb5272-a30c-4a6f-b432-4cb1c903f488 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1368 microversion: 2.1 time: 0.077943 Nov 01 01:47:57.713155 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1245/2581] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:47:57 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1368 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:47:58.272766 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 01 01:47:58.273007 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: Mon Nov 1 01:47:58 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 01 01:47:58.729134 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-228efc83-094a-4c7f-95c6-126ccbafe52d tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:47:58.729743 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-228efc83-094a-4c7f-95c6-126ccbafe52d tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:47:58.736017 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-228efc83-094a-4c7f-95c6-126ccbafe52d tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:47:58.736465 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-228efc83-094a-4c7f-95c6-126ccbafe52d tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:47:58.737221 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-228efc83-094a-4c7f-95c6-126ccbafe52d tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:47:58.737649 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-228efc83-094a-4c7f-95c6-126ccbafe52d tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:47:58.798036 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-228efc83-094a-4c7f-95c6-126ccbafe52d tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:47:58.806301 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-228efc83-094a-4c7f-95c6-126ccbafe52d tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1368 microversion: 2.1 time: 0.080858 Nov 01 01:47:58.806880 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1337/2582] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:47:58 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:47:59.822389 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-28b72b98-5669-4703-8acc-ff917d28be63 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:47:59.823049 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-28b72b98-5669-4703-8acc-ff917d28be63 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:47:59.829327 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-28b72b98-5669-4703-8acc-ff917d28be63 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:47:59.829762 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-28b72b98-5669-4703-8acc-ff917d28be63 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:47:59.830533 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-28b72b98-5669-4703-8acc-ff917d28be63 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:47:59.830958 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-28b72b98-5669-4703-8acc-ff917d28be63 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:47:59.889294 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-28b72b98-5669-4703-8acc-ff917d28be63 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:47:59.897336 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-28b72b98-5669-4703-8acc-ff917d28be63 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1368 microversion: 2.1 time: 0.078580 Nov 01 01:47:59.897888 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1246/2583] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:47:59 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:48:00.913799 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-713224e6-31db-4003-902a-84aa9bffd19a tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:48:00.914392 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-713224e6-31db-4003-902a-84aa9bffd19a tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:48:00.921321 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-713224e6-31db-4003-902a-84aa9bffd19a tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:48:00.921761 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-713224e6-31db-4003-902a-84aa9bffd19a tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:48:00.922618 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-713224e6-31db-4003-902a-84aa9bffd19a tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:48:00.923050 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-713224e6-31db-4003-902a-84aa9bffd19a tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:48:00.982831 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-713224e6-31db-4003-902a-84aa9bffd19a tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:48:00.990979 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-713224e6-31db-4003-902a-84aa9bffd19a tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1368 microversion: 2.1 time: 0.081660 Nov 01 01:48:00.991528 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1338/2584] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:48:00 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:48:02.008022 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-11c6caec-178a-410a-a2d1-18e4f1b2246a tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:48:02.008556 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-11c6caec-178a-410a-a2d1-18e4f1b2246a tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:48:02.014973 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-11c6caec-178a-410a-a2d1-18e4f1b2246a tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:48:02.015426 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-11c6caec-178a-410a-a2d1-18e4f1b2246a tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:48:02.016191 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-11c6caec-178a-410a-a2d1-18e4f1b2246a tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:48:02.016625 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-11c6caec-178a-410a-a2d1-18e4f1b2246a tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:48:02.078496 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-11c6caec-178a-410a-a2d1-18e4f1b2246a tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:48:02.086808 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-11c6caec-178a-410a-a2d1-18e4f1b2246a tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1368 microversion: 2.1 time: 0.082966 Nov 01 01:48:02.087371 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1247/2585] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:48:02 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:48:03.103317 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-fb4d2fdf-00ef-45ef-b33f-925129a230c4 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:48:03.103878 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-fb4d2fdf-00ef-45ef-b33f-925129a230c4 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:48:03.110045 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-fb4d2fdf-00ef-45ef-b33f-925129a230c4 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:48:03.110517 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-fb4d2fdf-00ef-45ef-b33f-925129a230c4 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:48:03.111274 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-fb4d2fdf-00ef-45ef-b33f-925129a230c4 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:48:03.111699 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-fb4d2fdf-00ef-45ef-b33f-925129a230c4 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:48:03.170018 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-fb4d2fdf-00ef-45ef-b33f-925129a230c4 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:48:03.178284 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-fb4d2fdf-00ef-45ef-b33f-925129a230c4 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1368 microversion: 2.1 time: 0.078674 Nov 01 01:48:03.178843 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1339/2586] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:48:03 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:48:04.195442 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-e762271d-51db-446f-8f03-9576eebf976a tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:48:04.195998 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-e762271d-51db-446f-8f03-9576eebf976a tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:48:04.202331 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e762271d-51db-446f-8f03-9576eebf976a tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:48:04.202808 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e762271d-51db-446f-8f03-9576eebf976a tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:48:04.203604 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e762271d-51db-446f-8f03-9576eebf976a tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:48:04.204034 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e762271d-51db-446f-8f03-9576eebf976a tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:48:04.262005 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-e762271d-51db-446f-8f03-9576eebf976a tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:48:04.269595 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-e762271d-51db-446f-8f03-9576eebf976a tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1368 microversion: 2.1 time: 0.078392 Nov 01 01:48:04.270155 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1248/2587] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:48:04 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:48:05.207979 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 01 01:48:05.208718 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: Mon Nov 1 01:48:05 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 01 01:48:05.287212 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-bb96bf1d-e9bf-46dd-bad7-b81ee980644f tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:48:05.292161 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-bb96bf1d-e9bf-46dd-bad7-b81ee980644f tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:48:05.293890 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-bb96bf1d-e9bf-46dd-bad7-b81ee980644f tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:48:05.294325 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-bb96bf1d-e9bf-46dd-bad7-b81ee980644f tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:48:05.295099 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-bb96bf1d-e9bf-46dd-bad7-b81ee980644f tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:48:05.295519 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-bb96bf1d-e9bf-46dd-bad7-b81ee980644f tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:48:05.355170 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-bb96bf1d-e9bf-46dd-bad7-b81ee980644f tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:48:05.363045 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-bb96bf1d-e9bf-46dd-bad7-b81ee980644f tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1368 microversion: 2.1 time: 0.079966 Nov 01 01:48:05.363605 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1340/2588] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:48:05 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:48:06.380167 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-51a679bf-667f-45bf-9ead-77d32222b7da tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:48:06.380767 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-51a679bf-667f-45bf-9ead-77d32222b7da tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:48:06.387141 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-51a679bf-667f-45bf-9ead-77d32222b7da tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:48:06.387582 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-51a679bf-667f-45bf-9ead-77d32222b7da tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:48:06.388337 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-51a679bf-667f-45bf-9ead-77d32222b7da tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:48:06.388762 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-51a679bf-667f-45bf-9ead-77d32222b7da tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:48:06.447157 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-51a679bf-667f-45bf-9ead-77d32222b7da tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:48:06.454919 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-51a679bf-667f-45bf-9ead-77d32222b7da tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1368 microversion: 2.1 time: 0.078449 Nov 01 01:48:06.455473 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1249/2589] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:48:06 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:48:07.472010 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-ef6d1236-f82e-4af3-a811-bfab9267c8c4 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:48:07.472616 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-ef6d1236-f82e-4af3-a811-bfab9267c8c4 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:48:07.479382 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ef6d1236-f82e-4af3-a811-bfab9267c8c4 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:48:07.479825 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ef6d1236-f82e-4af3-a811-bfab9267c8c4 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:48:07.480575 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ef6d1236-f82e-4af3-a811-bfab9267c8c4 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:48:07.481002 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ef6d1236-f82e-4af3-a811-bfab9267c8c4 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:48:07.538829 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-ef6d1236-f82e-4af3-a811-bfab9267c8c4 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:48:07.546575 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-ef6d1236-f82e-4af3-a811-bfab9267c8c4 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1368 microversion: 2.1 time: 0.078105 Nov 01 01:48:07.547038 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1341/2590] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:48:07 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1368 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:48:08.563554 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-5601e4c0-33fb-4a95-b92c-daed36e66103 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:48:08.564177 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-5601e4c0-33fb-4a95-b92c-daed36e66103 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:48:08.571469 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5601e4c0-33fb-4a95-b92c-daed36e66103 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:48:08.571916 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5601e4c0-33fb-4a95-b92c-daed36e66103 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:48:08.572676 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5601e4c0-33fb-4a95-b92c-daed36e66103 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:48:08.573107 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5601e4c0-33fb-4a95-b92c-daed36e66103 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:48:08.634507 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-5601e4c0-33fb-4a95-b92c-daed36e66103 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:48:08.642263 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-5601e4c0-33fb-4a95-b92c-daed36e66103 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1368 microversion: 2.1 time: 0.082498 Nov 01 01:48:08.642867 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1250/2591] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:48:08 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:48:09.658871 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-95e6a5ff-a2c9-4ae0-81ed-c946a72e1c93 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:48:09.659400 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-95e6a5ff-a2c9-4ae0-81ed-c946a72e1c93 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:48:09.666157 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-95e6a5ff-a2c9-4ae0-81ed-c946a72e1c93 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:48:09.666660 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-95e6a5ff-a2c9-4ae0-81ed-c946a72e1c93 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:48:09.667418 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-95e6a5ff-a2c9-4ae0-81ed-c946a72e1c93 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:48:09.667847 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-95e6a5ff-a2c9-4ae0-81ed-c946a72e1c93 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:48:09.726780 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-95e6a5ff-a2c9-4ae0-81ed-c946a72e1c93 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:48:09.736899 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-95e6a5ff-a2c9-4ae0-81ed-c946a72e1c93 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1368 microversion: 2.1 time: 0.081684 Nov 01 01:48:09.737468 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1342/2592] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:48:09 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:48:10.754628 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-653a3ede-d5c6-4b52-b69f-42a7828e795f tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:48:10.755289 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-653a3ede-d5c6-4b52-b69f-42a7828e795f tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:48:10.762113 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-653a3ede-d5c6-4b52-b69f-42a7828e795f tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:48:10.762605 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-653a3ede-d5c6-4b52-b69f-42a7828e795f tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:48:10.763365 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-653a3ede-d5c6-4b52-b69f-42a7828e795f tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:48:10.763793 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-653a3ede-d5c6-4b52-b69f-42a7828e795f tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:48:10.824546 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-653a3ede-d5c6-4b52-b69f-42a7828e795f tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:48:10.832186 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-653a3ede-d5c6-4b52-b69f-42a7828e795f tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1368 microversion: 2.1 time: 0.081232 Nov 01 01:48:10.832745 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1251/2593] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:48:10 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:48:11.848430 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-d0074c3f-212e-412e-a98e-46bf952ed407 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:48:11.849044 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-d0074c3f-212e-412e-a98e-46bf952ed407 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:48:11.856082 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d0074c3f-212e-412e-a98e-46bf952ed407 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:48:11.856527 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d0074c3f-212e-412e-a98e-46bf952ed407 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:48:11.857282 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d0074c3f-212e-412e-a98e-46bf952ed407 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:48:11.857709 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d0074c3f-212e-412e-a98e-46bf952ed407 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:48:11.915597 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-d0074c3f-212e-412e-a98e-46bf952ed407 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:48:11.923248 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-d0074c3f-212e-412e-a98e-46bf952ed407 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1368 microversion: 2.1 time: 0.078474 Nov 01 01:48:11.923804 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1343/2594] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:48:11 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:48:12.939621 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-8754b9c8-f1b6-487c-b265-2521f0044951 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:48:12.940478 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-8754b9c8-f1b6-487c-b265-2521f0044951 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:48:12.946689 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8754b9c8-f1b6-487c-b265-2521f0044951 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:48:12.947130 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8754b9c8-f1b6-487c-b265-2521f0044951 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:48:12.947928 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8754b9c8-f1b6-487c-b265-2521f0044951 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:48:12.948352 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8754b9c8-f1b6-487c-b265-2521f0044951 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:48:13.007065 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-8754b9c8-f1b6-487c-b265-2521f0044951 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:48:13.014816 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-8754b9c8-f1b6-487c-b265-2521f0044951 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1368 microversion: 2.1 time: 0.078875 Nov 01 01:48:13.015374 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1252/2595] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:48:12 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:48:14.031670 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-e45f0a4a-a78f-4c7e-b606-0fa3684bc463 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:48:14.032263 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-e45f0a4a-a78f-4c7e-b606-0fa3684bc463 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:48:14.038962 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e45f0a4a-a78f-4c7e-b606-0fa3684bc463 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:48:14.039405 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e45f0a4a-a78f-4c7e-b606-0fa3684bc463 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:48:14.040156 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e45f0a4a-a78f-4c7e-b606-0fa3684bc463 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:48:14.040581 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e45f0a4a-a78f-4c7e-b606-0fa3684bc463 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:48:14.100403 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-e45f0a4a-a78f-4c7e-b606-0fa3684bc463 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:48:14.108276 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-e45f0a4a-a78f-4c7e-b606-0fa3684bc463 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1368 microversion: 2.1 time: 0.080279 Nov 01 01:48:14.108862 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1344/2596] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:48:14 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:48:15.124493 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-b04ddfaa-524d-475a-bcb3-76381ff4e828 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:48:15.125050 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-b04ddfaa-524d-475a-bcb3-76381ff4e828 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:48:15.131314 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b04ddfaa-524d-475a-bcb3-76381ff4e828 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:48:15.131794 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b04ddfaa-524d-475a-bcb3-76381ff4e828 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:48:15.132564 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b04ddfaa-524d-475a-bcb3-76381ff4e828 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:48:15.133000 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b04ddfaa-524d-475a-bcb3-76381ff4e828 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:48:15.194646 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-b04ddfaa-524d-475a-bcb3-76381ff4e828 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:48:15.202296 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-b04ddfaa-524d-475a-bcb3-76381ff4e828 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1368 microversion: 2.1 time: 0.081589 Nov 01 01:48:15.202882 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1253/2597] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:48:15 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:48:16.218753 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-fbb14c69-92cd-4fe2-8875-d8f500b57e98 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:48:16.219348 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-fbb14c69-92cd-4fe2-8875-d8f500b57e98 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:48:16.225625 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-fbb14c69-92cd-4fe2-8875-d8f500b57e98 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:48:16.226062 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-fbb14c69-92cd-4fe2-8875-d8f500b57e98 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:48:16.226843 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-fbb14c69-92cd-4fe2-8875-d8f500b57e98 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:48:16.227267 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-fbb14c69-92cd-4fe2-8875-d8f500b57e98 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:48:16.287986 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-fbb14c69-92cd-4fe2-8875-d8f500b57e98 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:48:16.295763 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-fbb14c69-92cd-4fe2-8875-d8f500b57e98 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 200 len: 1368 microversion: 2.1 time: 0.080648 Nov 01 01:48:16.296329 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1345/2598] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:48:16 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:48:16.313020 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-8cf02d56-66e9-4cd0-92ae-4ca3cee9f6c2 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '.version_select at 0x7fccf6aa3040>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:48:16.404408 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-8cf02d56-66e9-4cd0-92ae-4ca3cee9f6c2 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1207935818" status: 202 len: 0 microversion: 2.1 time: 0.095197 Nov 01 01:48:16.404990 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1254/2599] 10.222.0.47 () {58 vars in 1220 bytes} [Mon Nov 1 01:48:16 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1207935818 => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 01 01:48:17.297690 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-c1ea81bf-7fa9-40da-ac2d-e6491a4f4671 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Action: 'create', calling method: .version_select at 0x7fccf6402310>, body: {"keypair": {"name": "tempest-keypair-594478628"}} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:48:17.316156 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.quota [None req-c1ea81bf-7fa9-40da-ac2d-e6491a4f4671 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Getting quotas for project c7a8cb991f4a4056af85fd3f9a387727. Resources: {'key_pairs'} {{(pid=116267) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 01 01:48:17.320919 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.quota [None req-c1ea81bf-7fa9-40da-ac2d-e6491a4f4671 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Getting quotas for user 246b28121cd749e68ba1686e16dad852 and project c7a8cb991f4a4056af85fd3f9a387727. Resources: {'key_pairs'} {{(pid=116267) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 01 01:48:17.599325 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.quota [None req-c1ea81bf-7fa9-40da-ac2d-e6491a4f4671 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Getting quotas for project c7a8cb991f4a4056af85fd3f9a387727. Resources: {'key_pairs'} {{(pid=116267) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 01 01:48:17.602865 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.quota [None req-c1ea81bf-7fa9-40da-ac2d-e6491a4f4671 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Getting quotas for user 246b28121cd749e68ba1686e16dad852 and project c7a8cb991f4a4056af85fd3f9a387727. Resources: {'key_pairs'} {{(pid=116267) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 01 01:48:17.616070 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-c1ea81bf-7fa9-40da-ac2d-e6491a4f4671 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 2300 microversion: 2.1 time: 0.322123 Nov 01 01:48:17.616664 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1346/2600] 10.222.0.47 () {60 vars in 1157 bytes} [Mon Nov 1 01:48:17 2021] POST /compute/v2.1/os-keypairs => generated 2300 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:48:19.774113 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-439a5a8c-3823-461e-b7a4-40feab08790c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1049742261", "imageRef": "b9068d8d-b02d-4043-9f0c-3d774cb372b3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "25e736ba-2e30-403f-83bd-a2deea011882"}], "security_groups": [{"name": "tempest-securitygroup--1793162944"}], "key_name": "tempest-keypair-594478628", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:48:19.864726 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.network.neutron [None req-439a5a8c-3823-461e-b7a4-40feab08790c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] validate_networks() for [('25e736ba-2e30-403f-83bd-a2deea011882', None, None, None, None, None)] {{(pid=116266) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Nov 01 01:48:20.274210 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.virt.hardware [None req-439a5a8c-3823-461e-b7a4-40feab08790c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Flavor limits 0:0:0 {{(pid=116266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 01 01:48:20.274672 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.virt.hardware [None req-439a5a8c-3823-461e-b7a4-40feab08790c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Image limits 0:0:0 {{(pid=116266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 01 01:48:20.275141 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.virt.hardware [None req-439a5a8c-3823-461e-b7a4-40feab08790c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Flavor pref 0:0:0 {{(pid=116266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 01 01:48:20.275542 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.virt.hardware [None req-439a5a8c-3823-461e-b7a4-40feab08790c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Image pref 0:0:0 {{(pid=116266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 01 01:48:20.275945 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.virt.hardware [None req-439a5a8c-3823-461e-b7a4-40feab08790c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 01 01:48:20.284294 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-439a5a8c-3823-461e-b7a4-40feab08790c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:48:20.284732 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-439a5a8c-3823-461e-b7a4-40feab08790c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:48:20.285516 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-439a5a8c-3823-461e-b7a4-40feab08790c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:48:20.285942 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-439a5a8c-3823-461e-b7a4-40feab08790c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:48:20.301346 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.quota [None req-439a5a8c-3823-461e-b7a4-40feab08790c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Getting quotas for project c7a8cb991f4a4056af85fd3f9a387727. Resources: {'instances', 'cores', 'ram'} {{(pid=116266) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 01 01:48:20.305153 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.quota [None req-439a5a8c-3823-461e-b7a4-40feab08790c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Getting quotas for user 246b28121cd749e68ba1686e16dad852 and project c7a8cb991f4a4056af85fd3f9a387727. Resources: {'instances', 'cores', 'ram'} {{(pid=116266) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 01 01:48:20.315782 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-439a5a8c-3823-461e-b7a4-40feab08790c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Going to run 1 instances... {{(pid=116266) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 01 01:48:20.318542 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-439a5a8c-3823-461e-b7a4-40feab08790c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b9068d8d-b02d-4043-9f0c-3d774cb372b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116266) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 01 01:48:20.477408 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-439a5a8c-3823-461e-b7a4-40feab08790c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.708190 Nov 01 01:48:20.477959 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1255/2601] 10.222.0.47 () {60 vars in 1146 bytes} [Mon Nov 1 01:48:19 2021] POST /compute/v2.1/servers => generated 402 bytes in 709 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 01 01:48:20.487920 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-211be19c-2cc0-40c5-92be-79a719231ab5 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:48:20.488523 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-211be19c-2cc0-40c5-92be-79a719231ab5 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:48:20.543925 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-211be19c-2cc0-40c5-92be-79a719231ab5 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:48:20.551840 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-211be19c-2cc0-40c5-92be-79a719231ab5 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2" status: 200 len: 1237 microversion: 2.1 time: 0.067076 Nov 01 01:48:20.551840 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1347/2602] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:48:20 2021] GET /compute/v2.1/servers/cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2 => generated 1237 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:48:21.568526 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-73a63437-464c-4b61-ae5d-79ad0e568427 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:48:21.569157 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-73a63437-464c-4b61-ae5d-79ad0e568427 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:48:21.575881 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-73a63437-464c-4b61-ae5d-79ad0e568427 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:48:21.576321 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-73a63437-464c-4b61-ae5d-79ad0e568427 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:48:21.577074 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-73a63437-464c-4b61-ae5d-79ad0e568427 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:48:21.577504 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-73a63437-464c-4b61-ae5d-79ad0e568427 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:48:21.635585 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-73a63437-464c-4b61-ae5d-79ad0e568427 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:48:21.642903 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-73a63437-464c-4b61-ae5d-79ad0e568427 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2" status: 200 len: 1241 microversion: 2.1 time: 0.078786 Nov 01 01:48:21.643454 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1256/2603] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:48:21 2021] GET /compute/v2.1/servers/cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2 => generated 1241 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:48:22.659781 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-75ea2463-9472-4096-9b3e-2d79cc8913ba tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:48:22.660477 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-75ea2463-9472-4096-9b3e-2d79cc8913ba tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:48:22.667446 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-75ea2463-9472-4096-9b3e-2d79cc8913ba tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:48:22.667925 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-75ea2463-9472-4096-9b3e-2d79cc8913ba tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:48:22.668789 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-75ea2463-9472-4096-9b3e-2d79cc8913ba tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:48:22.669279 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-75ea2463-9472-4096-9b3e-2d79cc8913ba tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:48:22.732802 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-75ea2463-9472-4096-9b3e-2d79cc8913ba tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:48:22.741796 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-75ea2463-9472-4096-9b3e-2d79cc8913ba tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2" status: 200 len: 1297 microversion: 2.1 time: 0.085606 Nov 01 01:48:22.742371 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1348/2604] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:48:22 2021] GET /compute/v2.1/servers/cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2 => generated 1297 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:48:23.760006 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-f492456b-a916-4d53-bc61-7188caec28f8 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:48:23.760747 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-f492456b-a916-4d53-bc61-7188caec28f8 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:48:23.767139 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f492456b-a916-4d53-bc61-7188caec28f8 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:48:23.767667 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f492456b-a916-4d53-bc61-7188caec28f8 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:48:23.768514 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f492456b-a916-4d53-bc61-7188caec28f8 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:48:23.769021 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f492456b-a916-4d53-bc61-7188caec28f8 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:48:23.888254 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-f492456b-a916-4d53-bc61-7188caec28f8 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:48:23.895610 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-f492456b-a916-4d53-bc61-7188caec28f8 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2" status: 200 len: 1363 microversion: 2.1 time: 0.140582 Nov 01 01:48:23.896800 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1257/2605] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:48:23 2021] GET /compute/v2.1/servers/cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2 => generated 1363 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:48:24.244420 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [req-1d60d33b-ebf6-400e-b69f-f76370f16afe req-6ee0235e-c945-481c-ac98-cd9a66f959ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2", "tag": "b2cc207f-c8a8-4129-a643-c3aa803178eb"}]} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:48:24.246019 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 01 01:48:24.246019 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: warnings.warn(msg) Nov 01 01:48:24.253688 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [req-1d60d33b-ebf6-400e-b69f-f76370f16afe req-6ee0235e-c945-481c-ac98-cd9a66f959ad service nova] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:48:24.256505 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [req-1d60d33b-ebf6-400e-b69f-f76370f16afe req-6ee0235e-c945-481c-ac98-cd9a66f959ad service nova] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:48:24.266480 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.compute.server_external_events [req-1d60d33b-ebf6-400e-b69f-f76370f16afe req-6ee0235e-c945-481c-ac98-cd9a66f959ad service nova] Creating event network-changed:b2cc207f-c8a8-4129-a643-c3aa803178eb for instance cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2 on hv-cinder-81561 Nov 01 01:48:24.272499 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [req-1d60d33b-ebf6-400e-b69f-f76370f16afe req-6ee0235e-c945-481c-ac98-cd9a66f959ad service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032870 Nov 01 01:48:24.273267 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1349/2606] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Nov 1 01:48:24 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:48:24.913447 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-9f657e08-1bf1-4265-82ab-a19e47871c4c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:48:24.914292 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-9f657e08-1bf1-4265-82ab-a19e47871c4c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:48:24.920521 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9f657e08-1bf1-4265-82ab-a19e47871c4c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:48:24.920968 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9f657e08-1bf1-4265-82ab-a19e47871c4c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:48:24.921739 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9f657e08-1bf1-4265-82ab-a19e47871c4c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:48:24.922170 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9f657e08-1bf1-4265-82ab-a19e47871c4c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:48:25.046194 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-9f657e08-1bf1-4265-82ab-a19e47871c4c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:48:25.053606 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-9f657e08-1bf1-4265-82ab-a19e47871c4c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2" status: 200 len: 1363 microversion: 2.1 time: 0.144314 Nov 01 01:48:25.054177 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1258/2607] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:48:24 2021] GET /compute/v2.1/servers/cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2 => generated 1363 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:48:26.072150 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-f7e81e61-5308-4cf2-90a7-ab747b3ff183 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:48:26.072956 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-f7e81e61-5308-4cf2-90a7-ab747b3ff183 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:48:26.080040 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f7e81e61-5308-4cf2-90a7-ab747b3ff183 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:48:26.080570 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f7e81e61-5308-4cf2-90a7-ab747b3ff183 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:48:26.081436 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f7e81e61-5308-4cf2-90a7-ab747b3ff183 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:48:26.081949 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f7e81e61-5308-4cf2-90a7-ab747b3ff183 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:48:26.203820 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-f7e81e61-5308-4cf2-90a7-ab747b3ff183 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:48:26.211151 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-f7e81e61-5308-4cf2-90a7-ab747b3ff183 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2" status: 200 len: 1363 microversion: 2.1 time: 0.144352 Nov 01 01:48:26.211717 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1350/2608] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:48:26 2021] GET /compute/v2.1/servers/cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2 => generated 1363 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:48:27.226626 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-759fb8fa-0444-4b71-bbcd-28256fd0e289 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:48:27.227229 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-759fb8fa-0444-4b71-bbcd-28256fd0e289 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:48:27.233129 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-759fb8fa-0444-4b71-bbcd-28256fd0e289 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:48:27.233568 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-759fb8fa-0444-4b71-bbcd-28256fd0e289 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:48:27.234317 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-759fb8fa-0444-4b71-bbcd-28256fd0e289 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:48:27.234769 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-759fb8fa-0444-4b71-bbcd-28256fd0e289 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:48:27.352355 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-759fb8fa-0444-4b71-bbcd-28256fd0e289 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:48:27.359642 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-759fb8fa-0444-4b71-bbcd-28256fd0e289 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2" status: 200 len: 1363 microversion: 2.1 time: 0.136645 Nov 01 01:48:27.360199 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1259/2609] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:48:27 2021] GET /compute/v2.1/servers/cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2 => generated 1363 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:48:28.376334 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-1c02de0f-4c3e-485c-997c-9b6b312df0ed tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:48:28.376949 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-1c02de0f-4c3e-485c-997c-9b6b312df0ed tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:48:28.383440 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-1c02de0f-4c3e-485c-997c-9b6b312df0ed tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:48:28.383883 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-1c02de0f-4c3e-485c-997c-9b6b312df0ed tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:48:28.384638 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-1c02de0f-4c3e-485c-997c-9b6b312df0ed tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:48:28.385060 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-1c02de0f-4c3e-485c-997c-9b6b312df0ed tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:48:28.505108 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-1c02de0f-4c3e-485c-997c-9b6b312df0ed tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:48:28.512330 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-1c02de0f-4c3e-485c-997c-9b6b312df0ed tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2" status: 200 len: 1363 microversion: 2.1 time: 0.139641 Nov 01 01:48:28.512886 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1351/2610] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:48:28 2021] GET /compute/v2.1/servers/cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2 => generated 1363 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:48:29.528076 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-72f8c5dc-0ecf-436a-9854-8f909b9869a6 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:48:29.528685 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-72f8c5dc-0ecf-436a-9854-8f909b9869a6 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:48:29.534992 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-72f8c5dc-0ecf-436a-9854-8f909b9869a6 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:48:29.535435 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-72f8c5dc-0ecf-436a-9854-8f909b9869a6 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:48:29.536184 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-72f8c5dc-0ecf-436a-9854-8f909b9869a6 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:48:29.536608 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-72f8c5dc-0ecf-436a-9854-8f909b9869a6 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:48:29.657206 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-72f8c5dc-0ecf-436a-9854-8f909b9869a6 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:48:29.664343 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-72f8c5dc-0ecf-436a-9854-8f909b9869a6 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2" status: 200 len: 1363 microversion: 2.1 time: 0.139910 Nov 01 01:48:29.664899 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1260/2611] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:48:29 2021] GET /compute/v2.1/servers/cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2 => generated 1363 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:48:30.680503 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-264be1e6-e643-4cff-83fd-c34a08244ab7 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:48:30.681160 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-264be1e6-e643-4cff-83fd-c34a08244ab7 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:48:30.687571 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-264be1e6-e643-4cff-83fd-c34a08244ab7 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:48:30.688009 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-264be1e6-e643-4cff-83fd-c34a08244ab7 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:48:30.688754 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-264be1e6-e643-4cff-83fd-c34a08244ab7 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:48:30.689176 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-264be1e6-e643-4cff-83fd-c34a08244ab7 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:48:30.808872 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-264be1e6-e643-4cff-83fd-c34a08244ab7 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:48:30.816389 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-264be1e6-e643-4cff-83fd-c34a08244ab7 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2" status: 200 len: 1363 microversion: 2.1 time: 0.140157 Nov 01 01:48:30.816950 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1352/2612] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:48:30 2021] GET /compute/v2.1/servers/cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2 => generated 1363 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:48:31.713675 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [req-ae3aaf3a-bbce-49ad-8892-24488c8fe896 req-70cc8348-2cd2-4238-b490-384d3e581788 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2", "name": "network-vif-plugged", "status": "completed", "tag": "b2cc207f-c8a8-4129-a643-c3aa803178eb"}]} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:48:31.715269 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 01 01:48:31.715269 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: warnings.warn(msg) Nov 01 01:48:31.722034 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [req-ae3aaf3a-bbce-49ad-8892-24488c8fe896 req-70cc8348-2cd2-4238-b490-384d3e581788 service nova] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:48:31.722481 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [req-ae3aaf3a-bbce-49ad-8892-24488c8fe896 req-70cc8348-2cd2-4238-b490-384d3e581788 service nova] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:48:31.732887 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.compute.server_external_events [req-ae3aaf3a-bbce-49ad-8892-24488c8fe896 req-70cc8348-2cd2-4238-b490-384d3e581788 service nova] Creating event network-vif-plugged:b2cc207f-c8a8-4129-a643-c3aa803178eb for instance cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2 on hv-cinder-81561 Nov 01 01:48:31.738856 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [req-ae3aaf3a-bbce-49ad-8892-24488c8fe896 req-70cc8348-2cd2-4238-b490-384d3e581788 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082247 Nov 01 01:48:31.739431 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1261/2613] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Nov 1 01:48:31 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:48:31.832929 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-89c674b3-7c29-466a-ade0-cd033bdaa4dd tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:48:31.833588 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-89c674b3-7c29-466a-ade0-cd033bdaa4dd tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:48:31.839904 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-89c674b3-7c29-466a-ade0-cd033bdaa4dd tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:48:31.840384 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-89c674b3-7c29-466a-ade0-cd033bdaa4dd tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:48:31.841139 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-89c674b3-7c29-466a-ade0-cd033bdaa4dd tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:48:31.841562 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-89c674b3-7c29-466a-ade0-cd033bdaa4dd tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:48:31.963745 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-89c674b3-7c29-466a-ade0-cd033bdaa4dd tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:48:31.971153 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-89c674b3-7c29-466a-ade0-cd033bdaa4dd tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2" status: 200 len: 1363 microversion: 2.1 time: 0.142284 Nov 01 01:48:31.971719 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1353/2614] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:48:31 2021] GET /compute/v2.1/servers/cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2 => generated 1363 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:48:32.988232 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-73ed1251-c299-49a2-b3ad-b9e88cd73f64 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:48:32.988917 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-73ed1251-c299-49a2-b3ad-b9e88cd73f64 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:48:32.995581 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-73ed1251-c299-49a2-b3ad-b9e88cd73f64 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:48:32.995953 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-73ed1251-c299-49a2-b3ad-b9e88cd73f64 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:48:32.996698 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-73ed1251-c299-49a2-b3ad-b9e88cd73f64 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:48:32.997125 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-73ed1251-c299-49a2-b3ad-b9e88cd73f64 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:48:33.114447 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-73ed1251-c299-49a2-b3ad-b9e88cd73f64 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:48:33.122216 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-73ed1251-c299-49a2-b3ad-b9e88cd73f64 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2" status: 200 len: 1363 microversion: 2.1 time: 0.138396 Nov 01 01:48:33.122803 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1262/2615] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:48:32 2021] GET /compute/v2.1/servers/cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2 => generated 1363 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:48:34.138911 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-ac923d76-6dbe-477a-85b7-42976bbceb84 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:48:34.139521 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-ac923d76-6dbe-477a-85b7-42976bbceb84 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:48:34.145725 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ac923d76-6dbe-477a-85b7-42976bbceb84 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:48:34.146170 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ac923d76-6dbe-477a-85b7-42976bbceb84 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:48:34.146958 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ac923d76-6dbe-477a-85b7-42976bbceb84 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:48:34.147391 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ac923d76-6dbe-477a-85b7-42976bbceb84 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:48:34.267745 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-ac923d76-6dbe-477a-85b7-42976bbceb84 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:48:34.274876 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-ac923d76-6dbe-477a-85b7-42976bbceb84 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2" status: 200 len: 1549 microversion: 2.1 time: 0.139747 Nov 01 01:48:34.275439 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1354/2616] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:48:34 2021] GET /compute/v2.1/servers/cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2 => generated 1549 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:48:34.290541 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-4835f2dd-d30e-44dc-a3ea-4c17bdcadf7a tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:48:34.291042 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-4835f2dd-d30e-44dc-a3ea-4c17bdcadf7a tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:48:34.297209 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4835f2dd-d30e-44dc-a3ea-4c17bdcadf7a tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:48:34.297654 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4835f2dd-d30e-44dc-a3ea-4c17bdcadf7a tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:48:34.298412 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4835f2dd-d30e-44dc-a3ea-4c17bdcadf7a tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:48:34.298867 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4835f2dd-d30e-44dc-a3ea-4c17bdcadf7a tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:48:34.377278 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-4835f2dd-d30e-44dc-a3ea-4c17bdcadf7a tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.090426 Nov 01 01:48:34.377866 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1263/2617] 10.222.0.47 () {58 vars in 1274 bytes} [Mon Nov 1 01:48:34 2021] GET /compute/v2.1/servers/cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2/os-interface => generated 285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:48:35.344860 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-d8992e61-58d3-43cc-a62b-3b6ab7be5eac tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:48:35.348934 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-d8992e61-58d3-43cc-a62b-3b6ab7be5eac tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:48:35.352509 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d8992e61-58d3-43cc-a62b-3b6ab7be5eac tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:48:35.353022 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d8992e61-58d3-43cc-a62b-3b6ab7be5eac tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:48:35.353860 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d8992e61-58d3-43cc-a62b-3b6ab7be5eac tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:48:35.354411 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d8992e61-58d3-43cc-a62b-3b6ab7be5eac tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:48:35.407286 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [req-f2285377-6e0b-4fda-bea3-449377330539 req-e55d8a32-c80f-4deb-995e-b5cf7c27127a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2", "tag": "b2cc207f-c8a8-4129-a643-c3aa803178eb"}]} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:48:35.408795 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 01 01:48:35.408795 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: warnings.warn(msg) Nov 01 01:48:35.415652 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [req-f2285377-6e0b-4fda-bea3-449377330539 req-e55d8a32-c80f-4deb-995e-b5cf7c27127a service nova] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:48:35.416089 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [req-f2285377-6e0b-4fda-bea3-449377330539 req-e55d8a32-c80f-4deb-995e-b5cf7c27127a service nova] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:48:35.426846 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.compute.server_external_events [req-f2285377-6e0b-4fda-bea3-449377330539 req-e55d8a32-c80f-4deb-995e-b5cf7c27127a service nova] Creating event network-changed:b2cc207f-c8a8-4129-a643-c3aa803178eb for instance cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2 on hv-cinder-81561 Nov 01 01:48:35.432305 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [req-f2285377-6e0b-4fda-bea3-449377330539 req-e55d8a32-c80f-4deb-995e-b5cf7c27127a service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088894 Nov 01 01:48:35.432884 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1264/2618] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Nov 1 01:48:35 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:48:35.438342 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-d8992e61-58d3-43cc-a62b-3b6ab7be5eac tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "POST /compute/v2.1/servers/cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2/action" status: 200 len: 14 microversion: 2.1 time: 0.097522 Nov 01 01:48:35.441952 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1355/2619] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Nov 1 01:48:35 2021] POST /compute/v2.1/servers/cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2/action => generated 14 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 01 01:48:36.450029 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-b01dfa05-dc11-44bc-80f5-7f219cfa9fd0 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:48:36.451052 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-b01dfa05-dc11-44bc-80f5-7f219cfa9fd0 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:48:36.457057 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b01dfa05-dc11-44bc-80f5-7f219cfa9fd0 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:48:36.457505 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b01dfa05-dc11-44bc-80f5-7f219cfa9fd0 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:48:36.458257 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b01dfa05-dc11-44bc-80f5-7f219cfa9fd0 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:48:36.458712 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b01dfa05-dc11-44bc-80f5-7f219cfa9fd0 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:48:36.538064 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-b01dfa05-dc11-44bc-80f5-7f219cfa9fd0 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "POST /compute/v2.1/servers/cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2/action" status: 200 len: 14 microversion: 2.1 time: 0.092308 Nov 01 01:48:36.539370 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1265/2620] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Nov 1 01:48:36 2021] POST /compute/v2.1/servers/cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2/action => generated 14 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 01 01:48:37.551236 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-dea63c38-3391-4639-b22e-953a7bce16bd tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:48:37.552253 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-dea63c38-3391-4639-b22e-953a7bce16bd tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:48:37.559111 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-dea63c38-3391-4639-b22e-953a7bce16bd tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:48:37.559547 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-dea63c38-3391-4639-b22e-953a7bce16bd tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:48:37.560445 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-dea63c38-3391-4639-b22e-953a7bce16bd tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:48:37.561069 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-dea63c38-3391-4639-b22e-953a7bce16bd tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:48:37.641895 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-dea63c38-3391-4639-b22e-953a7bce16bd tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "POST /compute/v2.1/servers/cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2/action" status: 200 len: 14 microversion: 2.1 time: 0.094555 Nov 01 01:48:37.642646 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1356/2621] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Nov 1 01:48:37 2021] POST /compute/v2.1/servers/cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2/action => generated 14 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 01 01:48:38.653436 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-d0025d0e-6d8a-493b-b499-b0d4be7a4a07 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:48:38.654342 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-d0025d0e-6d8a-493b-b499-b0d4be7a4a07 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:48:38.661115 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d0025d0e-6d8a-493b-b499-b0d4be7a4a07 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:48:38.661586 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d0025d0e-6d8a-493b-b499-b0d4be7a4a07 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:48:38.662340 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d0025d0e-6d8a-493b-b499-b0d4be7a4a07 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:48:38.662791 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d0025d0e-6d8a-493b-b499-b0d4be7a4a07 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:48:38.742232 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-d0025d0e-6d8a-493b-b499-b0d4be7a4a07 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "POST /compute/v2.1/servers/cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2/action" status: 200 len: 14 microversion: 2.1 time: 0.092714 Nov 01 01:48:38.743409 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1266/2622] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Nov 1 01:48:38 2021] POST /compute/v2.1/servers/cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2/action => generated 14 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 01 01:48:39.753837 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-d4457f23-02ac-4aa5-8a51-d4215f1c420c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:48:39.754880 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-d4457f23-02ac-4aa5-8a51-d4215f1c420c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:48:39.762366 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d4457f23-02ac-4aa5-8a51-d4215f1c420c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:48:39.762837 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d4457f23-02ac-4aa5-8a51-d4215f1c420c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:48:39.763591 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d4457f23-02ac-4aa5-8a51-d4215f1c420c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:48:39.764019 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d4457f23-02ac-4aa5-8a51-d4215f1c420c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:48:39.841368 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-d4457f23-02ac-4aa5-8a51-d4215f1c420c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "POST /compute/v2.1/servers/cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2/action" status: 200 len: 14 microversion: 2.1 time: 0.091428 Nov 01 01:48:39.842012 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1357/2623] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Nov 1 01:48:39 2021] POST /compute/v2.1/servers/cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2/action => generated 14 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 01 01:48:40.851844 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-0087f07e-2578-47fe-9fbf-f38d17dd5a06 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:48:40.852844 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-0087f07e-2578-47fe-9fbf-f38d17dd5a06 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:48:40.859693 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0087f07e-2578-47fe-9fbf-f38d17dd5a06 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:48:40.860140 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0087f07e-2578-47fe-9fbf-f38d17dd5a06 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:48:40.860901 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0087f07e-2578-47fe-9fbf-f38d17dd5a06 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:48:40.861334 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0087f07e-2578-47fe-9fbf-f38d17dd5a06 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:48:40.945384 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-0087f07e-2578-47fe-9fbf-f38d17dd5a06 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "POST /compute/v2.1/servers/cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2/action" status: 200 len: 14 microversion: 2.1 time: 0.097461 Nov 01 01:48:40.946755 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1267/2624] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Nov 1 01:48:40 2021] POST /compute/v2.1/servers/cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2/action => generated 14 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 01 01:48:41.957255 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-8dbf905a-95da-4bf3-aac1-7197fdf67636 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:48:41.958288 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-8dbf905a-95da-4bf3-aac1-7197fdf67636 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:48:41.965612 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8dbf905a-95da-4bf3-aac1-7197fdf67636 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:48:41.966055 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8dbf905a-95da-4bf3-aac1-7197fdf67636 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:48:41.966841 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8dbf905a-95da-4bf3-aac1-7197fdf67636 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:48:41.967270 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8dbf905a-95da-4bf3-aac1-7197fdf67636 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:48:42.047838 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-8dbf905a-95da-4bf3-aac1-7197fdf67636 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "POST /compute/v2.1/servers/cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2/action" status: 200 len: 14 microversion: 2.1 time: 0.094479 Nov 01 01:48:42.048446 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1358/2625] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Nov 1 01:48:41 2021] POST /compute/v2.1/servers/cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2/action => generated 14 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 01 01:48:43.059887 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-c4e317e4-edae-470f-9e61-a0dff4c02caf tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:48:43.060829 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-c4e317e4-edae-470f-9e61-a0dff4c02caf tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:48:43.067837 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c4e317e4-edae-470f-9e61-a0dff4c02caf tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:48:43.068278 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c4e317e4-edae-470f-9e61-a0dff4c02caf tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:48:43.069057 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c4e317e4-edae-470f-9e61-a0dff4c02caf tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:48:43.069483 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c4e317e4-edae-470f-9e61-a0dff4c02caf tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:48:43.159081 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-c4e317e4-edae-470f-9e61-a0dff4c02caf tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "POST /compute/v2.1/servers/cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2/action" status: 200 len: 14 microversion: 2.1 time: 0.103690 Nov 01 01:48:43.159737 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1268/2626] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Nov 1 01:48:43 2021] POST /compute/v2.1/servers/cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2/action => generated 14 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 01 01:48:44.169543 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-a50103b4-10c6-40d6-a282-cfd4108e9c25 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:48:44.170559 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-a50103b4-10c6-40d6-a282-cfd4108e9c25 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:48:44.177371 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a50103b4-10c6-40d6-a282-cfd4108e9c25 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:48:44.177813 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a50103b4-10c6-40d6-a282-cfd4108e9c25 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:48:44.178596 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a50103b4-10c6-40d6-a282-cfd4108e9c25 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:48:44.179025 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a50103b4-10c6-40d6-a282-cfd4108e9c25 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:48:44.260756 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-a50103b4-10c6-40d6-a282-cfd4108e9c25 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "POST /compute/v2.1/servers/cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2/action" status: 200 len: 14 microversion: 2.1 time: 0.095101 Nov 01 01:48:44.261355 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1359/2627] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Nov 1 01:48:44 2021] POST /compute/v2.1/servers/cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2/action => generated 14 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 01 01:48:45.271601 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-7d80426c-664e-4ced-9d39-6a2d490a6dc9 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:48:45.272603 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-7d80426c-664e-4ced-9d39-6a2d490a6dc9 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:48:45.279360 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7d80426c-664e-4ced-9d39-6a2d490a6dc9 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:48:45.279809 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7d80426c-664e-4ced-9d39-6a2d490a6dc9 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:48:45.280565 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7d80426c-664e-4ced-9d39-6a2d490a6dc9 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:48:45.280997 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7d80426c-664e-4ced-9d39-6a2d490a6dc9 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:48:45.371031 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-7d80426c-664e-4ced-9d39-6a2d490a6dc9 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "POST /compute/v2.1/servers/cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2/action" status: 200 len: 3604 microversion: 2.1 time: 0.103308 Nov 01 01:48:45.371902 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1269/2628] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Nov 1 01:48:45 2021] POST /compute/v2.1/servers/cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2/action => generated 3604 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:48:46.383236 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-0549d90d-e365-483e-ad8f-b20dba1d4efb tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:48:46.384234 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-0549d90d-e365-483e-ad8f-b20dba1d4efb tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:48:46.391112 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0549d90d-e365-483e-ad8f-b20dba1d4efb tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:48:46.391545 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0549d90d-e365-483e-ad8f-b20dba1d4efb tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:48:46.398844 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0549d90d-e365-483e-ad8f-b20dba1d4efb tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:48:46.398844 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0549d90d-e365-483e-ad8f-b20dba1d4efb tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:48:46.482180 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-0549d90d-e365-483e-ad8f-b20dba1d4efb tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "POST /compute/v2.1/servers/cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2/action" status: 200 len: 15025 microversion: 2.1 time: 0.102763 Nov 01 01:48:46.482860 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1360/2629] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Nov 1 01:48:46 2021] POST /compute/v2.1/servers/cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2/action => generated 15025 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 01 01:48:47.494126 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-b1987cad-3097-4bf7-9ef5-e4cdf032d3fb tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:48:47.495172 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-b1987cad-3097-4bf7-9ef5-e4cdf032d3fb tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:48:47.502568 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b1987cad-3097-4bf7-9ef5-e4cdf032d3fb tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:48:47.503009 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b1987cad-3097-4bf7-9ef5-e4cdf032d3fb tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:48:47.503757 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b1987cad-3097-4bf7-9ef5-e4cdf032d3fb tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:48:47.504181 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b1987cad-3097-4bf7-9ef5-e4cdf032d3fb tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:48:47.591053 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-b1987cad-3097-4bf7-9ef5-e4cdf032d3fb tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "POST /compute/v2.1/servers/cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2/action" status: 200 len: 18561 microversion: 2.1 time: 0.100749 Nov 01 01:48:47.591698 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1270/2630] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Nov 1 01:48:47 2021] POST /compute/v2.1/servers/cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2/action => generated 18561 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 01 01:48:48.602799 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-d48e469c-0022-4ac8-a479-9e922d862161 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:48:48.603850 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-d48e469c-0022-4ac8-a479-9e922d862161 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:48:48.613121 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d48e469c-0022-4ac8-a479-9e922d862161 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:48:48.613575 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d48e469c-0022-4ac8-a479-9e922d862161 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:48:48.614343 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d48e469c-0022-4ac8-a479-9e922d862161 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:48:48.614805 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d48e469c-0022-4ac8-a479-9e922d862161 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:48:48.707974 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-d48e469c-0022-4ac8-a479-9e922d862161 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "POST /compute/v2.1/servers/cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2/action" status: 200 len: 19661 microversion: 2.1 time: 0.109141 Nov 01 01:48:48.708684 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1361/2631] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Nov 1 01:48:48 2021] POST /compute/v2.1/servers/cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2/action => generated 19661 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 01 01:48:49.720316 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-a3f5f02d-7219-4ca1-a647-bdfb06301e5d tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:48:49.721310 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-a3f5f02d-7219-4ca1-a647-bdfb06301e5d tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:48:49.728032 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a3f5f02d-7219-4ca1-a647-bdfb06301e5d tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:48:49.728478 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a3f5f02d-7219-4ca1-a647-bdfb06301e5d tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:48:49.729229 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a3f5f02d-7219-4ca1-a647-bdfb06301e5d tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:48:49.729653 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a3f5f02d-7219-4ca1-a647-bdfb06301e5d tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:48:49.815747 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-a3f5f02d-7219-4ca1-a647-bdfb06301e5d tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "POST /compute/v2.1/servers/cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2/action" status: 200 len: 22546 microversion: 2.1 time: 0.099838 Nov 01 01:48:49.816383 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1271/2632] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Nov 1 01:48:49 2021] POST /compute/v2.1/servers/cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2/action => generated 22546 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 01 01:48:50.827831 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-caa2f8e5-4eb9-4e5e-99a7-9f1a2456cbcb tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:48:50.828835 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-caa2f8e5-4eb9-4e5e-99a7-9f1a2456cbcb tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:48:50.835698 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-caa2f8e5-4eb9-4e5e-99a7-9f1a2456cbcb tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:48:50.836144 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-caa2f8e5-4eb9-4e5e-99a7-9f1a2456cbcb tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:48:50.836904 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-caa2f8e5-4eb9-4e5e-99a7-9f1a2456cbcb tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:48:50.837329 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-caa2f8e5-4eb9-4e5e-99a7-9f1a2456cbcb tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:48:50.929949 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-caa2f8e5-4eb9-4e5e-99a7-9f1a2456cbcb tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "POST /compute/v2.1/servers/cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2/action" status: 200 len: 23804 microversion: 2.1 time: 0.106223 Nov 01 01:48:50.930604 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1362/2633] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Nov 1 01:48:50 2021] POST /compute/v2.1/servers/cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2/action => generated 23804 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 01 01:48:51.941772 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-63b4df5f-2d42-47c6-b637-e8a4b0b7e606 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:48:51.942786 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-63b4df5f-2d42-47c6-b637-e8a4b0b7e606 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:48:51.949587 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-63b4df5f-2d42-47c6-b637-e8a4b0b7e606 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:48:51.950031 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-63b4df5f-2d42-47c6-b637-e8a4b0b7e606 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:48:51.950845 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-63b4df5f-2d42-47c6-b637-e8a4b0b7e606 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:48:51.951281 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-63b4df5f-2d42-47c6-b637-e8a4b0b7e606 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:48:52.040492 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-63b4df5f-2d42-47c6-b637-e8a4b0b7e606 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "POST /compute/v2.1/servers/cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2/action" status: 200 len: 25612 microversion: 2.1 time: 0.103411 Nov 01 01:48:52.041116 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1272/2634] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Nov 1 01:48:51 2021] POST /compute/v2.1/servers/cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2/action => generated 25612 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 01 01:48:52.685134 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 01 01:48:52.685736 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: Mon Nov 1 01:48:52 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 01 01:48:53.052557 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-9804d5fd-2ff9-4a18-8001-9b149937f42c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:48:53.053475 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-9804d5fd-2ff9-4a18-8001-9b149937f42c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:48:53.060323 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9804d5fd-2ff9-4a18-8001-9b149937f42c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:48:53.060770 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9804d5fd-2ff9-4a18-8001-9b149937f42c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:48:53.061518 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9804d5fd-2ff9-4a18-8001-9b149937f42c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:48:53.062022 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9804d5fd-2ff9-4a18-8001-9b149937f42c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:48:53.166373 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-9804d5fd-2ff9-4a18-8001-9b149937f42c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "POST /compute/v2.1/servers/cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2/action" status: 200 len: 27005 microversion: 2.1 time: 0.117775 Nov 01 01:48:53.167024 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1363/2635] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Nov 1 01:48:53 2021] POST /compute/v2.1/servers/cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2/action => generated 27005 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 01 01:48:54.179733 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-fc08066b-8154-48be-a01b-fa67d426bf54 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:48:54.180743 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-fc08066b-8154-48be-a01b-fa67d426bf54 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:48:54.187527 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-fc08066b-8154-48be-a01b-fa67d426bf54 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:48:54.187966 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-fc08066b-8154-48be-a01b-fa67d426bf54 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:48:54.188718 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-fc08066b-8154-48be-a01b-fa67d426bf54 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:48:54.189405 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-fc08066b-8154-48be-a01b-fa67d426bf54 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:48:54.289569 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-fc08066b-8154-48be-a01b-fa67d426bf54 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "POST /compute/v2.1/servers/cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2/action" status: 200 len: 27709 microversion: 2.1 time: 0.114161 Nov 01 01:48:54.290218 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1273/2636] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Nov 1 01:48:54 2021] POST /compute/v2.1/servers/cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2/action => generated 27709 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 01 01:48:55.301441 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-9b4814a9-7d5b-4ecc-89c6-7a0dc82abf56 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:48:55.302449 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-9b4814a9-7d5b-4ecc-89c6-7a0dc82abf56 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:48:55.309227 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9b4814a9-7d5b-4ecc-89c6-7a0dc82abf56 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:48:55.309666 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9b4814a9-7d5b-4ecc-89c6-7a0dc82abf56 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:48:55.310409 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9b4814a9-7d5b-4ecc-89c6-7a0dc82abf56 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:48:55.310881 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9b4814a9-7d5b-4ecc-89c6-7a0dc82abf56 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:48:55.402108 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-9b4814a9-7d5b-4ecc-89c6-7a0dc82abf56 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "POST /compute/v2.1/servers/cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2/action" status: 200 len: 28120 microversion: 2.1 time: 0.104516 Nov 01 01:48:55.402789 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1364/2637] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Nov 1 01:48:55 2021] POST /compute/v2.1/servers/cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2/action => generated 28120 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 01 01:48:56.414133 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-7f066eb2-ba11-4580-adb5-04e7b31d21dc tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:48:56.415185 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-7f066eb2-ba11-4580-adb5-04e7b31d21dc tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:48:56.421948 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7f066eb2-ba11-4580-adb5-04e7b31d21dc tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:48:56.422389 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7f066eb2-ba11-4580-adb5-04e7b31d21dc tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:48:56.423190 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7f066eb2-ba11-4580-adb5-04e7b31d21dc tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:48:56.423619 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7f066eb2-ba11-4580-adb5-04e7b31d21dc tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:48:56.514043 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-7f066eb2-ba11-4580-adb5-04e7b31d21dc tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "POST /compute/v2.1/servers/cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2/action" status: 200 len: 28237 microversion: 2.1 time: 0.103666 Nov 01 01:48:56.514592 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1274/2638] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Nov 1 01:48:56 2021] POST /compute/v2.1/servers/cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2/action => generated 28237 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 01 01:48:57.526552 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-a22d2eec-7627-4d3c-a675-bb750b4935b8 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:48:57.527551 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-a22d2eec-7627-4d3c-a675-bb750b4935b8 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:48:57.534941 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a22d2eec-7627-4d3c-a675-bb750b4935b8 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:48:57.535411 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a22d2eec-7627-4d3c-a675-bb750b4935b8 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:48:57.536162 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a22d2eec-7627-4d3c-a675-bb750b4935b8 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:48:57.536588 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a22d2eec-7627-4d3c-a675-bb750b4935b8 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:48:57.623115 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-a22d2eec-7627-4d3c-a675-bb750b4935b8 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "POST /compute/v2.1/servers/cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2/action" status: 200 len: 28237 microversion: 2.1 time: 0.100382 Nov 01 01:48:57.623721 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1365/2639] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Nov 1 01:48:57 2021] POST /compute/v2.1/servers/cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2/action => generated 28237 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 01 01:48:58.635298 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-3fadaf05-c2a1-47a1-8ef4-64a66a9b6d09 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:48:58.636279 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-3fadaf05-c2a1-47a1-8ef4-64a66a9b6d09 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:48:58.644471 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3fadaf05-c2a1-47a1-8ef4-64a66a9b6d09 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:48:58.644917 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3fadaf05-c2a1-47a1-8ef4-64a66a9b6d09 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:48:58.645680 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3fadaf05-c2a1-47a1-8ef4-64a66a9b6d09 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:48:58.646110 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3fadaf05-c2a1-47a1-8ef4-64a66a9b6d09 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:48:58.729613 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-3fadaf05-c2a1-47a1-8ef4-64a66a9b6d09 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "POST /compute/v2.1/servers/cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2/action" status: 200 len: 28237 microversion: 2.1 time: 0.098373 Nov 01 01:48:58.730230 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1275/2640] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Nov 1 01:48:58 2021] POST /compute/v2.1/servers/cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2/action => generated 28237 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 01 01:48:59.741601 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-45aef2cf-ac62-407a-a2c5-132364c446fe tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:48:59.742630 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-45aef2cf-ac62-407a-a2c5-132364c446fe tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:48:59.749362 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-45aef2cf-ac62-407a-a2c5-132364c446fe tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:48:59.749811 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-45aef2cf-ac62-407a-a2c5-132364c446fe tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:48:59.750655 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-45aef2cf-ac62-407a-a2c5-132364c446fe tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:48:59.751085 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-45aef2cf-ac62-407a-a2c5-132364c446fe tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:48:59.835827 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-45aef2cf-ac62-407a-a2c5-132364c446fe tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "POST /compute/v2.1/servers/cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2/action" status: 200 len: 28237 microversion: 2.1 time: 0.098114 Nov 01 01:48:59.836475 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1366/2641] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Nov 1 01:48:59 2021] POST /compute/v2.1/servers/cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2/action => generated 28237 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 01 01:49:00.848338 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-9ba01c3b-448a-4c3b-9b1e-e2acb4481268 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:49:00.849348 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-9ba01c3b-448a-4c3b-9b1e-e2acb4481268 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:49:00.856106 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9ba01c3b-448a-4c3b-9b1e-e2acb4481268 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:49:00.856547 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9ba01c3b-448a-4c3b-9b1e-e2acb4481268 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:49:00.857303 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9ba01c3b-448a-4c3b-9b1e-e2acb4481268 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:49:00.857731 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9ba01c3b-448a-4c3b-9b1e-e2acb4481268 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:49:00.938499 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-9ba01c3b-448a-4c3b-9b1e-e2acb4481268 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "POST /compute/v2.1/servers/cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2/action" status: 200 len: 28237 microversion: 2.1 time: 0.094576 Nov 01 01:49:00.939620 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1276/2642] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Nov 1 01:49:00 2021] POST /compute/v2.1/servers/cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2/action => generated 28237 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 01 01:49:01.950114 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-f3e68da1-6905-4ffd-80ce-94c509951a06 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:49:01.951095 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-f3e68da1-6905-4ffd-80ce-94c509951a06 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:49:01.957875 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f3e68da1-6905-4ffd-80ce-94c509951a06 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:49:01.958318 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f3e68da1-6905-4ffd-80ce-94c509951a06 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:49:01.959130 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f3e68da1-6905-4ffd-80ce-94c509951a06 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:49:01.959559 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f3e68da1-6905-4ffd-80ce-94c509951a06 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:49:02.042301 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-f3e68da1-6905-4ffd-80ce-94c509951a06 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "POST /compute/v2.1/servers/cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2/action" status: 200 len: 28237 microversion: 2.1 time: 0.096291 Nov 01 01:49:02.042954 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1367/2643] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Nov 1 01:49:01 2021] POST /compute/v2.1/servers/cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2/action => generated 28237 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 01 01:49:03.053830 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-486c1705-42f6-43e8-b4c1-9d3b1e2dcbb4 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:49:03.060134 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-486c1705-42f6-43e8-b4c1-9d3b1e2dcbb4 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:49:03.061594 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-486c1705-42f6-43e8-b4c1-9d3b1e2dcbb4 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:49:03.062036 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-486c1705-42f6-43e8-b4c1-9d3b1e2dcbb4 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:49:03.062829 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-486c1705-42f6-43e8-b4c1-9d3b1e2dcbb4 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:49:03.063769 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-486c1705-42f6-43e8-b4c1-9d3b1e2dcbb4 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:49:03.146295 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-486c1705-42f6-43e8-b4c1-9d3b1e2dcbb4 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "POST /compute/v2.1/servers/cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2/action" status: 200 len: 28237 microversion: 2.1 time: 0.096467 Nov 01 01:49:03.146997 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1277/2644] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Nov 1 01:49:03 2021] POST /compute/v2.1/servers/cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2/action => generated 28237 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 01 01:49:04.159729 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-20c33ba1-811e-4cc8-9a04-6d81086c78db tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:49:04.160647 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-20c33ba1-811e-4cc8-9a04-6d81086c78db tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:49:04.167506 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-20c33ba1-811e-4cc8-9a04-6d81086c78db tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:49:04.167952 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-20c33ba1-811e-4cc8-9a04-6d81086c78db tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:49:04.168706 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-20c33ba1-811e-4cc8-9a04-6d81086c78db tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:49:04.169135 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-20c33ba1-811e-4cc8-9a04-6d81086c78db tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:49:04.255358 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-20c33ba1-811e-4cc8-9a04-6d81086c78db tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "POST /compute/v2.1/servers/cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2/action" status: 200 len: 28237 microversion: 2.1 time: 0.100374 Nov 01 01:49:04.256053 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1368/2645] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Nov 1 01:49:04 2021] POST /compute/v2.1/servers/cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2/action => generated 28237 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 01 01:49:05.267436 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-2c6550a9-ed3e-4fc8-9e5a-9cf28d833b54 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:49:05.268432 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-2c6550a9-ed3e-4fc8-9e5a-9cf28d833b54 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:49:05.275356 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2c6550a9-ed3e-4fc8-9e5a-9cf28d833b54 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:49:05.275803 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2c6550a9-ed3e-4fc8-9e5a-9cf28d833b54 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:49:05.276567 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2c6550a9-ed3e-4fc8-9e5a-9cf28d833b54 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:49:05.276996 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2c6550a9-ed3e-4fc8-9e5a-9cf28d833b54 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:49:05.378029 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-2c6550a9-ed3e-4fc8-9e5a-9cf28d833b54 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "POST /compute/v2.1/servers/cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2/action" status: 200 len: 28237 microversion: 2.1 time: 0.114436 Nov 01 01:49:05.378706 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1278/2646] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Nov 1 01:49:05 2021] POST /compute/v2.1/servers/cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2/action => generated 28237 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 01 01:49:06.389563 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-8b566448-065e-4f86-82ee-676148cf7464 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:49:06.390598 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-8b566448-065e-4f86-82ee-676148cf7464 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:49:06.397330 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8b566448-065e-4f86-82ee-676148cf7464 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:49:06.397778 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8b566448-065e-4f86-82ee-676148cf7464 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:49:06.398558 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8b566448-065e-4f86-82ee-676148cf7464 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:49:06.398988 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8b566448-065e-4f86-82ee-676148cf7464 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:49:06.480268 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-8b566448-065e-4f86-82ee-676148cf7464 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "POST /compute/v2.1/servers/cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2/action" status: 200 len: 28237 microversion: 2.1 time: 0.094593 Nov 01 01:49:06.480902 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1369/2647] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Nov 1 01:49:06 2021] POST /compute/v2.1/servers/cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2/action => generated 28237 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 01 01:49:07.491595 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-c440f799-818b-4b21-8a64-43c627664b74 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:49:07.492594 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-c440f799-818b-4b21-8a64-43c627664b74 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:49:07.499424 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c440f799-818b-4b21-8a64-43c627664b74 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:49:07.499868 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c440f799-818b-4b21-8a64-43c627664b74 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:49:07.501131 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c440f799-818b-4b21-8a64-43c627664b74 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:49:07.501564 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c440f799-818b-4b21-8a64-43c627664b74 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:49:07.595812 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-c440f799-818b-4b21-8a64-43c627664b74 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "POST /compute/v2.1/servers/cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2/action" status: 200 len: 28237 microversion: 2.1 time: 0.108114 Nov 01 01:49:07.596446 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1279/2648] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Nov 1 01:49:07 2021] POST /compute/v2.1/servers/cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2/action => generated 28237 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 01 01:49:08.608108 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-fde5909a-5823-4f22-8ec0-b1165543f02c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:49:08.609044 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-fde5909a-5823-4f22-8ec0-b1165543f02c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:49:08.616899 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-fde5909a-5823-4f22-8ec0-b1165543f02c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:49:08.617260 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-fde5909a-5823-4f22-8ec0-b1165543f02c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:49:08.618032 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-fde5909a-5823-4f22-8ec0-b1165543f02c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:49:08.618481 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-fde5909a-5823-4f22-8ec0-b1165543f02c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:49:08.711175 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-fde5909a-5823-4f22-8ec0-b1165543f02c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "POST /compute/v2.1/servers/cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2/action" status: 200 len: 28528 microversion: 2.1 time: 0.107048 Nov 01 01:49:08.711825 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1370/2649] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Nov 1 01:49:08 2021] POST /compute/v2.1/servers/cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2/action => generated 28528 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 01 01:49:09.723444 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-858c952c-cda5-47d8-85a4-d31a148615ad tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:49:09.724452 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-858c952c-cda5-47d8-85a4-d31a148615ad tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:49:09.731347 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-858c952c-cda5-47d8-85a4-d31a148615ad tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:49:09.731793 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-858c952c-cda5-47d8-85a4-d31a148615ad tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:49:09.732552 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-858c952c-cda5-47d8-85a4-d31a148615ad tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:49:09.732984 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-858c952c-cda5-47d8-85a4-d31a148615ad tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:49:09.827631 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-858c952c-cda5-47d8-85a4-d31a148615ad tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "POST /compute/v2.1/servers/cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2/action" status: 200 len: 28696 microversion: 2.1 time: 0.108238 Nov 01 01:49:09.828259 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1280/2650] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Nov 1 01:49:09 2021] POST /compute/v2.1/servers/cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2/action => generated 28696 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 01 01:49:10.839110 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-69f6f2f1-8f16-4d85-b3a2-5d38863b3570 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:49:10.840098 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-69f6f2f1-8f16-4d85-b3a2-5d38863b3570 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:49:10.847074 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-69f6f2f1-8f16-4d85-b3a2-5d38863b3570 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:49:10.847509 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-69f6f2f1-8f16-4d85-b3a2-5d38863b3570 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:49:10.848253 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-69f6f2f1-8f16-4d85-b3a2-5d38863b3570 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:49:10.848678 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-69f6f2f1-8f16-4d85-b3a2-5d38863b3570 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:49:10.932014 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-69f6f2f1-8f16-4d85-b3a2-5d38863b3570 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "POST /compute/v2.1/servers/cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2/action" status: 200 len: 28696 microversion: 2.1 time: 0.096727 Nov 01 01:49:10.932653 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1371/2651] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Nov 1 01:49:10 2021] POST /compute/v2.1/servers/cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2/action => generated 28696 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 01 01:49:11.944271 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-8e0d7e6f-ebb8-48ca-9f5b-7c493709701a tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:49:11.945275 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-8e0d7e6f-ebb8-48ca-9f5b-7c493709701a tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:49:11.952088 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8e0d7e6f-ebb8-48ca-9f5b-7c493709701a tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:49:11.952537 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8e0d7e6f-ebb8-48ca-9f5b-7c493709701a tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:49:11.953296 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8e0d7e6f-ebb8-48ca-9f5b-7c493709701a tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:49:11.954230 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8e0d7e6f-ebb8-48ca-9f5b-7c493709701a tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:49:12.057697 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-8e0d7e6f-ebb8-48ca-9f5b-7c493709701a tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "POST /compute/v2.1/servers/cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2/action" status: 200 len: 28696 microversion: 2.1 time: 0.117283 Nov 01 01:49:12.058825 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1281/2652] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Nov 1 01:49:11 2021] POST /compute/v2.1/servers/cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2/action => generated 28696 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 01 01:49:13.070160 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-c5c30801-890c-4122-9b5d-f078929cbe59 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:49:13.071115 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-c5c30801-890c-4122-9b5d-f078929cbe59 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:49:13.077905 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c5c30801-890c-4122-9b5d-f078929cbe59 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:49:13.078350 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c5c30801-890c-4122-9b5d-f078929cbe59 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:49:13.079148 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c5c30801-890c-4122-9b5d-f078929cbe59 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:49:13.079558 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c5c30801-890c-4122-9b5d-f078929cbe59 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:49:13.170477 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-c5c30801-890c-4122-9b5d-f078929cbe59 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "POST /compute/v2.1/servers/cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2/action" status: 200 len: 28696 microversion: 2.1 time: 0.104250 Nov 01 01:49:13.171100 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1372/2653] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Nov 1 01:49:13 2021] POST /compute/v2.1/servers/cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2/action => generated 28696 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 01 01:49:14.182525 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-e96510c5-5d20-485b-b1ca-f6440fa069ee tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:49:14.183524 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-e96510c5-5d20-485b-b1ca-f6440fa069ee tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:49:14.190881 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e96510c5-5d20-485b-b1ca-f6440fa069ee tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:49:14.191331 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e96510c5-5d20-485b-b1ca-f6440fa069ee tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:49:14.192094 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e96510c5-5d20-485b-b1ca-f6440fa069ee tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:49:14.192524 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e96510c5-5d20-485b-b1ca-f6440fa069ee tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:49:14.272364 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-e96510c5-5d20-485b-b1ca-f6440fa069ee tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "POST /compute/v2.1/servers/cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2/action" status: 200 len: 28696 microversion: 2.1 time: 0.093837 Nov 01 01:49:14.273270 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1282/2654] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Nov 1 01:49:14 2021] POST /compute/v2.1/servers/cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2/action => generated 28696 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 01 01:49:15.284413 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-05adf8bb-4b95-4138-bcd0-632c005ba21b tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:49:15.286568 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-05adf8bb-4b95-4138-bcd0-632c005ba21b tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:49:15.292187 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-05adf8bb-4b95-4138-bcd0-632c005ba21b tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:49:15.292593 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-05adf8bb-4b95-4138-bcd0-632c005ba21b tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:49:15.293346 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-05adf8bb-4b95-4138-bcd0-632c005ba21b tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:49:15.293766 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-05adf8bb-4b95-4138-bcd0-632c005ba21b tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:49:15.381738 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-05adf8bb-4b95-4138-bcd0-632c005ba21b tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "POST /compute/v2.1/servers/cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2/action" status: 200 len: 28696 microversion: 2.1 time: 0.101264 Nov 01 01:49:15.382464 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1373/2655] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Nov 1 01:49:15 2021] POST /compute/v2.1/servers/cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2/action => generated 28696 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 01 01:49:16.394088 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-5e39c42e-3724-4c49-9311-bebc354b2c73 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:49:16.395636 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-5e39c42e-3724-4c49-9311-bebc354b2c73 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:49:16.402178 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5e39c42e-3724-4c49-9311-bebc354b2c73 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:49:16.402659 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5e39c42e-3724-4c49-9311-bebc354b2c73 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:49:16.403426 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5e39c42e-3724-4c49-9311-bebc354b2c73 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:49:16.403861 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5e39c42e-3724-4c49-9311-bebc354b2c73 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:49:16.486313 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-5e39c42e-3724-4c49-9311-bebc354b2c73 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "POST /compute/v2.1/servers/cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2/action" status: 200 len: 28696 microversion: 2.1 time: 0.096666 Nov 01 01:49:16.486979 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1283/2656] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Nov 1 01:49:16 2021] POST /compute/v2.1/servers/cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2/action => generated 28696 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 01 01:49:17.498409 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-f93b8f3f-0068-4ee8-a3a2-4dbe466e66b6 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:49:17.499433 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-f93b8f3f-0068-4ee8-a3a2-4dbe466e66b6 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:49:17.506327 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f93b8f3f-0068-4ee8-a3a2-4dbe466e66b6 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:49:17.506798 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f93b8f3f-0068-4ee8-a3a2-4dbe466e66b6 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:49:17.507543 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f93b8f3f-0068-4ee8-a3a2-4dbe466e66b6 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:49:17.507967 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f93b8f3f-0068-4ee8-a3a2-4dbe466e66b6 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:49:17.589810 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-f93b8f3f-0068-4ee8-a3a2-4dbe466e66b6 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "POST /compute/v2.1/servers/cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2/action" status: 200 len: 28696 microversion: 2.1 time: 0.095243 Nov 01 01:49:17.590475 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1374/2657] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Nov 1 01:49:17 2021] POST /compute/v2.1/servers/cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2/action => generated 28696 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 01 01:49:18.601635 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-d17bf1e1-c8d1-49aa-a8e0-096a43b85fbf tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:49:18.602653 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-d17bf1e1-c8d1-49aa-a8e0-096a43b85fbf tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:49:18.609406 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d17bf1e1-c8d1-49aa-a8e0-096a43b85fbf tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:49:18.609884 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d17bf1e1-c8d1-49aa-a8e0-096a43b85fbf tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:49:18.610621 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d17bf1e1-c8d1-49aa-a8e0-096a43b85fbf tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:49:18.611051 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d17bf1e1-c8d1-49aa-a8e0-096a43b85fbf tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:49:18.697506 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-d17bf1e1-c8d1-49aa-a8e0-096a43b85fbf tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "POST /compute/v2.1/servers/cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2/action" status: 200 len: 28696 microversion: 2.1 time: 0.099772 Nov 01 01:49:18.698140 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1284/2658] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Nov 1 01:49:18 2021] POST /compute/v2.1/servers/cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2/action => generated 28696 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 01 01:49:19.709496 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-5e032cbb-3215-400c-ba54-3eda846bcc45 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:49:19.710539 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-5e032cbb-3215-400c-ba54-3eda846bcc45 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:49:19.717348 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-5e032cbb-3215-400c-ba54-3eda846bcc45 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:49:19.717794 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-5e032cbb-3215-400c-ba54-3eda846bcc45 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:49:19.718573 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-5e032cbb-3215-400c-ba54-3eda846bcc45 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:49:19.719000 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-5e032cbb-3215-400c-ba54-3eda846bcc45 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:49:19.805843 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-5e032cbb-3215-400c-ba54-3eda846bcc45 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "POST /compute/v2.1/servers/cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2/action" status: 200 len: 28696 microversion: 2.1 time: 0.100245 Nov 01 01:49:19.806536 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1375/2659] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Nov 1 01:49:19 2021] POST /compute/v2.1/servers/cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2/action => generated 28696 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 01 01:49:20.818478 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-c3947443-ef18-4902-b921-b50498eed236 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:49:20.819511 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-c3947443-ef18-4902-b921-b50498eed236 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:49:20.826245 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c3947443-ef18-4902-b921-b50498eed236 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:49:20.826786 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c3947443-ef18-4902-b921-b50498eed236 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:49:20.827544 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c3947443-ef18-4902-b921-b50498eed236 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:49:20.827972 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c3947443-ef18-4902-b921-b50498eed236 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:49:20.912057 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-c3947443-ef18-4902-b921-b50498eed236 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "POST /compute/v2.1/servers/cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2/action" status: 200 len: 28696 microversion: 2.1 time: 0.097499 Nov 01 01:49:20.912942 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1285/2660] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Nov 1 01:49:20 2021] POST /compute/v2.1/servers/cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2/action => generated 28696 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 01 01:49:21.924194 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-3693ba88-1ab4-4caa-bf24-29f506d2bbb5 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:49:21.925222 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-3693ba88-1ab4-4caa-bf24-29f506d2bbb5 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:49:21.932012 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3693ba88-1ab4-4caa-bf24-29f506d2bbb5 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:49:21.932456 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3693ba88-1ab4-4caa-bf24-29f506d2bbb5 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:49:21.933205 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3693ba88-1ab4-4caa-bf24-29f506d2bbb5 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:49:21.933630 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3693ba88-1ab4-4caa-bf24-29f506d2bbb5 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:49:22.018861 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-3693ba88-1ab4-4caa-bf24-29f506d2bbb5 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "POST /compute/v2.1/servers/cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2/action" status: 200 len: 28696 microversion: 2.1 time: 0.098558 Nov 01 01:49:22.019702 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1376/2661] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Nov 1 01:49:21 2021] POST /compute/v2.1/servers/cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2/action => generated 28696 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 01 01:49:23.030461 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-d5ae8c82-20a5-4018-90c5-4e113dfcde63 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:49:23.031404 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-d5ae8c82-20a5-4018-90c5-4e113dfcde63 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:49:23.038217 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d5ae8c82-20a5-4018-90c5-4e113dfcde63 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:49:23.038691 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d5ae8c82-20a5-4018-90c5-4e113dfcde63 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:49:23.039443 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d5ae8c82-20a5-4018-90c5-4e113dfcde63 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:49:23.039872 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d5ae8c82-20a5-4018-90c5-4e113dfcde63 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:49:23.133041 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-d5ae8c82-20a5-4018-90c5-4e113dfcde63 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "POST /compute/v2.1/servers/cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2/action" status: 200 len: 28696 microversion: 2.1 time: 0.106480 Nov 01 01:49:23.133710 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1286/2662] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Nov 1 01:49:23 2021] POST /compute/v2.1/servers/cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2/action => generated 28696 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 01 01:49:24.207527 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-bc4b33fc-9466-46c6-925a-81f95047c202 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:49:24.208578 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-bc4b33fc-9466-46c6-925a-81f95047c202 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:49:24.215416 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-bc4b33fc-9466-46c6-925a-81f95047c202 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:49:24.215868 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-bc4b33fc-9466-46c6-925a-81f95047c202 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:49:24.216629 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-bc4b33fc-9466-46c6-925a-81f95047c202 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:49:24.217061 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-bc4b33fc-9466-46c6-925a-81f95047c202 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:49:24.308833 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-bc4b33fc-9466-46c6-925a-81f95047c202 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "POST /compute/v2.1/servers/cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2/action" status: 200 len: 28696 microversion: 2.1 time: 0.167650 Nov 01 01:49:24.309444 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1377/2663] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Nov 1 01:49:24 2021] POST /compute/v2.1/servers/cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2/action => generated 28696 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 01 01:49:25.320699 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-6539800c-abf6-4816-a885-e37b5ed2195b tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:49:25.321732 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-6539800c-abf6-4816-a885-e37b5ed2195b tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:49:25.328584 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6539800c-abf6-4816-a885-e37b5ed2195b tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:49:25.329014 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6539800c-abf6-4816-a885-e37b5ed2195b tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:49:25.329770 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6539800c-abf6-4816-a885-e37b5ed2195b tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:49:25.330216 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6539800c-abf6-4816-a885-e37b5ed2195b tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:49:25.429250 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-6539800c-abf6-4816-a885-e37b5ed2195b tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "POST /compute/v2.1/servers/cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2/action" status: 200 len: 28696 microversion: 2.1 time: 0.112417 Nov 01 01:49:25.430131 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1287/2664] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Nov 1 01:49:25 2021] POST /compute/v2.1/servers/cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2/action => generated 28696 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 01 01:49:25.800492 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-350c26ab-4f5b-411d-8a4f-0185bf7135bc tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:49:25.801065 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-350c26ab-4f5b-411d-8a4f-0185bf7135bc tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: 5c06a09a-23e3-468c-9a18-d40bd3785c9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:49:25.807955 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-350c26ab-4f5b-411d-8a4f-0185bf7135bc tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:49:25.808442 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-350c26ab-4f5b-411d-8a4f-0185bf7135bc tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:49:25.809206 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-350c26ab-4f5b-411d-8a4f-0185bf7135bc tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:49:25.809627 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-350c26ab-4f5b-411d-8a4f-0185bf7135bc tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:49:25.834704 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-350c26ab-4f5b-411d-8a4f-0185bf7135bc tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: 5c06a09a-23e3-468c-9a18-d40bd3785c9d] Going to try to terminate instance {{(pid=116267) delete /opt/stack/nova/nova/compute/api.py:2612}} Nov 01 01:49:26.102983 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-350c26ab-4f5b-411d-8a4f-0185bf7135bc tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "DELETE /compute/v2.1/servers/5c06a09a-23e3-468c-9a18-d40bd3785c9d" status: 204 len: 0 microversion: 2.1 time: 0.306515 Nov 01 01:49:26.103489 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1378/2665] 10.222.0.47 () {58 vars in 1238 bytes} [Mon Nov 1 01:49:25 2021] DELETE /compute/v2.1/servers/5c06a09a-23e3-468c-9a18-d40bd3785c9d => generated 0 bytes in 308 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 01 01:49:26.111663 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-201250f4-2884-4bd5-977a-fae418398fe2 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:49:26.115975 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-201250f4-2884-4bd5-977a-fae418398fe2 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: 5c06a09a-23e3-468c-9a18-d40bd3785c9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:49:26.119794 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-201250f4-2884-4bd5-977a-fae418398fe2 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:49:26.120240 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-201250f4-2884-4bd5-977a-fae418398fe2 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:49:26.120996 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-201250f4-2884-4bd5-977a-fae418398fe2 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:49:26.121424 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-201250f4-2884-4bd5-977a-fae418398fe2 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:49:26.240107 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-201250f4-2884-4bd5-977a-fae418398fe2 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:49:26.247306 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-201250f4-2884-4bd5-977a-fae418398fe2 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/5c06a09a-23e3-468c-9a18-d40bd3785c9d" status: 200 len: 1507 microversion: 2.1 time: 0.139671 Nov 01 01:49:26.247864 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1288/2666] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:49:26 2021] GET /compute/v2.1/servers/5c06a09a-23e3-468c-9a18-d40bd3785c9d => generated 1507 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:49:26.441618 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-f835e97d-6ac5-4aab-8ed1-c3729af3fe00 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:49:26.442677 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-f835e97d-6ac5-4aab-8ed1-c3729af3fe00 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:49:26.449615 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f835e97d-6ac5-4aab-8ed1-c3729af3fe00 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:49:26.450240 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f835e97d-6ac5-4aab-8ed1-c3729af3fe00 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:49:26.450818 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f835e97d-6ac5-4aab-8ed1-c3729af3fe00 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:49:26.451254 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f835e97d-6ac5-4aab-8ed1-c3729af3fe00 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:49:26.543483 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-f835e97d-6ac5-4aab-8ed1-c3729af3fe00 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "POST /compute/v2.1/servers/cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2/action" status: 200 len: 28696 microversion: 2.1 time: 0.105982 Nov 01 01:49:26.544195 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1379/2667] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Nov 1 01:49:26 2021] POST /compute/v2.1/servers/cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2/action => generated 28696 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 01 01:49:27.264082 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-87729018-b020-4c13-80c6-75d624503b3d tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:49:27.264693 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-87729018-b020-4c13-80c6-75d624503b3d tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: 5c06a09a-23e3-468c-9a18-d40bd3785c9d] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:49:27.271620 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-87729018-b020-4c13-80c6-75d624503b3d tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:49:27.272134 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-87729018-b020-4c13-80c6-75d624503b3d tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:49:27.272822 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-87729018-b020-4c13-80c6-75d624503b3d tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:49:27.273259 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-87729018-b020-4c13-80c6-75d624503b3d tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:49:27.408987 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-87729018-b020-4c13-80c6-75d624503b3d tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:49:27.417474 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-87729018-b020-4c13-80c6-75d624503b3d tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/5c06a09a-23e3-468c-9a18-d40bd3785c9d" status: 200 len: 1507 microversion: 2.1 time: 0.156979 Nov 01 01:49:27.418061 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1289/2668] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:49:27 2021] GET /compute/v2.1/servers/5c06a09a-23e3-468c-9a18-d40bd3785c9d => generated 1507 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:49:27.556050 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-f8d6a374-895f-4945-8f84-680d50f283c5 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:49:27.557091 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-f8d6a374-895f-4945-8f84-680d50f283c5 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:49:27.564181 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f8d6a374-895f-4945-8f84-680d50f283c5 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:49:27.564543 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f8d6a374-895f-4945-8f84-680d50f283c5 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:49:27.565339 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f8d6a374-895f-4945-8f84-680d50f283c5 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:49:27.565773 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f8d6a374-895f-4945-8f84-680d50f283c5 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:49:27.656421 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-f8d6a374-895f-4945-8f84-680d50f283c5 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "POST /compute/v2.1/servers/cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2/action" status: 200 len: 28696 microversion: 2.1 time: 0.104259 Nov 01 01:49:27.660986 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1380/2669] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Nov 1 01:49:27 2021] POST /compute/v2.1/servers/cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2/action => generated 28696 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 01 01:49:27.941162 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [req-feeeb144-44a4-434b-982f-f60708a25590 req-ca9dc601-18a9-4b0c-ade7-2662d3df07bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c06a09a-23e3-468c-9a18-d40bd3785c9d", "name": "network-vif-deleted", "tag": "c8a25e8a-7f87-4425-985e-192fc8e74209"}]} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:49:27.942825 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 01 01:49:27.942825 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: warnings.warn(msg) Nov 01 01:49:27.950930 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [req-feeeb144-44a4-434b-982f-f60708a25590 req-ca9dc601-18a9-4b0c-ade7-2662d3df07bc service nova] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:49:27.951363 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [req-feeeb144-44a4-434b-982f-f60708a25590 req-ca9dc601-18a9-4b0c-ade7-2662d3df07bc service nova] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:49:27.961946 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.compute.server_external_events [req-feeeb144-44a4-434b-982f-f60708a25590 req-ca9dc601-18a9-4b0c-ade7-2662d3df07bc service nova] Creating event network-vif-deleted:c8a25e8a-7f87-4425-985e-192fc8e74209 for instance 5c06a09a-23e3-468c-9a18-d40bd3785c9d on hv-cinder-81561 Nov 01 01:49:27.966869 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [req-feeeb144-44a4-434b-982f-f60708a25590 req-ca9dc601-18a9-4b0c-ade7-2662d3df07bc service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029533 Nov 01 01:49:27.973327 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1290/2670] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Nov 1 01:49:27 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:49:28.434378 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-63cfaf72-ff75-4d6c-be24-2dfa41ad0fa5 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:49:28.435090 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-63cfaf72-ff75-4d6c-be24-2dfa41ad0fa5 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: 5c06a09a-23e3-468c-9a18-d40bd3785c9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:49:28.442591 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-63cfaf72-ff75-4d6c-be24-2dfa41ad0fa5 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:49:28.443028 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-63cfaf72-ff75-4d6c-be24-2dfa41ad0fa5 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:49:28.443776 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-63cfaf72-ff75-4d6c-be24-2dfa41ad0fa5 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:49:28.444200 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-63cfaf72-ff75-4d6c-be24-2dfa41ad0fa5 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:49:28.473638 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-63cfaf72-ff75-4d6c-be24-2dfa41ad0fa5 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:49:28.474071 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-63cfaf72-ff75-4d6c-be24-2dfa41ad0fa5 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:49:28.474539 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.objects.instance [None req-63cfaf72-ff75-4d6c-be24-2dfa41ad0fa5 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lazy-loading 'fault' on Instance uuid 5c06a09a-23e3-468c-9a18-d40bd3785c9d {{(pid=116267) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 01 01:49:28.516672 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-63cfaf72-ff75-4d6c-be24-2dfa41ad0fa5 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:49:28.524285 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-63cfaf72-ff75-4d6c-be24-2dfa41ad0fa5 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/5c06a09a-23e3-468c-9a18-d40bd3785c9d" status: 200 len: 1311 microversion: 2.1 time: 0.093877 Nov 01 01:49:28.524845 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1381/2671] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:49:28 2021] GET /compute/v2.1/servers/5c06a09a-23e3-468c-9a18-d40bd3785c9d => generated 1311 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:49:28.669112 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-7b5fc142-e154-4d96-9ee4-2a18dd9b7a2c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:49:28.670035 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-7b5fc142-e154-4d96-9ee4-2a18dd9b7a2c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:49:28.676113 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7b5fc142-e154-4d96-9ee4-2a18dd9b7a2c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:49:28.676558 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7b5fc142-e154-4d96-9ee4-2a18dd9b7a2c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:49:28.680502 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7b5fc142-e154-4d96-9ee4-2a18dd9b7a2c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:49:28.680502 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7b5fc142-e154-4d96-9ee4-2a18dd9b7a2c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:49:28.768173 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-7b5fc142-e154-4d96-9ee4-2a18dd9b7a2c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "POST /compute/v2.1/servers/cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2/action" status: 200 len: 28696 microversion: 2.1 time: 0.103426 Nov 01 01:49:28.769464 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1291/2672] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Nov 1 01:49:28 2021] POST /compute/v2.1/servers/cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2/action => generated 28696 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 01 01:49:29.540729 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-cd310f6f-274c-4ad2-8258-e477613fe8ce tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:49:29.541327 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-cd310f6f-274c-4ad2-8258-e477613fe8ce tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: 5c06a09a-23e3-468c-9a18-d40bd3785c9d] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:49:29.548160 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-cd310f6f-274c-4ad2-8258-e477613fe8ce tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:49:29.548626 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-cd310f6f-274c-4ad2-8258-e477613fe8ce tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:49:29.549370 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-cd310f6f-274c-4ad2-8258-e477613fe8ce tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:49:29.550380 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-cd310f6f-274c-4ad2-8258-e477613fe8ce tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:49:29.563372 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.wsgi [None req-cd310f6f-274c-4ad2-8258-e477613fe8ce tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] HTTP exception thrown: Instance 5c06a09a-23e3-468c-9a18-d40bd3785c9d could not be found. Nov 01 01:49:29.563941 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-cd310f6f-274c-4ad2-8258-e477613fe8ce tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Returning 404 to user: Instance 5c06a09a-23e3-468c-9a18-d40bd3785c9d could not be found. {{(pid=116267) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 01 01:49:29.564730 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-cd310f6f-274c-4ad2-8258-e477613fe8ce tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/5c06a09a-23e3-468c-9a18-d40bd3785c9d" status: 404 len: 111 microversion: 2.1 time: 0.027633 Nov 01 01:49:29.565235 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1382/2673] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:49:29 2021] GET /compute/v2.1/servers/5c06a09a-23e3-468c-9a18-d40bd3785c9d => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 01:49:29.573365 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-e80d0850-ac59-4b24-a311-76308c2bb7db tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:49:29.573944 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-e80d0850-ac59-4b24-a311-76308c2bb7db tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:49:29.580687 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e80d0850-ac59-4b24-a311-76308c2bb7db tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:49:29.581636 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e80d0850-ac59-4b24-a311-76308c2bb7db tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:49:29.582384 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e80d0850-ac59-4b24-a311-76308c2bb7db tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:49:29.582940 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e80d0850-ac59-4b24-a311-76308c2bb7db tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:49:29.610313 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-e80d0850-ac59-4b24-a311-76308c2bb7db tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Going to try to terminate instance {{(pid=116266) delete /opt/stack/nova/nova/compute/api.py:2612}} Nov 01 01:49:29.779620 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-e6ac98c6-8ea5-40ee-8965-c71f24f19b85 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:49:29.780526 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-e6ac98c6-8ea5-40ee-8965-c71f24f19b85 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:49:29.787242 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e6ac98c6-8ea5-40ee-8965-c71f24f19b85 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:49:29.787680 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e6ac98c6-8ea5-40ee-8965-c71f24f19b85 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:49:29.788451 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e6ac98c6-8ea5-40ee-8965-c71f24f19b85 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:49:29.788872 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e6ac98c6-8ea5-40ee-8965-c71f24f19b85 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:49:29.839535 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-e80d0850-ac59-4b24-a311-76308c2bb7db tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "DELETE /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 204 len: 0 microversion: 2.1 time: 0.269815 Nov 01 01:49:29.840131 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1292/2674] 10.222.0.47 () {58 vars in 1238 bytes} [Mon Nov 1 01:49:29 2021] DELETE /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 0 bytes in 271 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 01 01:49:29.848814 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-33ec1691-059a-4e2f-9e85-6e7a2e48d339 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:49:29.852600 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-33ec1691-059a-4e2f-9e85-6e7a2e48d339 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:49:29.856592 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-33ec1691-059a-4e2f-9e85-6e7a2e48d339 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:49:29.857039 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-33ec1691-059a-4e2f-9e85-6e7a2e48d339 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:49:29.857821 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-33ec1691-059a-4e2f-9e85-6e7a2e48d339 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:49:29.858251 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-33ec1691-059a-4e2f-9e85-6e7a2e48d339 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:49:29.916752 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-e6ac98c6-8ea5-40ee-8965-c71f24f19b85 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "POST /compute/v2.1/servers/cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2/action" status: 200 len: 28696 microversion: 2.1 time: 0.140708 Nov 01 01:49:29.920680 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1383/2675] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Nov 1 01:49:29 2021] POST /compute/v2.1/servers/cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2/action => generated 28696 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 01 01:49:29.977622 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-33ec1691-059a-4e2f-9e85-6e7a2e48d339 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:49:29.985403 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-33ec1691-059a-4e2f-9e85-6e7a2e48d339 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1569 microversion: 2.1 time: 0.141087 Nov 01 01:49:29.985958 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1293/2676] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:49:29 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1569 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:49:30.929587 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-f814ff74-ab87-4f64-ba54-0a40e1b1b228 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:49:30.930603 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-f814ff74-ab87-4f64-ba54-0a40e1b1b228 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:49:30.937371 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f814ff74-ab87-4f64-ba54-0a40e1b1b228 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:49:30.938063 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f814ff74-ab87-4f64-ba54-0a40e1b1b228 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:49:30.938833 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f814ff74-ab87-4f64-ba54-0a40e1b1b228 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:49:30.939256 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f814ff74-ab87-4f64-ba54-0a40e1b1b228 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:49:31.001303 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-81ced3fe-0c33-4327-a3c6-b0536524287f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:49:31.001908 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-81ced3fe-0c33-4327-a3c6-b0536524287f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:49:31.008249 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-81ced3fe-0c33-4327-a3c6-b0536524287f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:49:31.008691 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-81ced3fe-0c33-4327-a3c6-b0536524287f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:49:31.009447 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-81ced3fe-0c33-4327-a3c6-b0536524287f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:49:31.009872 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-81ced3fe-0c33-4327-a3c6-b0536524287f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:49:31.056853 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-f814ff74-ab87-4f64-ba54-0a40e1b1b228 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "POST /compute/v2.1/servers/cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2/action" status: 200 len: 28696 microversion: 2.1 time: 0.131789 Nov 01 01:49:31.058261 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1384/2677] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Nov 1 01:49:30 2021] POST /compute/v2.1/servers/cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2/action => generated 28696 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 01 01:49:31.136104 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-81ced3fe-0c33-4327-a3c6-b0536524287f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:49:31.144565 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-81ced3fe-0c33-4327-a3c6-b0536524287f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1569 microversion: 2.1 time: 0.146900 Nov 01 01:49:31.145140 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1294/2678] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:49:30 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1569 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:49:31.533964 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [req-848f98d9-c005-4779-9b4d-952ef5991739 req-49c438d2-1e72-4b73-a0ab-b90b389eb0b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f02098be-ed15-45a0-a599-941cb0e1eebb", "name": "network-vif-deleted", "tag": "675c5b62-2b1b-4dd7-823c-c35403e383c1"}]} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:49:31.535578 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 01 01:49:31.535578 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: warnings.warn(msg) Nov 01 01:49:31.543204 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [req-848f98d9-c005-4779-9b4d-952ef5991739 req-49c438d2-1e72-4b73-a0ab-b90b389eb0b8 service nova] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:49:31.543632 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [req-848f98d9-c005-4779-9b4d-952ef5991739 req-49c438d2-1e72-4b73-a0ab-b90b389eb0b8 service nova] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:49:31.554361 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.compute.server_external_events [req-848f98d9-c005-4779-9b4d-952ef5991739 req-49c438d2-1e72-4b73-a0ab-b90b389eb0b8 service nova] Creating event network-vif-deleted:675c5b62-2b1b-4dd7-823c-c35403e383c1 for instance f02098be-ed15-45a0-a599-941cb0e1eebb on hv-cinder-81561 Nov 01 01:49:31.558955 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [req-848f98d9-c005-4779-9b4d-952ef5991739 req-49c438d2-1e72-4b73-a0ab-b90b389eb0b8 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028869 Nov 01 01:49:31.559522 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1385/2679] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Nov 1 01:49:31 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:49:32.069331 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-fa311a67-07cd-4f00-82be-e031564dd44e tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:49:32.070163 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-fa311a67-07cd-4f00-82be-e031564dd44e tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:49:32.076428 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-fa311a67-07cd-4f00-82be-e031564dd44e tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:49:32.076874 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-fa311a67-07cd-4f00-82be-e031564dd44e tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:49:32.077636 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-fa311a67-07cd-4f00-82be-e031564dd44e tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:49:32.078071 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-fa311a67-07cd-4f00-82be-e031564dd44e tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:49:32.162495 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-9a18dcdd-7a5e-4569-a5ec-83c4127ca47e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:49:32.163191 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-9a18dcdd-7a5e-4569-a5ec-83c4127ca47e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:49:32.169152 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9a18dcdd-7a5e-4569-a5ec-83c4127ca47e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:49:32.169597 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9a18dcdd-7a5e-4569-a5ec-83c4127ca47e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:49:32.170377 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9a18dcdd-7a5e-4569-a5ec-83c4127ca47e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:49:32.170826 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9a18dcdd-7a5e-4569-a5ec-83c4127ca47e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:49:32.180803 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-fa311a67-07cd-4f00-82be-e031564dd44e tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "POST /compute/v2.1/servers/cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2/action" status: 200 len: 28696 microversion: 2.1 time: 0.115717 Nov 01 01:49:32.184728 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1295/2680] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Nov 1 01:49:32 2021] POST /compute/v2.1/servers/cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2/action => generated 28696 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 01 01:49:32.231424 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-9a18dcdd-7a5e-4569-a5ec-83c4127ca47e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:49:32.239520 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-9a18dcdd-7a5e-4569-a5ec-83c4127ca47e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.081959 Nov 01 01:49:32.240082 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1386/2681] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:49:32 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:49:33.193688 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-65f63634-b46b-485b-aae8-8211deaa85d0 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:49:33.194707 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-65f63634-b46b-485b-aae8-8211deaa85d0 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:49:33.201454 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-65f63634-b46b-485b-aae8-8211deaa85d0 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:49:33.201895 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-65f63634-b46b-485b-aae8-8211deaa85d0 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:49:33.202675 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-65f63634-b46b-485b-aae8-8211deaa85d0 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:49:33.203099 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-65f63634-b46b-485b-aae8-8211deaa85d0 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:49:33.256425 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-3cc51987-7de5-42db-aa3c-358862e81101 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:49:33.257020 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-3cc51987-7de5-42db-aa3c-358862e81101 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:49:33.263119 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3cc51987-7de5-42db-aa3c-358862e81101 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:49:33.263550 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3cc51987-7de5-42db-aa3c-358862e81101 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:49:33.264294 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3cc51987-7de5-42db-aa3c-358862e81101 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:49:33.264716 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3cc51987-7de5-42db-aa3c-358862e81101 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:49:33.284462 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-65f63634-b46b-485b-aae8-8211deaa85d0 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "POST /compute/v2.1/servers/cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2/action" status: 200 len: 28696 microversion: 2.1 time: 0.095084 Nov 01 01:49:33.285331 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1296/2682] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Nov 1 01:49:33 2021] POST /compute/v2.1/servers/cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2/action => generated 28696 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 01 01:49:33.324135 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-3cc51987-7de5-42db-aa3c-358862e81101 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:49:33.331739 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-3cc51987-7de5-42db-aa3c-358862e81101 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.079467 Nov 01 01:49:33.332285 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1387/2683] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:49:33 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:49:34.296505 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-0ec1cd4f-5904-475b-b72e-940d663be820 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:49:34.297507 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-0ec1cd4f-5904-475b-b72e-940d663be820 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:49:34.304301 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0ec1cd4f-5904-475b-b72e-940d663be820 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:49:34.304743 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0ec1cd4f-5904-475b-b72e-940d663be820 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:49:34.305500 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0ec1cd4f-5904-475b-b72e-940d663be820 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:49:34.305931 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0ec1cd4f-5904-475b-b72e-940d663be820 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:49:34.349453 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-8f71bf3a-c49f-4529-b42c-062afca819ed tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:49:34.350053 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-8f71bf3a-c49f-4529-b42c-062afca819ed tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:49:34.356395 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8f71bf3a-c49f-4529-b42c-062afca819ed tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:49:34.356833 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8f71bf3a-c49f-4529-b42c-062afca819ed tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:49:34.357579 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8f71bf3a-c49f-4529-b42c-062afca819ed tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:49:34.358039 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8f71bf3a-c49f-4529-b42c-062afca819ed tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:49:34.392634 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-0ec1cd4f-5904-475b-b72e-940d663be820 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "POST /compute/v2.1/servers/cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2/action" status: 200 len: 28696 microversion: 2.1 time: 0.099972 Nov 01 01:49:34.393854 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1297/2684] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Nov 1 01:49:34 2021] POST /compute/v2.1/servers/cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2/action => generated 28696 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 01 01:49:34.417273 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-8f71bf3a-c49f-4529-b42c-062afca819ed tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:49:34.428626 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-8f71bf3a-c49f-4529-b42c-062afca819ed tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.083049 Nov 01 01:49:34.429640 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1388/2685] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:49:34 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:49:35.405124 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-548899eb-d4ad-4f6a-a0e4-d970b1397443 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:49:35.406124 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-548899eb-d4ad-4f6a-a0e4-d970b1397443 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:49:35.412977 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-548899eb-d4ad-4f6a-a0e4-d970b1397443 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:49:35.413420 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-548899eb-d4ad-4f6a-a0e4-d970b1397443 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:49:35.414168 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-548899eb-d4ad-4f6a-a0e4-d970b1397443 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:49:35.414622 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-548899eb-d4ad-4f6a-a0e4-d970b1397443 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:49:35.446744 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-c3130205-e4cd-410c-925d-ddf62bf1c69d tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:49:35.447344 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-c3130205-e4cd-410c-925d-ddf62bf1c69d tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:49:35.453554 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c3130205-e4cd-410c-925d-ddf62bf1c69d tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:49:35.453998 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c3130205-e4cd-410c-925d-ddf62bf1c69d tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:49:35.454810 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c3130205-e4cd-410c-925d-ddf62bf1c69d tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:49:35.455236 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c3130205-e4cd-410c-925d-ddf62bf1c69d tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:49:35.498547 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-548899eb-d4ad-4f6a-a0e4-d970b1397443 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "POST /compute/v2.1/servers/cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2/action" status: 200 len: 28696 microversion: 2.1 time: 0.097190 Nov 01 01:49:35.499570 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1298/2686] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Nov 1 01:49:35 2021] POST /compute/v2.1/servers/cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2/action => generated 28696 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 01 01:49:35.514919 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-c3130205-e4cd-410c-925d-ddf62bf1c69d tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:49:35.523218 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-c3130205-e4cd-410c-925d-ddf62bf1c69d tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.080108 Nov 01 01:49:35.523796 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1389/2687] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:49:35 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:49:36.511320 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-f212f771-196c-451c-957f-52ca9ec53850 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:49:36.512316 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-f212f771-196c-451c-957f-52ca9ec53850 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:49:36.519665 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f212f771-196c-451c-957f-52ca9ec53850 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:49:36.520110 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f212f771-196c-451c-957f-52ca9ec53850 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:49:36.520862 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f212f771-196c-451c-957f-52ca9ec53850 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:49:36.521289 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f212f771-196c-451c-957f-52ca9ec53850 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:49:36.540089 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-fa13858b-57fe-4da6-a169-dc9b9f132b22 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:49:36.540789 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-fa13858b-57fe-4da6-a169-dc9b9f132b22 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:49:36.546940 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-fa13858b-57fe-4da6-a169-dc9b9f132b22 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:49:36.547385 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-fa13858b-57fe-4da6-a169-dc9b9f132b22 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:49:36.548145 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-fa13858b-57fe-4da6-a169-dc9b9f132b22 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:49:36.548569 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-fa13858b-57fe-4da6-a169-dc9b9f132b22 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:49:36.611406 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-fa13858b-57fe-4da6-a169-dc9b9f132b22 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:49:36.617984 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-f212f771-196c-451c-957f-52ca9ec53850 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "POST /compute/v2.1/servers/cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2/action" status: 200 len: 28696 microversion: 2.1 time: 0.110437 Nov 01 01:49:36.621700 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1299/2688] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Nov 1 01:49:36 2021] POST /compute/v2.1/servers/cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2/action => generated 28696 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 01 01:49:36.621871 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-fa13858b-57fe-4da6-a169-dc9b9f132b22 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.082684 Nov 01 01:49:36.621871 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1390/2689] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:49:36 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:49:37.630233 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-b575d133-e7c4-4448-a548-1734d2ea9204 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:49:37.631210 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-b575d133-e7c4-4448-a548-1734d2ea9204 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:49:37.634949 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-f61d2386-4e2c-466e-aa49-16dea594e12e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:49:37.635545 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-f61d2386-4e2c-466e-aa49-16dea594e12e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:49:37.637987 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b575d133-e7c4-4448-a548-1734d2ea9204 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:49:37.638442 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b575d133-e7c4-4448-a548-1734d2ea9204 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:49:37.639207 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b575d133-e7c4-4448-a548-1734d2ea9204 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:49:37.639630 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b575d133-e7c4-4448-a548-1734d2ea9204 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:49:37.641602 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f61d2386-4e2c-466e-aa49-16dea594e12e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:49:37.642044 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f61d2386-4e2c-466e-aa49-16dea594e12e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:49:37.642817 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f61d2386-4e2c-466e-aa49-16dea594e12e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:49:37.643242 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f61d2386-4e2c-466e-aa49-16dea594e12e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:49:37.703726 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-f61d2386-4e2c-466e-aa49-16dea594e12e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:49:37.711584 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-f61d2386-4e2c-466e-aa49-16dea594e12e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.080277 Nov 01 01:49:37.712140 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1391/2690] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:49:37 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:49:37.728762 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-b575d133-e7c4-4448-a548-1734d2ea9204 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "POST /compute/v2.1/servers/cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2/action" status: 200 len: 29893 microversion: 2.1 time: 0.102492 Nov 01 01:49:37.729397 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1300/2691] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Nov 1 01:49:37 2021] POST /compute/v2.1/servers/cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2/action => generated 29893 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 01 01:49:38.728123 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-750c0fac-b9b4-4197-aa7a-80f4065edee4 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:49:38.728715 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-750c0fac-b9b4-4197-aa7a-80f4065edee4 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:49:38.734913 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-750c0fac-b9b4-4197-aa7a-80f4065edee4 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:49:38.735361 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-750c0fac-b9b4-4197-aa7a-80f4065edee4 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:49:38.736115 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-750c0fac-b9b4-4197-aa7a-80f4065edee4 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:49:38.736539 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-750c0fac-b9b4-4197-aa7a-80f4065edee4 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:49:38.742816 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-532fd118-a376-453b-8b76-b11c194ded32 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:49:38.744190 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-532fd118-a376-453b-8b76-b11c194ded32 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:49:38.751546 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-532fd118-a376-453b-8b76-b11c194ded32 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:49:38.752029 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-532fd118-a376-453b-8b76-b11c194ded32 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:49:38.753534 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-532fd118-a376-453b-8b76-b11c194ded32 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:49:38.753964 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-532fd118-a376-453b-8b76-b11c194ded32 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:49:38.802751 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-750c0fac-b9b4-4197-aa7a-80f4065edee4 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:49:38.810403 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-750c0fac-b9b4-4197-aa7a-80f4065edee4 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.086000 Nov 01 01:49:38.811010 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1392/2692] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:49:38 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:49:38.844213 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-532fd118-a376-453b-8b76-b11c194ded32 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "POST /compute/v2.1/servers/cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2/action" status: 200 len: 31954 microversion: 2.1 time: 0.107380 Nov 01 01:49:38.844849 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1301/2693] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Nov 1 01:49:38 2021] POST /compute/v2.1/servers/cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2/action => generated 31954 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 01 01:49:39.827172 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-a3a6b7cc-7da7-4c73-8f4c-d59c5db9c19a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:49:39.827811 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-a3a6b7cc-7da7-4c73-8f4c-d59c5db9c19a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:49:39.834702 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a3a6b7cc-7da7-4c73-8f4c-d59c5db9c19a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:49:39.835148 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a3a6b7cc-7da7-4c73-8f4c-d59c5db9c19a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:49:39.835899 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a3a6b7cc-7da7-4c73-8f4c-d59c5db9c19a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:49:39.836323 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a3a6b7cc-7da7-4c73-8f4c-d59c5db9c19a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:49:39.856154 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-07bff996-eb5a-45de-9cb9-42a0fb1a6e1c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:49:39.857151 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-07bff996-eb5a-45de-9cb9-42a0fb1a6e1c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:49:39.863933 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-07bff996-eb5a-45de-9cb9-42a0fb1a6e1c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:49:39.864380 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-07bff996-eb5a-45de-9cb9-42a0fb1a6e1c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:49:39.865140 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-07bff996-eb5a-45de-9cb9-42a0fb1a6e1c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:49:39.865571 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-07bff996-eb5a-45de-9cb9-42a0fb1a6e1c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:49:39.894842 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-a3a6b7cc-7da7-4c73-8f4c-d59c5db9c19a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:49:39.902646 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-a3a6b7cc-7da7-4c73-8f4c-d59c5db9c19a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.079074 Nov 01 01:49:39.903214 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1393/2694] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:49:39 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:49:39.965007 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-07bff996-eb5a-45de-9cb9-42a0fb1a6e1c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "POST /compute/v2.1/servers/cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2/action" status: 200 len: 33257 microversion: 2.1 time: 0.112732 Nov 01 01:49:39.965640 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1302/2695] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Nov 1 01:49:39 2021] POST /compute/v2.1/servers/cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2/action => generated 33257 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 01 01:49:40.918556 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-c2cece44-bf75-4619-b1ce-2c9eed1518c3 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:49:40.919189 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-c2cece44-bf75-4619-b1ce-2c9eed1518c3 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:49:40.925431 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c2cece44-bf75-4619-b1ce-2c9eed1518c3 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:49:40.925873 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c2cece44-bf75-4619-b1ce-2c9eed1518c3 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:49:40.926660 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c2cece44-bf75-4619-b1ce-2c9eed1518c3 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:49:40.927089 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c2cece44-bf75-4619-b1ce-2c9eed1518c3 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:49:40.977579 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-ccee93b0-d289-4331-876e-566e355d7e54 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:49:40.978639 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-ccee93b0-d289-4331-876e-566e355d7e54 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:49:40.985463 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-c2cece44-bf75-4619-b1ce-2c9eed1518c3 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:49:40.985614 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ccee93b0-d289-4331-876e-566e355d7e54 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:49:40.985974 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ccee93b0-d289-4331-876e-566e355d7e54 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:49:40.986805 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ccee93b0-d289-4331-876e-566e355d7e54 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:49:40.987242 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ccee93b0-d289-4331-876e-566e355d7e54 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:49:40.993194 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-c2cece44-bf75-4619-b1ce-2c9eed1518c3 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.078348 Nov 01 01:49:40.993884 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1394/2696] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:49:40 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:49:41.087036 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-ccee93b0-d289-4331-876e-566e355d7e54 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "POST /compute/v2.1/servers/cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2/action" status: 200 len: 34447 microversion: 2.1 time: 0.113140 Nov 01 01:49:41.087635 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1303/2697] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Nov 1 01:49:40 2021] POST /compute/v2.1/servers/cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2/action => generated 34447 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 01 01:49:42.009856 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-5389f50a-1b90-42ab-a253-34cddf0111ca tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:49:42.010536 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-5389f50a-1b90-42ab-a253-34cddf0111ca tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:49:42.016778 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-5389f50a-1b90-42ab-a253-34cddf0111ca tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:49:42.017214 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-5389f50a-1b90-42ab-a253-34cddf0111ca tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:49:42.017957 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-5389f50a-1b90-42ab-a253-34cddf0111ca tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:49:42.018377 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-5389f50a-1b90-42ab-a253-34cddf0111ca tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:49:42.076352 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-5389f50a-1b90-42ab-a253-34cddf0111ca tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:49:42.083883 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-5389f50a-1b90-42ab-a253-34cddf0111ca tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.077659 Nov 01 01:49:42.084439 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1395/2698] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:49:42 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:49:42.099469 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-f51280f6-9e22-43a8-a780-1ee4c37e62e2 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:49:42.100516 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-f51280f6-9e22-43a8-a780-1ee4c37e62e2 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:49:42.107276 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f51280f6-9e22-43a8-a780-1ee4c37e62e2 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:49:42.107722 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f51280f6-9e22-43a8-a780-1ee4c37e62e2 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:49:42.108479 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f51280f6-9e22-43a8-a780-1ee4c37e62e2 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:49:42.108908 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f51280f6-9e22-43a8-a780-1ee4c37e62e2 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:49:42.204067 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-f51280f6-9e22-43a8-a780-1ee4c37e62e2 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "POST /compute/v2.1/servers/cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2/action" status: 200 len: 36061 microversion: 2.1 time: 0.109028 Nov 01 01:49:42.204946 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1304/2699] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Nov 1 01:49:42 2021] POST /compute/v2.1/servers/cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2/action => generated 36061 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 01 01:49:43.100296 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-6e903509-daa0-461b-83f6-03091835227f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:49:43.100928 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-6e903509-daa0-461b-83f6-03091835227f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:49:43.107067 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-6e903509-daa0-461b-83f6-03091835227f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:49:43.107505 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-6e903509-daa0-461b-83f6-03091835227f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:49:43.108248 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-6e903509-daa0-461b-83f6-03091835227f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:49:43.108668 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-6e903509-daa0-461b-83f6-03091835227f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:49:43.176104 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-6e903509-daa0-461b-83f6-03091835227f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:49:43.183759 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-6e903509-daa0-461b-83f6-03091835227f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.087272 Nov 01 01:49:43.184321 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1396/2700] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:49:43 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:49:43.215411 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-5e612ecc-95e3-4f17-a3f9-b04d0a402c14 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:49:43.216453 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-5e612ecc-95e3-4f17-a3f9-b04d0a402c14 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:49:43.223360 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5e612ecc-95e3-4f17-a3f9-b04d0a402c14 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:49:43.233162 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5e612ecc-95e3-4f17-a3f9-b04d0a402c14 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:49:43.233162 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5e612ecc-95e3-4f17-a3f9-b04d0a402c14 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:49:43.233162 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5e612ecc-95e3-4f17-a3f9-b04d0a402c14 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:49:43.323217 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-5e612ecc-95e3-4f17-a3f9-b04d0a402c14 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "POST /compute/v2.1/servers/cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2/action" status: 200 len: 37743 microversion: 2.1 time: 0.111400 Nov 01 01:49:43.324024 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1305/2701] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Nov 1 01:49:43 2021] POST /compute/v2.1/servers/cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2/action => generated 37743 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 01 01:49:44.200887 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-f72d774b-8e7e-4b30-910e-6e0c82794820 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:49:44.201479 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-f72d774b-8e7e-4b30-910e-6e0c82794820 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:49:44.207625 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f72d774b-8e7e-4b30-910e-6e0c82794820 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:49:44.208061 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f72d774b-8e7e-4b30-910e-6e0c82794820 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:49:44.208803 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f72d774b-8e7e-4b30-910e-6e0c82794820 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:49:44.209222 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f72d774b-8e7e-4b30-910e-6e0c82794820 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:49:44.266302 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-f72d774b-8e7e-4b30-910e-6e0c82794820 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:49:44.274039 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-f72d774b-8e7e-4b30-910e-6e0c82794820 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.076753 Nov 01 01:49:44.274639 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1397/2702] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:49:44 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:49:44.335207 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-31c03574-882e-4b78-9379-8b96494e595c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:49:44.336208 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-31c03574-882e-4b78-9379-8b96494e595c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:49:44.342991 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-31c03574-882e-4b78-9379-8b96494e595c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:49:44.343435 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-31c03574-882e-4b78-9379-8b96494e595c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:49:44.344198 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-31c03574-882e-4b78-9379-8b96494e595c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:49:44.344624 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-31c03574-882e-4b78-9379-8b96494e595c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:49:44.433648 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-31c03574-882e-4b78-9379-8b96494e595c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "POST /compute/v2.1/servers/cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2/action" status: 200 len: 38222 microversion: 2.1 time: 0.102336 Nov 01 01:49:44.434273 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1306/2703] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Nov 1 01:49:44 2021] POST /compute/v2.1/servers/cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2/action => generated 38222 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 01 01:49:45.289965 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-38ae083b-5380-4673-951b-854ee275afd2 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:49:45.290642 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-38ae083b-5380-4673-951b-854ee275afd2 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:49:45.296859 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-38ae083b-5380-4673-951b-854ee275afd2 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:49:45.303467 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-38ae083b-5380-4673-951b-854ee275afd2 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:49:45.303467 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-38ae083b-5380-4673-951b-854ee275afd2 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:49:45.303467 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-38ae083b-5380-4673-951b-854ee275afd2 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:49:45.361013 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-38ae083b-5380-4673-951b-854ee275afd2 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:49:45.369608 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-38ae083b-5380-4673-951b-854ee275afd2 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.083394 Nov 01 01:49:45.370186 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1398/2704] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:49:45 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:49:45.446217 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-7cd52456-604d-444f-82c7-013c8f330425 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:49:45.447250 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-7cd52456-604d-444f-82c7-013c8f330425 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:49:45.454046 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7cd52456-604d-444f-82c7-013c8f330425 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:49:45.454519 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7cd52456-604d-444f-82c7-013c8f330425 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:49:45.455302 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7cd52456-604d-444f-82c7-013c8f330425 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:49:45.455737 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7cd52456-604d-444f-82c7-013c8f330425 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:49:45.536127 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-7cd52456-604d-444f-82c7-013c8f330425 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "POST /compute/v2.1/servers/cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2/action" status: 200 len: 38222 microversion: 2.1 time: 0.093798 Nov 01 01:49:45.536751 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1307/2705] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Nov 1 01:49:45 2021] POST /compute/v2.1/servers/cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2/action => generated 38222 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 01 01:49:46.386870 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-d0252874-6025-464d-a1f4-345704bc7089 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:49:46.387477 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-d0252874-6025-464d-a1f4-345704bc7089 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:49:46.393423 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d0252874-6025-464d-a1f4-345704bc7089 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:49:46.393858 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d0252874-6025-464d-a1f4-345704bc7089 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:49:46.401006 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d0252874-6025-464d-a1f4-345704bc7089 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:49:46.401006 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d0252874-6025-464d-a1f4-345704bc7089 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:49:46.453156 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-d0252874-6025-464d-a1f4-345704bc7089 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:49:46.460820 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-d0252874-6025-464d-a1f4-345704bc7089 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.077526 Nov 01 01:49:46.461380 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1399/2706] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:49:46 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:49:46.548434 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-41f15eaf-6e87-42ce-9113-0c58fa404278 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:49:46.550036 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-41f15eaf-6e87-42ce-9113-0c58fa404278 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:49:46.556877 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-41f15eaf-6e87-42ce-9113-0c58fa404278 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:49:46.557326 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-41f15eaf-6e87-42ce-9113-0c58fa404278 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:49:46.558087 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-41f15eaf-6e87-42ce-9113-0c58fa404278 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:49:46.558548 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-41f15eaf-6e87-42ce-9113-0c58fa404278 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:49:46.646914 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-41f15eaf-6e87-42ce-9113-0c58fa404278 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "POST /compute/v2.1/servers/cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2/action" status: 200 len: 38222 microversion: 2.1 time: 0.102304 Nov 01 01:49:46.647471 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1308/2707] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Nov 1 01:49:46 2021] POST /compute/v2.1/servers/cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2/action => generated 38222 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 01 01:49:47.477625 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-9d6c86f9-b228-47be-bdf6-773fb16277ab tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:49:47.478225 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-9d6c86f9-b228-47be-bdf6-773fb16277ab tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:49:47.484471 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9d6c86f9-b228-47be-bdf6-773fb16277ab tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:49:47.484910 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9d6c86f9-b228-47be-bdf6-773fb16277ab tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:49:47.485655 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9d6c86f9-b228-47be-bdf6-773fb16277ab tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:49:47.486075 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9d6c86f9-b228-47be-bdf6-773fb16277ab tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:49:47.544068 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-9d6c86f9-b228-47be-bdf6-773fb16277ab tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:49:47.552369 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-9d6c86f9-b228-47be-bdf6-773fb16277ab tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.078386 Nov 01 01:49:47.552926 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1400/2708] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:49:47 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:49:47.659741 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-2e14bb58-90ca-47eb-a149-b76a2e6a2ba6 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:49:47.660642 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-2e14bb58-90ca-47eb-a149-b76a2e6a2ba6 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:49:47.667362 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2e14bb58-90ca-47eb-a149-b76a2e6a2ba6 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:49:47.667802 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2e14bb58-90ca-47eb-a149-b76a2e6a2ba6 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:49:47.668552 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2e14bb58-90ca-47eb-a149-b76a2e6a2ba6 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:49:47.669011 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2e14bb58-90ca-47eb-a149-b76a2e6a2ba6 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:49:47.758435 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-2e14bb58-90ca-47eb-a149-b76a2e6a2ba6 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "POST /compute/v2.1/servers/cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2/action" status: 200 len: 38234 microversion: 2.1 time: 0.103219 Nov 01 01:49:47.759066 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1309/2709] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Nov 1 01:49:47 2021] POST /compute/v2.1/servers/cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2/action => generated 38234 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 01 01:49:48.569233 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-4d45332c-681d-48d9-80e4-2ed30118314a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:49:48.569862 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-4d45332c-681d-48d9-80e4-2ed30118314a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:49:48.576060 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4d45332c-681d-48d9-80e4-2ed30118314a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:49:48.576500 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4d45332c-681d-48d9-80e4-2ed30118314a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:49:48.577240 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4d45332c-681d-48d9-80e4-2ed30118314a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:49:48.577662 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4d45332c-681d-48d9-80e4-2ed30118314a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:49:48.635174 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-4d45332c-681d-48d9-80e4-2ed30118314a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:49:48.642975 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-4d45332c-681d-48d9-80e4-2ed30118314a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.077850 Nov 01 01:49:48.643528 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1401/2710] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:49:48 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:49:48.773540 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-cb9a77dd-935e-4bde-b919-789c4da2b87c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:49:48.775899 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-cb9a77dd-935e-4bde-b919-789c4da2b87c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:49:48.784211 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-cb9a77dd-935e-4bde-b919-789c4da2b87c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:49:48.784664 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-cb9a77dd-935e-4bde-b919-789c4da2b87c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:49:48.785447 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-cb9a77dd-935e-4bde-b919-789c4da2b87c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:49:48.785878 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-cb9a77dd-935e-4bde-b919-789c4da2b87c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:49:48.900257 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-cb9a77dd-935e-4bde-b919-789c4da2b87c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "POST /compute/v2.1/servers/cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2/action" status: 200 len: 38353 microversion: 2.1 time: 0.133291 Nov 01 01:49:48.900817 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1310/2711] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Nov 1 01:49:48 2021] POST /compute/v2.1/servers/cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2/action => generated 38353 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 01 01:49:48.910895 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-b0d6247e-8c27-477a-a8d0-7f8676813092 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:49:48.911382 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-b0d6247e-8c27-477a-a8d0-7f8676813092 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:49:48.917162 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b0d6247e-8c27-477a-a8d0-7f8676813092 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:49:48.917758 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b0d6247e-8c27-477a-a8d0-7f8676813092 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:49:48.918530 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b0d6247e-8c27-477a-a8d0-7f8676813092 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:49:48.918955 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b0d6247e-8c27-477a-a8d0-7f8676813092 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:49:48.942092 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-b0d6247e-8c27-477a-a8d0-7f8676813092 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2/ips" status: 200 len: 145 microversion: 2.1 time: 0.035398 Nov 01 01:49:48.942671 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1402/2712] 10.222.0.47 () {58 vars in 1247 bytes} [Mon Nov 1 01:49:48 2021] GET /compute/v2.1/servers/cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2/ips => generated 145 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:49:49.659966 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-ac55791a-bca0-4906-b839-292d8c5f517f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:49:49.660626 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-ac55791a-bca0-4906-b839-292d8c5f517f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:49:49.667407 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ac55791a-bca0-4906-b839-292d8c5f517f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:49:49.667855 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ac55791a-bca0-4906-b839-292d8c5f517f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:49:49.668608 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ac55791a-bca0-4906-b839-292d8c5f517f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:49:49.669068 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ac55791a-bca0-4906-b839-292d8c5f517f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:49:49.732787 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-ac55791a-bca0-4906-b839-292d8c5f517f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:49:49.740975 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-ac55791a-bca0-4906-b839-292d8c5f517f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.085153 Nov 01 01:49:49.741533 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1311/2713] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:49:49 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:49:50.756829 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-f48bc975-e278-4be7-9ff3-4ee7a913be4f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:49:50.757410 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-f48bc975-e278-4be7-9ff3-4ee7a913be4f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:49:50.763539 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f48bc975-e278-4be7-9ff3-4ee7a913be4f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:49:50.763977 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f48bc975-e278-4be7-9ff3-4ee7a913be4f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:49:50.764722 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f48bc975-e278-4be7-9ff3-4ee7a913be4f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:49:50.765144 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f48bc975-e278-4be7-9ff3-4ee7a913be4f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:49:50.825820 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-f48bc975-e278-4be7-9ff3-4ee7a913be4f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:49:50.833984 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-f48bc975-e278-4be7-9ff3-4ee7a913be4f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.080745 Nov 01 01:49:50.834562 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1403/2714] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:49:50 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:49:51.850554 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-3cec1e72-f4c4-4417-8037-33fb88c04f73 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:49:51.851152 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-3cec1e72-f4c4-4417-8037-33fb88c04f73 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:49:51.857356 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3cec1e72-f4c4-4417-8037-33fb88c04f73 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:49:51.857797 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3cec1e72-f4c4-4417-8037-33fb88c04f73 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:49:51.858574 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3cec1e72-f4c4-4417-8037-33fb88c04f73 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:49:51.859002 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3cec1e72-f4c4-4417-8037-33fb88c04f73 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:49:51.916814 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-3cec1e72-f4c4-4417-8037-33fb88c04f73 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:49:51.924417 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-3cec1e72-f4c4-4417-8037-33fb88c04f73 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.077475 Nov 01 01:49:51.924979 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1312/2715] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:49:51 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:49:52.941353 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-6f585e41-15e4-4e99-bad0-f3116f6a4216 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:49:52.941956 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-6f585e41-15e4-4e99-bad0-f3116f6a4216 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:49:52.948267 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-6f585e41-15e4-4e99-bad0-f3116f6a4216 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:49:52.948731 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-6f585e41-15e4-4e99-bad0-f3116f6a4216 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:49:52.949476 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-6f585e41-15e4-4e99-bad0-f3116f6a4216 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:49:52.949898 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-6f585e41-15e4-4e99-bad0-f3116f6a4216 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:49:53.009685 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-6f585e41-15e4-4e99-bad0-f3116f6a4216 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:49:53.017573 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-6f585e41-15e4-4e99-bad0-f3116f6a4216 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.079788 Nov 01 01:49:53.018720 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1404/2716] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:49:52 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:49:54.035104 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-318d6fe8-204b-4464-9f1f-1c95cded04fb tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:49:54.035744 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-318d6fe8-204b-4464-9f1f-1c95cded04fb tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:49:54.041940 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-318d6fe8-204b-4464-9f1f-1c95cded04fb tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:49:54.042386 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-318d6fe8-204b-4464-9f1f-1c95cded04fb tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:49:54.043301 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-318d6fe8-204b-4464-9f1f-1c95cded04fb tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:49:54.043732 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-318d6fe8-204b-4464-9f1f-1c95cded04fb tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:49:54.101939 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-318d6fe8-204b-4464-9f1f-1c95cded04fb tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:49:54.109670 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-318d6fe8-204b-4464-9f1f-1c95cded04fb tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.078725 Nov 01 01:49:54.110224 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1313/2717] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:49:54 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:49:55.127064 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-fcc7730a-e053-4ffd-89a2-6e551ef142cc tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:49:55.127622 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-fcc7730a-e053-4ffd-89a2-6e551ef142cc tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:49:55.134810 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-fcc7730a-e053-4ffd-89a2-6e551ef142cc tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:49:55.135258 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-fcc7730a-e053-4ffd-89a2-6e551ef142cc tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:49:55.136007 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-fcc7730a-e053-4ffd-89a2-6e551ef142cc tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:49:55.136426 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-fcc7730a-e053-4ffd-89a2-6e551ef142cc tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:49:55.196017 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-fcc7730a-e053-4ffd-89a2-6e551ef142cc tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:49:55.203765 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-fcc7730a-e053-4ffd-89a2-6e551ef142cc tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.080523 Nov 01 01:49:55.204324 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1405/2718] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:49:55 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:49:56.220273 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-9d77320d-60d4-4886-a890-11b29e32bf7d tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:49:56.220908 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-9d77320d-60d4-4886-a890-11b29e32bf7d tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:49:56.227645 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9d77320d-60d4-4886-a890-11b29e32bf7d tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:49:56.228086 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9d77320d-60d4-4886-a890-11b29e32bf7d tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:49:56.228839 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9d77320d-60d4-4886-a890-11b29e32bf7d tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:49:56.229267 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9d77320d-60d4-4886-a890-11b29e32bf7d tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:49:56.289716 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-9d77320d-60d4-4886-a890-11b29e32bf7d tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:49:56.297304 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-9d77320d-60d4-4886-a890-11b29e32bf7d tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.080704 Nov 01 01:49:56.297866 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1314/2719] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:49:56 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:49:57.314507 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-80dd3abe-bfba-4814-92e0-b66c9783bcdb tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:49:57.315113 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-80dd3abe-bfba-4814-92e0-b66c9783bcdb tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:49:57.321837 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-80dd3abe-bfba-4814-92e0-b66c9783bcdb tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:49:57.322280 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-80dd3abe-bfba-4814-92e0-b66c9783bcdb tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:49:57.323076 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-80dd3abe-bfba-4814-92e0-b66c9783bcdb tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:49:57.323499 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-80dd3abe-bfba-4814-92e0-b66c9783bcdb tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:49:57.382202 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-80dd3abe-bfba-4814-92e0-b66c9783bcdb tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:49:57.389944 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-80dd3abe-bfba-4814-92e0-b66c9783bcdb tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.079348 Nov 01 01:49:57.390529 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1406/2720] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:49:57 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:49:58.406969 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-19e36e35-b464-4385-b6e1-008ac5eaf250 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:49:58.407642 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-19e36e35-b464-4385-b6e1-008ac5eaf250 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:49:58.414526 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-19e36e35-b464-4385-b6e1-008ac5eaf250 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:49:58.414970 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-19e36e35-b464-4385-b6e1-008ac5eaf250 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:49:58.415727 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-19e36e35-b464-4385-b6e1-008ac5eaf250 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:49:58.416155 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-19e36e35-b464-4385-b6e1-008ac5eaf250 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:49:58.474137 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-19e36e35-b464-4385-b6e1-008ac5eaf250 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:49:58.481717 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-19e36e35-b464-4385-b6e1-008ac5eaf250 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.078414 Nov 01 01:49:58.482272 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1315/2721] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:49:58 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:49:59.498108 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-00c05ed1-99cc-48a6-bd7d-2bfa545eb690 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:49:59.498755 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-00c05ed1-99cc-48a6-bd7d-2bfa545eb690 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:49:59.504986 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-00c05ed1-99cc-48a6-bd7d-2bfa545eb690 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:49:59.505427 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-00c05ed1-99cc-48a6-bd7d-2bfa545eb690 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:49:59.506177 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-00c05ed1-99cc-48a6-bd7d-2bfa545eb690 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:49:59.506642 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-00c05ed1-99cc-48a6-bd7d-2bfa545eb690 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:49:59.564700 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-00c05ed1-99cc-48a6-bd7d-2bfa545eb690 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:49:59.572677 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-00c05ed1-99cc-48a6-bd7d-2bfa545eb690 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.078235 Nov 01 01:49:59.573240 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1407/2722] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:49:59 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:50:00.589168 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-237c6d04-76cc-4db1-8a2b-ce2e11d157d8 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:50:00.589767 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-237c6d04-76cc-4db1-8a2b-ce2e11d157d8 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:50:00.596116 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-237c6d04-76cc-4db1-8a2b-ce2e11d157d8 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:50:00.596526 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-237c6d04-76cc-4db1-8a2b-ce2e11d157d8 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:50:00.597292 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-237c6d04-76cc-4db1-8a2b-ce2e11d157d8 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:50:00.597722 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-237c6d04-76cc-4db1-8a2b-ce2e11d157d8 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:50:00.657639 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-237c6d04-76cc-4db1-8a2b-ce2e11d157d8 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:50:00.665805 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-237c6d04-76cc-4db1-8a2b-ce2e11d157d8 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.080304 Nov 01 01:50:00.666383 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1316/2723] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:50:00 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:50:01.682753 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-7cee8fd4-4199-4f25-b357-0f5b402d8766 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:50:01.683354 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-7cee8fd4-4199-4f25-b357-0f5b402d8766 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:50:01.690560 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-7cee8fd4-4199-4f25-b357-0f5b402d8766 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:50:01.691812 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-7cee8fd4-4199-4f25-b357-0f5b402d8766 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:50:01.691953 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-7cee8fd4-4199-4f25-b357-0f5b402d8766 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:50:01.692303 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-7cee8fd4-4199-4f25-b357-0f5b402d8766 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:50:01.749995 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-7cee8fd4-4199-4f25-b357-0f5b402d8766 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:50:01.758453 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-7cee8fd4-4199-4f25-b357-0f5b402d8766 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.079279 Nov 01 01:50:01.759023 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1408/2724] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:50:01 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:50:02.774977 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-f33fe7de-258e-413a-8912-231bb5cee52d tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:50:02.775590 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-f33fe7de-258e-413a-8912-231bb5cee52d tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:50:02.781710 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f33fe7de-258e-413a-8912-231bb5cee52d tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:50:02.782150 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f33fe7de-258e-413a-8912-231bb5cee52d tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:50:02.782933 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f33fe7de-258e-413a-8912-231bb5cee52d tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:50:02.783358 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f33fe7de-258e-413a-8912-231bb5cee52d tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:50:02.845402 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-f33fe7de-258e-413a-8912-231bb5cee52d tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:50:02.853628 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-f33fe7de-258e-413a-8912-231bb5cee52d tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.082316 Nov 01 01:50:02.854183 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1317/2725] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:50:02 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:50:03.870244 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-b4ca561c-898a-46ba-959b-0045f727e16c tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:50:03.870877 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-b4ca561c-898a-46ba-959b-0045f727e16c tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:50:03.877124 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b4ca561c-898a-46ba-959b-0045f727e16c tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:50:03.877573 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b4ca561c-898a-46ba-959b-0045f727e16c tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:50:03.880570 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b4ca561c-898a-46ba-959b-0045f727e16c tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:50:03.880570 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b4ca561c-898a-46ba-959b-0045f727e16c tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:50:03.937781 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-b4ca561c-898a-46ba-959b-0045f727e16c tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:50:03.945532 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-b4ca561c-898a-46ba-959b-0045f727e16c tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.079067 Nov 01 01:50:03.946093 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1409/2726] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:50:03 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:50:04.961943 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-3f50b70a-8d59-4151-909a-78e98e07d214 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:50:04.962554 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-3f50b70a-8d59-4151-909a-78e98e07d214 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:50:04.968813 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3f50b70a-8d59-4151-909a-78e98e07d214 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:50:04.969252 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3f50b70a-8d59-4151-909a-78e98e07d214 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:50:04.970006 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3f50b70a-8d59-4151-909a-78e98e07d214 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:50:04.970444 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3f50b70a-8d59-4151-909a-78e98e07d214 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:50:05.028155 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-3f50b70a-8d59-4151-909a-78e98e07d214 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:50:05.035716 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-3f50b70a-8d59-4151-909a-78e98e07d214 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.077379 Nov 01 01:50:05.036275 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1318/2727] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:50:04 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:50:06.051821 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-37597333-4513-484b-be46-6737549b544b tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:50:06.052988 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-37597333-4513-484b-be46-6737549b544b tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:50:06.059236 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-37597333-4513-484b-be46-6737549b544b tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:50:06.059679 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-37597333-4513-484b-be46-6737549b544b tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:50:06.060432 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-37597333-4513-484b-be46-6737549b544b tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:50:06.060859 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-37597333-4513-484b-be46-6737549b544b tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:50:06.120868 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-37597333-4513-484b-be46-6737549b544b tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:50:06.129051 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-37597333-4513-484b-be46-6737549b544b tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.080858 Nov 01 01:50:06.129616 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1410/2728] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:50:06 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:50:07.145338 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-4c9df0b9-e020-4a19-8fe4-58cc0b45b3ef tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:50:07.145889 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-4c9df0b9-e020-4a19-8fe4-58cc0b45b3ef tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:50:07.152060 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4c9df0b9-e020-4a19-8fe4-58cc0b45b3ef tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:50:07.152500 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4c9df0b9-e020-4a19-8fe4-58cc0b45b3ef tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:50:07.153244 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4c9df0b9-e020-4a19-8fe4-58cc0b45b3ef tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:50:07.153666 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4c9df0b9-e020-4a19-8fe4-58cc0b45b3ef tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:50:07.211711 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-4c9df0b9-e020-4a19-8fe4-58cc0b45b3ef tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:50:07.219381 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-4c9df0b9-e020-4a19-8fe4-58cc0b45b3ef tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.078265 Nov 01 01:50:07.219938 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1319/2729] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:50:07 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:50:08.236420 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-6034db2e-5a68-483b-b720-5286647eda6e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:50:08.237095 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-6034db2e-5a68-483b-b720-5286647eda6e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:50:08.243753 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-6034db2e-5a68-483b-b720-5286647eda6e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:50:08.244184 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-6034db2e-5a68-483b-b720-5286647eda6e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:50:08.244927 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-6034db2e-5a68-483b-b720-5286647eda6e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:50:08.245346 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-6034db2e-5a68-483b-b720-5286647eda6e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:50:08.302869 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-6034db2e-5a68-483b-b720-5286647eda6e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:50:08.310348 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-6034db2e-5a68-483b-b720-5286647eda6e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.077597 Nov 01 01:50:08.310937 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1411/2730] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:50:08 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:50:09.327228 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-a1f24e08-5e50-4ae7-9570-8b411279a2b2 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:50:09.327825 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-a1f24e08-5e50-4ae7-9570-8b411279a2b2 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:50:09.334570 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a1f24e08-5e50-4ae7-9570-8b411279a2b2 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:50:09.335015 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a1f24e08-5e50-4ae7-9570-8b411279a2b2 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:50:09.335770 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a1f24e08-5e50-4ae7-9570-8b411279a2b2 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:50:09.336199 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a1f24e08-5e50-4ae7-9570-8b411279a2b2 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:50:09.397281 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-a1f24e08-5e50-4ae7-9570-8b411279a2b2 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:50:09.404907 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-a1f24e08-5e50-4ae7-9570-8b411279a2b2 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.081364 Nov 01 01:50:09.405465 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1320/2731] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:50:09 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:50:10.421434 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-61f02d69-d835-43a2-aa7e-4be69beec0f7 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:50:10.422031 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-61f02d69-d835-43a2-aa7e-4be69beec0f7 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:50:10.428872 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-61f02d69-d835-43a2-aa7e-4be69beec0f7 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:50:10.429308 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-61f02d69-d835-43a2-aa7e-4be69beec0f7 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:50:10.430046 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-61f02d69-d835-43a2-aa7e-4be69beec0f7 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:50:10.430496 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-61f02d69-d835-43a2-aa7e-4be69beec0f7 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:50:10.487886 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-61f02d69-d835-43a2-aa7e-4be69beec0f7 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:50:10.496200 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-61f02d69-d835-43a2-aa7e-4be69beec0f7 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.078401 Nov 01 01:50:10.496756 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1412/2732] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:50:10 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:50:11.513264 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-f2f83d29-a37a-49a3-9277-d898ec876bcc tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:50:11.513853 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-f2f83d29-a37a-49a3-9277-d898ec876bcc tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:50:11.520622 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f2f83d29-a37a-49a3-9277-d898ec876bcc tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:50:11.521064 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f2f83d29-a37a-49a3-9277-d898ec876bcc tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:50:11.521813 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f2f83d29-a37a-49a3-9277-d898ec876bcc tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:50:11.522237 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f2f83d29-a37a-49a3-9277-d898ec876bcc tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:50:11.580165 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-f2f83d29-a37a-49a3-9277-d898ec876bcc tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:50:11.588225 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-f2f83d29-a37a-49a3-9277-d898ec876bcc tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.078676 Nov 01 01:50:11.588779 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1321/2733] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:50:11 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:50:12.604848 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-0bee152a-403e-4561-8eb1-bcbfc6c1ec46 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:50:12.605454 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-0bee152a-403e-4561-8eb1-bcbfc6c1ec46 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:50:12.611728 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0bee152a-403e-4561-8eb1-bcbfc6c1ec46 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:50:12.612170 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0bee152a-403e-4561-8eb1-bcbfc6c1ec46 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:50:12.612919 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0bee152a-403e-4561-8eb1-bcbfc6c1ec46 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:50:12.613340 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0bee152a-403e-4561-8eb1-bcbfc6c1ec46 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:50:12.671281 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-0bee152a-403e-4561-8eb1-bcbfc6c1ec46 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:50:12.679449 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-0bee152a-403e-4561-8eb1-bcbfc6c1ec46 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.078325 Nov 01 01:50:12.680013 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1413/2734] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:50:12 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:50:13.696129 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-740db69c-a34a-45ed-8cf8-c8a084a781da tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:50:13.696762 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-740db69c-a34a-45ed-8cf8-c8a084a781da tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:50:13.702930 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-740db69c-a34a-45ed-8cf8-c8a084a781da tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:50:13.703365 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-740db69c-a34a-45ed-8cf8-c8a084a781da tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:50:13.704112 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-740db69c-a34a-45ed-8cf8-c8a084a781da tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:50:13.704669 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-740db69c-a34a-45ed-8cf8-c8a084a781da tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:50:13.764115 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-740db69c-a34a-45ed-8cf8-c8a084a781da tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:50:13.772511 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-740db69c-a34a-45ed-8cf8-c8a084a781da tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.080020 Nov 01 01:50:13.773068 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1322/2735] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:50:13 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:50:14.788707 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-5d6a24d5-841d-4ad6-885c-d44f05e559d7 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:50:14.789307 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-5d6a24d5-841d-4ad6-885c-d44f05e559d7 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:50:14.795609 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-5d6a24d5-841d-4ad6-885c-d44f05e559d7 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:50:14.796043 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-5d6a24d5-841d-4ad6-885c-d44f05e559d7 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:50:14.796786 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-5d6a24d5-841d-4ad6-885c-d44f05e559d7 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:50:14.797205 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-5d6a24d5-841d-4ad6-885c-d44f05e559d7 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:50:14.860090 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-5d6a24d5-841d-4ad6-885c-d44f05e559d7 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:50:14.868398 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-5d6a24d5-841d-4ad6-885c-d44f05e559d7 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.083340 Nov 01 01:50:14.868956 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1414/2736] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:50:14 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:50:15.885423 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-08943692-ac15-452b-b460-ccef69185499 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:50:15.886011 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-08943692-ac15-452b-b460-ccef69185499 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:50:15.892254 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-08943692-ac15-452b-b460-ccef69185499 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:50:15.892694 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-08943692-ac15-452b-b460-ccef69185499 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:50:15.893447 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-08943692-ac15-452b-b460-ccef69185499 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:50:15.893876 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-08943692-ac15-452b-b460-ccef69185499 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:50:15.954487 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-08943692-ac15-452b-b460-ccef69185499 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:50:15.962761 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-08943692-ac15-452b-b460-ccef69185499 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.080963 Nov 01 01:50:15.963311 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1323/2737] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:50:15 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:50:16.979633 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-236cb9c6-614b-4891-90ba-8033d2a7c8b7 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:50:16.980244 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-236cb9c6-614b-4891-90ba-8033d2a7c8b7 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:50:16.986485 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-236cb9c6-614b-4891-90ba-8033d2a7c8b7 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:50:16.986971 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-236cb9c6-614b-4891-90ba-8033d2a7c8b7 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:50:16.987720 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-236cb9c6-614b-4891-90ba-8033d2a7c8b7 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:50:16.988141 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-236cb9c6-614b-4891-90ba-8033d2a7c8b7 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:50:17.046337 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-236cb9c6-614b-4891-90ba-8033d2a7c8b7 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:50:17.054115 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-236cb9c6-614b-4891-90ba-8033d2a7c8b7 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.078192 Nov 01 01:50:17.054709 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1415/2738] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:50:16 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:50:18.070933 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-539bbc89-c1b0-4a2e-961c-eb98ae796041 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:50:18.071562 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-539bbc89-c1b0-4a2e-961c-eb98ae796041 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:50:18.079799 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-539bbc89-c1b0-4a2e-961c-eb98ae796041 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:50:18.080321 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-539bbc89-c1b0-4a2e-961c-eb98ae796041 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:50:18.081277 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-539bbc89-c1b0-4a2e-961c-eb98ae796041 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:50:18.081709 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-539bbc89-c1b0-4a2e-961c-eb98ae796041 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:50:18.146273 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-539bbc89-c1b0-4a2e-961c-eb98ae796041 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:50:18.154189 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-539bbc89-c1b0-4a2e-961c-eb98ae796041 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.086862 Nov 01 01:50:18.154814 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1324/2739] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:50:18 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:50:19.171355 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-3cf5ad46-caff-4071-b35c-67459e0c9901 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:50:19.171889 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-3cf5ad46-caff-4071-b35c-67459e0c9901 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:50:19.178576 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3cf5ad46-caff-4071-b35c-67459e0c9901 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:50:19.179016 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3cf5ad46-caff-4071-b35c-67459e0c9901 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:50:19.179762 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3cf5ad46-caff-4071-b35c-67459e0c9901 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:50:19.180181 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3cf5ad46-caff-4071-b35c-67459e0c9901 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:50:19.244314 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-3cf5ad46-caff-4071-b35c-67459e0c9901 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:50:19.252099 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-3cf5ad46-caff-4071-b35c-67459e0c9901 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.084500 Nov 01 01:50:19.252664 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1416/2740] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:50:19 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:50:20.269310 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-496028a6-2801-46f3-9b96-0d599786e614 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:50:20.269933 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-496028a6-2801-46f3-9b96-0d599786e614 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:50:20.276107 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-496028a6-2801-46f3-9b96-0d599786e614 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:50:20.276542 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-496028a6-2801-46f3-9b96-0d599786e614 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:50:20.277288 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-496028a6-2801-46f3-9b96-0d599786e614 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:50:20.277712 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-496028a6-2801-46f3-9b96-0d599786e614 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:50:20.335944 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-496028a6-2801-46f3-9b96-0d599786e614 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:50:20.343558 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-496028a6-2801-46f3-9b96-0d599786e614 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.077900 Nov 01 01:50:20.344119 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1325/2741] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:50:20 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:50:21.360637 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-45a9373d-70f0-4251-9495-b36d99476333 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:50:21.361253 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-45a9373d-70f0-4251-9495-b36d99476333 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:50:21.367540 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-45a9373d-70f0-4251-9495-b36d99476333 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:50:21.367986 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-45a9373d-70f0-4251-9495-b36d99476333 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:50:21.368747 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-45a9373d-70f0-4251-9495-b36d99476333 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:50:21.369175 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-45a9373d-70f0-4251-9495-b36d99476333 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:50:21.427421 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-45a9373d-70f0-4251-9495-b36d99476333 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:50:21.435009 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-45a9373d-70f0-4251-9495-b36d99476333 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.078050 Nov 01 01:50:21.435568 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1417/2742] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:50:21 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:50:22.451784 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-c59b5542-2d29-49ee-8606-4184fc4c6a0f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:50:22.452388 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-c59b5542-2d29-49ee-8606-4184fc4c6a0f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:50:22.458724 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c59b5542-2d29-49ee-8606-4184fc4c6a0f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:50:22.459165 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c59b5542-2d29-49ee-8606-4184fc4c6a0f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:50:22.459911 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c59b5542-2d29-49ee-8606-4184fc4c6a0f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:50:22.460363 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c59b5542-2d29-49ee-8606-4184fc4c6a0f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:50:22.521118 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-c59b5542-2d29-49ee-8606-4184fc4c6a0f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:50:22.528615 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-c59b5542-2d29-49ee-8606-4184fc4c6a0f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.080472 Nov 01 01:50:22.529170 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1326/2743] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:50:22 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:50:23.545279 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-40f19400-17db-44f6-982a-ef800cfccd60 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:50:23.545881 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-40f19400-17db-44f6-982a-ef800cfccd60 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:50:23.552664 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-40f19400-17db-44f6-982a-ef800cfccd60 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:50:23.553103 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-40f19400-17db-44f6-982a-ef800cfccd60 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:50:23.553847 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-40f19400-17db-44f6-982a-ef800cfccd60 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:50:23.554269 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-40f19400-17db-44f6-982a-ef800cfccd60 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:50:23.611881 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-40f19400-17db-44f6-982a-ef800cfccd60 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:50:23.620071 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-40f19400-17db-44f6-982a-ef800cfccd60 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.078456 Nov 01 01:50:23.620568 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1418/2744] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:50:23 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:50:24.637257 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-397f0358-50e8-40c7-a4ba-8fcf4622f40a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:50:24.637785 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-397f0358-50e8-40c7-a4ba-8fcf4622f40a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:50:24.644036 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-397f0358-50e8-40c7-a4ba-8fcf4622f40a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:50:24.645107 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-397f0358-50e8-40c7-a4ba-8fcf4622f40a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:50:24.645874 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-397f0358-50e8-40c7-a4ba-8fcf4622f40a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:50:24.646307 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-397f0358-50e8-40c7-a4ba-8fcf4622f40a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:50:24.703987 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-397f0358-50e8-40c7-a4ba-8fcf4622f40a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:50:24.712365 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-397f0358-50e8-40c7-a4ba-8fcf4622f40a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.078934 Nov 01 01:50:24.712931 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1327/2745] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:50:24 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:50:25.729198 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-ef83b656-c9ab-4b51-8bad-3adeda9c01ed tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:50:25.729781 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-ef83b656-c9ab-4b51-8bad-3adeda9c01ed tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:50:25.735583 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ef83b656-c9ab-4b51-8bad-3adeda9c01ed tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:50:25.736024 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ef83b656-c9ab-4b51-8bad-3adeda9c01ed tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:50:25.736768 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ef83b656-c9ab-4b51-8bad-3adeda9c01ed tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:50:25.737191 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ef83b656-c9ab-4b51-8bad-3adeda9c01ed tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:50:25.796716 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-ef83b656-c9ab-4b51-8bad-3adeda9c01ed tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:50:25.804475 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-ef83b656-c9ab-4b51-8bad-3adeda9c01ed tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.079081 Nov 01 01:50:25.805045 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1419/2746] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:50:25 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:50:26.821320 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-f31c4858-7d1a-4456-9dc7-b72ddb469231 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:50:26.821919 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-f31c4858-7d1a-4456-9dc7-b72ddb469231 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:50:26.827840 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f31c4858-7d1a-4456-9dc7-b72ddb469231 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:50:26.828282 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f31c4858-7d1a-4456-9dc7-b72ddb469231 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:50:26.829058 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f31c4858-7d1a-4456-9dc7-b72ddb469231 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:50:26.829482 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f31c4858-7d1a-4456-9dc7-b72ddb469231 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:50:26.896259 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-f31c4858-7d1a-4456-9dc7-b72ddb469231 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:50:26.904203 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-f31c4858-7d1a-4456-9dc7-b72ddb469231 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.086507 Nov 01 01:50:26.904763 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1328/2747] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:50:26 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:50:27.921160 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-a4ea72a7-f6b9-4c30-b822-517e13a6585f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:50:27.921768 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-a4ea72a7-f6b9-4c30-b822-517e13a6585f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:50:27.928168 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a4ea72a7-f6b9-4c30-b822-517e13a6585f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:50:27.928620 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a4ea72a7-f6b9-4c30-b822-517e13a6585f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:50:27.929379 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a4ea72a7-f6b9-4c30-b822-517e13a6585f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:50:27.929813 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a4ea72a7-f6b9-4c30-b822-517e13a6585f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:50:27.992494 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-a4ea72a7-f6b9-4c30-b822-517e13a6585f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:50:28.000245 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-a4ea72a7-f6b9-4c30-b822-517e13a6585f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.082729 Nov 01 01:50:28.000815 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1420/2748] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:50:27 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:50:29.016797 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-6bab4cee-b124-4047-98c9-774414f5e92c tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:50:29.017400 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-6bab4cee-b124-4047-98c9-774414f5e92c tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:50:29.024138 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6bab4cee-b124-4047-98c9-774414f5e92c tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:50:29.024583 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6bab4cee-b124-4047-98c9-774414f5e92c tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:50:29.025335 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6bab4cee-b124-4047-98c9-774414f5e92c tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:50:29.025772 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6bab4cee-b124-4047-98c9-774414f5e92c tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:50:29.085806 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-6bab4cee-b124-4047-98c9-774414f5e92c tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:50:29.093442 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-6bab4cee-b124-4047-98c9-774414f5e92c tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.080312 Nov 01 01:50:29.094004 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1329/2749] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:50:29 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:50:30.111028 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-bc4d202c-27d7-4193-8e3b-40dc439f86b7 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:50:30.111632 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-bc4d202c-27d7-4193-8e3b-40dc439f86b7 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:50:30.118525 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-bc4d202c-27d7-4193-8e3b-40dc439f86b7 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:50:30.118965 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-bc4d202c-27d7-4193-8e3b-40dc439f86b7 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:50:30.119706 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-bc4d202c-27d7-4193-8e3b-40dc439f86b7 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:50:30.120125 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-bc4d202c-27d7-4193-8e3b-40dc439f86b7 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:50:30.178439 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-bc4d202c-27d7-4193-8e3b-40dc439f86b7 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:50:30.186415 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-bc4d202c-27d7-4193-8e3b-40dc439f86b7 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.079227 Nov 01 01:50:30.186993 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1421/2750] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:50:30 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:50:31.202917 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-c0b2542d-1497-4e09-bb54-d044d8f3a40c tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:50:31.203525 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-c0b2542d-1497-4e09-bb54-d044d8f3a40c tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:50:31.209908 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c0b2542d-1497-4e09-bb54-d044d8f3a40c tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:50:31.210354 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c0b2542d-1497-4e09-bb54-d044d8f3a40c tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:50:31.211138 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c0b2542d-1497-4e09-bb54-d044d8f3a40c tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:50:31.211568 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c0b2542d-1497-4e09-bb54-d044d8f3a40c tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:50:31.269129 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-c0b2542d-1497-4e09-bb54-d044d8f3a40c tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:50:31.282723 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-c0b2542d-1497-4e09-bb54-d044d8f3a40c tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.083384 Nov 01 01:50:31.283289 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1330/2751] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:50:31 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:50:32.299237 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-2c984f5f-3ebe-4b5a-b83f-1f51bc5204ea tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:50:32.299826 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-2c984f5f-3ebe-4b5a-b83f-1f51bc5204ea tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:50:32.306727 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-2c984f5f-3ebe-4b5a-b83f-1f51bc5204ea tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:50:32.307166 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-2c984f5f-3ebe-4b5a-b83f-1f51bc5204ea tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:50:32.307909 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-2c984f5f-3ebe-4b5a-b83f-1f51bc5204ea tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:50:32.308329 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-2c984f5f-3ebe-4b5a-b83f-1f51bc5204ea tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:50:32.367083 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-2c984f5f-3ebe-4b5a-b83f-1f51bc5204ea tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:50:32.374466 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-2c984f5f-3ebe-4b5a-b83f-1f51bc5204ea tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.078851 Nov 01 01:50:32.375025 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1422/2752] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:50:32 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:50:33.390777 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-dcf876c4-448e-48ed-8f70-f251df7817c2 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:50:33.391384 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-dcf876c4-448e-48ed-8f70-f251df7817c2 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:50:33.398128 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-dcf876c4-448e-48ed-8f70-f251df7817c2 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:50:33.398611 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-dcf876c4-448e-48ed-8f70-f251df7817c2 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:50:33.399374 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-dcf876c4-448e-48ed-8f70-f251df7817c2 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:50:33.399803 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-dcf876c4-448e-48ed-8f70-f251df7817c2 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:50:33.458595 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-dcf876c4-448e-48ed-8f70-f251df7817c2 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:50:33.466109 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-dcf876c4-448e-48ed-8f70-f251df7817c2 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.079023 Nov 01 01:50:33.466762 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1331/2753] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:50:33 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:50:34.483635 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-de391cc0-8abb-449a-9f73-b2bfd8b468ca tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:50:34.484230 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-de391cc0-8abb-449a-9f73-b2bfd8b468ca tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:50:34.491121 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-de391cc0-8abb-449a-9f73-b2bfd8b468ca tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:50:34.491559 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-de391cc0-8abb-449a-9f73-b2bfd8b468ca tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:50:34.492305 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-de391cc0-8abb-449a-9f73-b2bfd8b468ca tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:50:34.492729 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-de391cc0-8abb-449a-9f73-b2bfd8b468ca tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:50:34.555565 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-de391cc0-8abb-449a-9f73-b2bfd8b468ca tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:50:34.563540 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-de391cc0-8abb-449a-9f73-b2bfd8b468ca tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.083590 Nov 01 01:50:34.564103 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1423/2754] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:50:34 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:50:35.579893 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-aca6c11c-8d37-4781-8934-2c78240c84c8 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:50:35.580526 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-aca6c11c-8d37-4781-8934-2c78240c84c8 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:50:35.587394 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-aca6c11c-8d37-4781-8934-2c78240c84c8 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:50:35.587778 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-aca6c11c-8d37-4781-8934-2c78240c84c8 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:50:35.588525 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-aca6c11c-8d37-4781-8934-2c78240c84c8 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:50:35.588949 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-aca6c11c-8d37-4781-8934-2c78240c84c8 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:50:35.650357 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-aca6c11c-8d37-4781-8934-2c78240c84c8 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:50:35.658011 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-aca6c11c-8d37-4781-8934-2c78240c84c8 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.081756 Nov 01 01:50:35.658584 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1332/2755] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:50:35 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:50:36.674464 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-cd26d565-a384-4959-a9ae-54bcec181cdb tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:50:36.675594 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-cd26d565-a384-4959-a9ae-54bcec181cdb tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:50:36.681827 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-cd26d565-a384-4959-a9ae-54bcec181cdb tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:50:36.682280 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-cd26d565-a384-4959-a9ae-54bcec181cdb tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:50:36.683052 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-cd26d565-a384-4959-a9ae-54bcec181cdb tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:50:36.683474 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-cd26d565-a384-4959-a9ae-54bcec181cdb tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:50:36.906080 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-cd26d565-a384-4959-a9ae-54bcec181cdb tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:50:36.914248 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-cd26d565-a384-4959-a9ae-54bcec181cdb tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.243509 Nov 01 01:50:36.914828 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1424/2756] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:50:36 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:50:37.931148 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-8c08ea73-f9f1-4e86-9142-f655508c628b tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:50:37.931760 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-8c08ea73-f9f1-4e86-9142-f655508c628b tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:50:37.938267 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8c08ea73-f9f1-4e86-9142-f655508c628b tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:50:37.938746 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8c08ea73-f9f1-4e86-9142-f655508c628b tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:50:37.939506 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8c08ea73-f9f1-4e86-9142-f655508c628b tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:50:37.939939 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8c08ea73-f9f1-4e86-9142-f655508c628b tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:50:37.998251 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-8c08ea73-f9f1-4e86-9142-f655508c628b tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:50:38.006132 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-8c08ea73-f9f1-4e86-9142-f655508c628b tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.078688 Nov 01 01:50:38.006734 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1333/2757] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:50:37 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:50:39.023276 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-5ca40d5d-13be-472f-9669-ec1c5fac07de tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:50:39.023895 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-5ca40d5d-13be-472f-9669-ec1c5fac07de tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:50:39.030039 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-5ca40d5d-13be-472f-9669-ec1c5fac07de tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:50:39.030523 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-5ca40d5d-13be-472f-9669-ec1c5fac07de tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:50:39.031277 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-5ca40d5d-13be-472f-9669-ec1c5fac07de tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:50:39.031705 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-5ca40d5d-13be-472f-9669-ec1c5fac07de tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:50:39.089533 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-5ca40d5d-13be-472f-9669-ec1c5fac07de tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:50:39.097620 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-5ca40d5d-13be-472f-9669-ec1c5fac07de tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.078002 Nov 01 01:50:39.098270 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1425/2758] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:50:39 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:50:40.114049 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-371cbcbb-9990-4b98-a18f-a081bd71cc66 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:50:40.114682 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-371cbcbb-9990-4b98-a18f-a081bd71cc66 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:50:40.121564 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-371cbcbb-9990-4b98-a18f-a081bd71cc66 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:50:40.122020 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-371cbcbb-9990-4b98-a18f-a081bd71cc66 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:50:40.122825 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-371cbcbb-9990-4b98-a18f-a081bd71cc66 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:50:40.123256 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-371cbcbb-9990-4b98-a18f-a081bd71cc66 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:50:40.180966 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-371cbcbb-9990-4b98-a18f-a081bd71cc66 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:50:40.188856 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-371cbcbb-9990-4b98-a18f-a081bd71cc66 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.078461 Nov 01 01:50:40.189425 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1334/2759] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:50:40 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:50:41.205323 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-1f8b3b00-8a80-4fc4-ac2c-6e13349fab7a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:50:41.205925 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-1f8b3b00-8a80-4fc4-ac2c-6e13349fab7a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:50:41.212146 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-1f8b3b00-8a80-4fc4-ac2c-6e13349fab7a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:50:41.212585 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-1f8b3b00-8a80-4fc4-ac2c-6e13349fab7a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:50:41.213335 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-1f8b3b00-8a80-4fc4-ac2c-6e13349fab7a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:50:41.213759 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-1f8b3b00-8a80-4fc4-ac2c-6e13349fab7a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:50:41.274676 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-1f8b3b00-8a80-4fc4-ac2c-6e13349fab7a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:50:41.282240 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-1f8b3b00-8a80-4fc4-ac2c-6e13349fab7a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.080532 Nov 01 01:50:41.282813 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1426/2760] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:50:41 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:50:42.299427 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-8b53c3dd-84aa-4081-a0eb-714424430b63 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:50:42.300484 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-8b53c3dd-84aa-4081-a0eb-714424430b63 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:50:42.306702 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8b53c3dd-84aa-4081-a0eb-714424430b63 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:50:42.307144 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8b53c3dd-84aa-4081-a0eb-714424430b63 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:50:42.307896 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8b53c3dd-84aa-4081-a0eb-714424430b63 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:50:42.308318 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8b53c3dd-84aa-4081-a0eb-714424430b63 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:50:42.368478 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-8b53c3dd-84aa-4081-a0eb-714424430b63 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:50:42.376076 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-8b53c3dd-84aa-4081-a0eb-714424430b63 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.080353 Nov 01 01:50:42.376630 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1335/2761] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:50:42 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:50:43.392954 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-03c40d1d-3a1a-4ea2-b9e8-d293e60a0bfd tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:50:43.394163 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-03c40d1d-3a1a-4ea2-b9e8-d293e60a0bfd tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:50:43.400570 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-03c40d1d-3a1a-4ea2-b9e8-d293e60a0bfd tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:50:43.401007 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-03c40d1d-3a1a-4ea2-b9e8-d293e60a0bfd tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:50:43.401750 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-03c40d1d-3a1a-4ea2-b9e8-d293e60a0bfd tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:50:43.402171 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-03c40d1d-3a1a-4ea2-b9e8-d293e60a0bfd tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:50:43.459916 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-03c40d1d-3a1a-4ea2-b9e8-d293e60a0bfd tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:50:43.467426 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-03c40d1d-3a1a-4ea2-b9e8-d293e60a0bfd tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.078263 Nov 01 01:50:43.467976 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1427/2762] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:50:43 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:50:44.483757 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-6d44a0de-299d-4ec6-8b5f-6de17cbb5545 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:50:44.484360 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-6d44a0de-299d-4ec6-8b5f-6de17cbb5545 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:50:44.490575 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6d44a0de-299d-4ec6-8b5f-6de17cbb5545 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:50:44.491015 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6d44a0de-299d-4ec6-8b5f-6de17cbb5545 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:50:44.491769 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6d44a0de-299d-4ec6-8b5f-6de17cbb5545 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:50:44.492193 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6d44a0de-299d-4ec6-8b5f-6de17cbb5545 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:50:44.551343 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-6d44a0de-299d-4ec6-8b5f-6de17cbb5545 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:50:44.558870 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-6d44a0de-299d-4ec6-8b5f-6de17cbb5545 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.078683 Nov 01 01:50:44.559426 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1336/2763] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:50:44 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:50:45.575483 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-ec56a309-eaab-4de8-8244-e1ee35c14b24 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:50:45.576135 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-ec56a309-eaab-4de8-8244-e1ee35c14b24 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:50:45.582589 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ec56a309-eaab-4de8-8244-e1ee35c14b24 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:50:45.583034 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ec56a309-eaab-4de8-8244-e1ee35c14b24 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:50:45.583793 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ec56a309-eaab-4de8-8244-e1ee35c14b24 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:50:45.584224 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ec56a309-eaab-4de8-8244-e1ee35c14b24 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:50:45.642335 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-ec56a309-eaab-4de8-8244-e1ee35c14b24 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:50:45.649803 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-ec56a309-eaab-4de8-8244-e1ee35c14b24 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.077929 Nov 01 01:50:45.650357 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1428/2764] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:50:45 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:50:46.666766 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-f187c40b-33e5-4f3d-9035-ead643aac299 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:50:46.667299 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-f187c40b-33e5-4f3d-9035-ead643aac299 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:50:46.673468 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f187c40b-33e5-4f3d-9035-ead643aac299 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:50:46.673917 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f187c40b-33e5-4f3d-9035-ead643aac299 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:50:46.674709 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f187c40b-33e5-4f3d-9035-ead643aac299 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:50:46.675141 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f187c40b-33e5-4f3d-9035-ead643aac299 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:50:46.735553 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-f187c40b-33e5-4f3d-9035-ead643aac299 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:50:46.743645 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-f187c40b-33e5-4f3d-9035-ead643aac299 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.080596 Nov 01 01:50:46.744215 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1337/2765] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:50:46 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:50:47.759560 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-9a541c4d-1c6e-4d7e-a258-2331fe9a1607 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:50:47.760168 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-9a541c4d-1c6e-4d7e-a258-2331fe9a1607 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:50:47.766312 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9a541c4d-1c6e-4d7e-a258-2331fe9a1607 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:50:47.766779 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9a541c4d-1c6e-4d7e-a258-2331fe9a1607 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:50:47.767525 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9a541c4d-1c6e-4d7e-a258-2331fe9a1607 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:50:47.767952 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9a541c4d-1c6e-4d7e-a258-2331fe9a1607 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:50:47.829180 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-9a541c4d-1c6e-4d7e-a258-2331fe9a1607 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:50:47.837329 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-9a541c4d-1c6e-4d7e-a258-2331fe9a1607 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.081453 Nov 01 01:50:47.837885 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1429/2766] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:50:47 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:50:48.854215 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-c96b82f3-990b-4051-93f3-745fdf88b962 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:50:48.854852 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-c96b82f3-990b-4051-93f3-745fdf88b962 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:50:48.861266 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c96b82f3-990b-4051-93f3-745fdf88b962 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:50:48.861716 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c96b82f3-990b-4051-93f3-745fdf88b962 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:50:48.862498 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c96b82f3-990b-4051-93f3-745fdf88b962 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:50:48.862929 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c96b82f3-990b-4051-93f3-745fdf88b962 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:50:48.920821 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-c96b82f3-990b-4051-93f3-745fdf88b962 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:50:48.929038 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-c96b82f3-990b-4051-93f3-745fdf88b962 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.078456 Nov 01 01:50:48.929604 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1338/2767] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:50:48 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:50:49.026974 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-aee4702d-a66f-45c3-b63a-3f997771d12e tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:50:49.027519 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-aee4702d-a66f-45c3-b63a-3f997771d12e tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:50:49.033687 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-aee4702d-a66f-45c3-b63a-3f997771d12e tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:50:49.034133 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-aee4702d-a66f-45c3-b63a-3f997771d12e tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:50:49.034922 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-aee4702d-a66f-45c3-b63a-3f997771d12e tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:50:49.035357 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-aee4702d-a66f-45c3-b63a-3f997771d12e tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:50:49.061378 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-aee4702d-a66f-45c3-b63a-3f997771d12e tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2] Going to try to terminate instance {{(pid=116267) delete /opt/stack/nova/nova/compute/api.py:2612}} Nov 01 01:50:49.340144 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-aee4702d-a66f-45c3-b63a-3f997771d12e tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "DELETE /compute/v2.1/servers/cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2" status: 204 len: 0 microversion: 2.1 time: 0.316444 Nov 01 01:50:49.340655 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1430/2768] 10.222.0.47 () {58 vars in 1238 bytes} [Mon Nov 1 01:50:49 2021] DELETE /compute/v2.1/servers/cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 01 01:50:49.349351 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-3e7f823d-eaa1-4892-b889-eb7e110e3fbe tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:50:49.349956 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-3e7f823d-eaa1-4892-b889-eb7e110e3fbe tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:50:49.355870 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3e7f823d-eaa1-4892-b889-eb7e110e3fbe tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:50:49.356315 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3e7f823d-eaa1-4892-b889-eb7e110e3fbe tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:50:49.357068 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3e7f823d-eaa1-4892-b889-eb7e110e3fbe tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:50:49.357498 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3e7f823d-eaa1-4892-b889-eb7e110e3fbe tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:50:49.484217 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-3e7f823d-eaa1-4892-b889-eb7e110e3fbe tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:50:49.492083 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-3e7f823d-eaa1-4892-b889-eb7e110e3fbe tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2" status: 200 len: 1673 microversion: 2.1 time: 0.146939 Nov 01 01:50:49.492655 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1339/2769] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:50:49 2021] GET /compute/v2.1/servers/cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2 => generated 1673 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:50:49.952923 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-de88d4a2-5756-4aec-be86-0e298fbca374 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:50:49.953624 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-de88d4a2-5756-4aec-be86-0e298fbca374 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:50:49.959908 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-de88d4a2-5756-4aec-be86-0e298fbca374 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:50:49.960357 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-de88d4a2-5756-4aec-be86-0e298fbca374 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:50:49.961121 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-de88d4a2-5756-4aec-be86-0e298fbca374 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:50:49.961556 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-de88d4a2-5756-4aec-be86-0e298fbca374 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:50:50.020676 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-de88d4a2-5756-4aec-be86-0e298fbca374 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:50:50.028461 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-de88d4a2-5756-4aec-be86-0e298fbca374 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.079481 Nov 01 01:50:50.029055 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1431/2770] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:50:49 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:50:50.509785 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-3602d196-2518-4dae-9e64-7cba13868cbf tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:50:50.510413 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-3602d196-2518-4dae-9e64-7cba13868cbf tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:50:50.516967 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3602d196-2518-4dae-9e64-7cba13868cbf tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:50:50.517409 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3602d196-2518-4dae-9e64-7cba13868cbf tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:50:50.518164 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3602d196-2518-4dae-9e64-7cba13868cbf tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:50:50.518633 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3602d196-2518-4dae-9e64-7cba13868cbf tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:50:50.876175 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-3602d196-2518-4dae-9e64-7cba13868cbf tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:50:50.883933 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-3602d196-2518-4dae-9e64-7cba13868cbf tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2" status: 200 len: 1673 microversion: 2.1 time: 0.377796 Nov 01 01:50:50.884493 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1340/2771] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:50:50 2021] GET /compute/v2.1/servers/cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2 => generated 1673 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:50:51.046897 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-92bf5340-4bb2-46e8-9b8d-5e0407eb00ef tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:50:51.047497 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-92bf5340-4bb2-46e8-9b8d-5e0407eb00ef tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:50:51.053796 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-92bf5340-4bb2-46e8-9b8d-5e0407eb00ef tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:50:51.054236 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-92bf5340-4bb2-46e8-9b8d-5e0407eb00ef tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:50:51.055012 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-92bf5340-4bb2-46e8-9b8d-5e0407eb00ef tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:50:51.055443 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-92bf5340-4bb2-46e8-9b8d-5e0407eb00ef tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:50:51.114485 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-92bf5340-4bb2-46e8-9b8d-5e0407eb00ef tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:50:51.122019 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-92bf5340-4bb2-46e8-9b8d-5e0407eb00ef tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.078735 Nov 01 01:50:51.122595 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1432/2772] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:50:51 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:50:51.900764 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-e7803561-ad1e-4a1a-a39f-f9ff09b06dc3 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:50:51.901375 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-e7803561-ad1e-4a1a-a39f-f9ff09b06dc3 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:50:51.907550 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e7803561-ad1e-4a1a-a39f-f9ff09b06dc3 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:50:51.907996 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e7803561-ad1e-4a1a-a39f-f9ff09b06dc3 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:50:51.908756 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e7803561-ad1e-4a1a-a39f-f9ff09b06dc3 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:50:51.909185 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e7803561-ad1e-4a1a-a39f-f9ff09b06dc3 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:50:51.968593 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-e7803561-ad1e-4a1a-a39f-f9ff09b06dc3 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:50:51.976588 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-e7803561-ad1e-4a1a-a39f-f9ff09b06dc3 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2" status: 200 len: 1605 microversion: 2.1 time: 0.079510 Nov 01 01:50:51.977159 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1341/2773] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:50:51 2021] GET /compute/v2.1/servers/cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2 => generated 1605 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:50:52.107166 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [req-8a05c21c-2073-4c20-9373-7e3400ebd006 req-904c441a-379e-4bca-bd34-5dcab28c0649 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2", "name": "network-vif-deleted", "tag": "b2cc207f-c8a8-4129-a643-c3aa803178eb"}]} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:50:52.108687 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 01 01:50:52.108687 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: warnings.warn(msg) Nov 01 01:50:52.116755 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [req-8a05c21c-2073-4c20-9373-7e3400ebd006 req-904c441a-379e-4bca-bd34-5dcab28c0649 service nova] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:50:52.117477 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [req-8a05c21c-2073-4c20-9373-7e3400ebd006 req-904c441a-379e-4bca-bd34-5dcab28c0649 service nova] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:50:52.133481 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.compute.server_external_events [req-8a05c21c-2073-4c20-9373-7e3400ebd006 req-904c441a-379e-4bca-bd34-5dcab28c0649 service nova] Creating event network-vif-deleted:b2cc207f-c8a8-4129-a643-c3aa803178eb for instance cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2 on hv-cinder-81561 Nov 01 01:50:52.139198 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [req-8a05c21c-2073-4c20-9373-7e3400ebd006 req-904c441a-379e-4bca-bd34-5dcab28c0649 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085483 Nov 01 01:50:52.139749 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-9b8b3c06-c707-4c6d-ba50-25b54a881469 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:50:52.140356 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-9b8b3c06-c707-4c6d-ba50-25b54a881469 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:50:52.144835 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1433/2774] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Nov 1 01:50:52 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:50:52.146868 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9b8b3c06-c707-4c6d-ba50-25b54a881469 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:50:52.149336 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9b8b3c06-c707-4c6d-ba50-25b54a881469 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:50:52.149336 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9b8b3c06-c707-4c6d-ba50-25b54a881469 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:50:52.149336 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9b8b3c06-c707-4c6d-ba50-25b54a881469 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:50:52.217412 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-9b8b3c06-c707-4c6d-ba50-25b54a881469 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:50:52.226524 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-9b8b3c06-c707-4c6d-ba50-25b54a881469 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.091737 Nov 01 01:50:52.236742 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1342/2775] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:50:52 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:50:52.994617 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-83f9ab07-c695-47b8-8e20-820fd00e19dd tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:50:52.997535 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-83f9ab07-c695-47b8-8e20-820fd00e19dd tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:50:53.004967 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-83f9ab07-c695-47b8-8e20-820fd00e19dd tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:50:53.005421 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-83f9ab07-c695-47b8-8e20-820fd00e19dd tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:50:53.006212 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-83f9ab07-c695-47b8-8e20-820fd00e19dd tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:50:53.006758 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-83f9ab07-c695-47b8-8e20-820fd00e19dd tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:50:53.039172 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-83f9ab07-c695-47b8-8e20-820fd00e19dd tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:50:53.039694 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-83f9ab07-c695-47b8-8e20-820fd00e19dd tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:50:53.040123 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.objects.instance [None req-83f9ab07-c695-47b8-8e20-820fd00e19dd tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lazy-loading 'fault' on Instance uuid cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2 {{(pid=116267) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 01 01:50:53.081834 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-83f9ab07-c695-47b8-8e20-820fd00e19dd tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246b28121cd749e68ba1686e16dad852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8cb991f4a4056af85fd3f9a387727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:50:53.092278 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-83f9ab07-c695-47b8-8e20-820fd00e19dd tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2" status: 200 len: 1327 microversion: 2.1 time: 0.101328 Nov 01 01:50:53.093161 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1434/2776] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:50:52 2021] GET /compute/v2.1/servers/cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2 => generated 1327 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:50:53.244134 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-ddf803d4-7a9f-4dfe-b80c-76922ab716bd tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:50:53.244733 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-ddf803d4-7a9f-4dfe-b80c-76922ab716bd tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:50:53.251088 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ddf803d4-7a9f-4dfe-b80c-76922ab716bd tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:50:53.251540 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ddf803d4-7a9f-4dfe-b80c-76922ab716bd tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:50:53.252304 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ddf803d4-7a9f-4dfe-b80c-76922ab716bd tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:50:53.252735 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ddf803d4-7a9f-4dfe-b80c-76922ab716bd tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:50:53.315338 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-ddf803d4-7a9f-4dfe-b80c-76922ab716bd tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:50:53.322939 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-ddf803d4-7a9f-4dfe-b80c-76922ab716bd tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.082531 Nov 01 01:50:53.323504 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1343/2777] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:50:53 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:50:54.109335 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-ad2ad99d-6bfb-44d4-823f-448b03281fec tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:50:54.109939 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-ad2ad99d-6bfb-44d4-823f-448b03281fec tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:50:54.117040 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ad2ad99d-6bfb-44d4-823f-448b03281fec tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:50:54.117481 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ad2ad99d-6bfb-44d4-823f-448b03281fec tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:50:54.118230 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ad2ad99d-6bfb-44d4-823f-448b03281fec tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:50:54.118679 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ad2ad99d-6bfb-44d4-823f-448b03281fec tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:50:54.131699 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.wsgi [None req-ad2ad99d-6bfb-44d4-823f-448b03281fec tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] HTTP exception thrown: Instance cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2 could not be found. Nov 01 01:50:54.132320 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-ad2ad99d-6bfb-44d4-823f-448b03281fec tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Returning 404 to user: Instance cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2 could not be found. {{(pid=116267) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 01 01:50:54.133123 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-ad2ad99d-6bfb-44d4-823f-448b03281fec tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2" status: 404 len: 111 microversion: 2.1 time: 0.027817 Nov 01 01:50:54.133639 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1435/2778] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:50:54 2021] GET /compute/v2.1/servers/cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 01:50:54.141784 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-f7a3d218-86ee-4f78-856b-8d5272cdc117 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '.version_select at 0x7fccf6b91b80>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:50:54.238674 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-f7a3d218-86ee-4f78-856b-8d5272cdc117 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-594478628" status: 202 len: 0 microversion: 2.1 time: 0.100515 Nov 01 01:50:54.239232 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1344/2779] 10.222.0.47 () {58 vars in 1217 bytes} [Mon Nov 1 01:50:54 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-594478628 => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 01 01:50:54.339291 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-16d3badc-13ab-415a-8745-6a9f8b179e05 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:50:54.339931 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-16d3badc-13ab-415a-8745-6a9f8b179e05 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:50:54.345790 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-16d3badc-13ab-415a-8745-6a9f8b179e05 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:50:54.346247 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-16d3badc-13ab-415a-8745-6a9f8b179e05 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:50:54.347054 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-16d3badc-13ab-415a-8745-6a9f8b179e05 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:50:54.347486 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-16d3badc-13ab-415a-8745-6a9f8b179e05 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:50:54.406994 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-16d3badc-13ab-415a-8745-6a9f8b179e05 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:50:54.415187 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-16d3badc-13ab-415a-8745-6a9f8b179e05 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.079513 Nov 01 01:50:54.420113 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1436/2780] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:50:54 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:50:55.007939 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-c21716f5-8ddb-41a0-8798-a865f9f8252c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:50:55.008515 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-c21716f5-8ddb-41a0-8798-a865f9f8252c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:50:55.014416 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c21716f5-8ddb-41a0-8798-a865f9f8252c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:50:55.014888 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c21716f5-8ddb-41a0-8798-a865f9f8252c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:50:55.015641 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c21716f5-8ddb-41a0-8798-a865f9f8252c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:50:55.016068 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c21716f5-8ddb-41a0-8798-a865f9f8252c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:50:55.029320 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.wsgi [None req-c21716f5-8ddb-41a0-8798-a865f9f8252c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] HTTP exception thrown: Instance cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2 could not be found. Nov 01 01:50:55.029898 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-c21716f5-8ddb-41a0-8798-a865f9f8252c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Returning 404 to user: Instance cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2 could not be found. {{(pid=116266) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 01 01:50:55.030725 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-c21716f5-8ddb-41a0-8798-a865f9f8252c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "DELETE /compute/v2.1/servers/cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2" status: 404 len: 111 microversion: 2.1 time: 0.026984 Nov 01 01:50:55.031246 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1345/2781] 10.222.0.47 () {58 vars in 1238 bytes} [Mon Nov 1 01:50:55 2021] DELETE /compute/v2.1/servers/cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 01:50:55.039696 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-a7150670-68cd-4056-bc26-59035c275a4c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:50:55.040301 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-a7150670-68cd-4056-bc26-59035c275a4c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:50:55.046034 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a7150670-68cd-4056-bc26-59035c275a4c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:50:55.046500 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a7150670-68cd-4056-bc26-59035c275a4c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:50:55.047245 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a7150670-68cd-4056-bc26-59035c275a4c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:50:55.047675 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a7150670-68cd-4056-bc26-59035c275a4c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:50:55.062284 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.wsgi [None req-a7150670-68cd-4056-bc26-59035c275a4c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] HTTP exception thrown: Instance cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2 could not be found. Nov 01 01:50:55.062869 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-a7150670-68cd-4056-bc26-59035c275a4c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Returning 404 to user: Instance cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2 could not be found. {{(pid=116267) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 01 01:50:55.063659 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-a7150670-68cd-4056-bc26-59035c275a4c tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2" status: 404 len: 111 microversion: 2.1 time: 0.028341 Nov 01 01:50:55.064324 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1437/2782] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:50:55 2021] GET /compute/v2.1/servers/cb415e1e-d7a6-4435-8958-f2fe9e4aa6d2 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 01:50:55.431861 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-a6dc1091-5d82-4503-8f35-10b5637fbeaf tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:50:55.432458 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-a6dc1091-5d82-4503-8f35-10b5637fbeaf tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:50:55.438637 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a6dc1091-5d82-4503-8f35-10b5637fbeaf tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:50:55.439079 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a6dc1091-5d82-4503-8f35-10b5637fbeaf tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:50:55.439825 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a6dc1091-5d82-4503-8f35-10b5637fbeaf tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:50:55.440248 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a6dc1091-5d82-4503-8f35-10b5637fbeaf tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:50:55.498567 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-a6dc1091-5d82-4503-8f35-10b5637fbeaf tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:50:55.506650 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-a6dc1091-5d82-4503-8f35-10b5637fbeaf tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.078470 Nov 01 01:50:55.507204 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1346/2783] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:50:55 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:50:56.523682 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-ac7ec6d0-f785-407d-a2a0-fbf82cbaeaf5 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:50:56.524290 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-ac7ec6d0-f785-407d-a2a0-fbf82cbaeaf5 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:50:56.530246 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ac7ec6d0-f785-407d-a2a0-fbf82cbaeaf5 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:50:56.530728 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ac7ec6d0-f785-407d-a2a0-fbf82cbaeaf5 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:50:56.531563 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ac7ec6d0-f785-407d-a2a0-fbf82cbaeaf5 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:50:56.531988 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ac7ec6d0-f785-407d-a2a0-fbf82cbaeaf5 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:50:56.590857 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-ac7ec6d0-f785-407d-a2a0-fbf82cbaeaf5 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:50:56.598986 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-ac7ec6d0-f785-407d-a2a0-fbf82cbaeaf5 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.079805 Nov 01 01:50:56.599525 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1438/2784] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:50:56 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:50:57.615793 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-3b221dd2-0719-4f0a-8d01-47e9a8056d39 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:50:57.616432 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-3b221dd2-0719-4f0a-8d01-47e9a8056d39 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:50:57.622191 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3b221dd2-0719-4f0a-8d01-47e9a8056d39 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:50:57.622661 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3b221dd2-0719-4f0a-8d01-47e9a8056d39 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:50:57.623421 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3b221dd2-0719-4f0a-8d01-47e9a8056d39 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:50:57.623851 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3b221dd2-0719-4f0a-8d01-47e9a8056d39 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:50:57.687340 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-3b221dd2-0719-4f0a-8d01-47e9a8056d39 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:50:57.694988 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-3b221dd2-0719-4f0a-8d01-47e9a8056d39 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.083570 Nov 01 01:50:57.695551 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1347/2785] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:50:57 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:50:58.711212 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-7cd84237-0558-4d5c-bb05-1d7a81d11025 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:50:58.711816 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-7cd84237-0558-4d5c-bb05-1d7a81d11025 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:50:58.718188 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-7cd84237-0558-4d5c-bb05-1d7a81d11025 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:50:58.718652 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-7cd84237-0558-4d5c-bb05-1d7a81d11025 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:50:58.719401 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-7cd84237-0558-4d5c-bb05-1d7a81d11025 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:50:58.719822 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-7cd84237-0558-4d5c-bb05-1d7a81d11025 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:50:58.778086 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-7cd84237-0558-4d5c-bb05-1d7a81d11025 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:50:58.786242 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-7cd84237-0558-4d5c-bb05-1d7a81d11025 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.078632 Nov 01 01:50:58.786817 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1439/2786] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:50:58 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:50:59.802607 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-e36c0f2b-6706-43fa-a712-97120981004f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:50:59.803215 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-e36c0f2b-6706-43fa-a712-97120981004f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:50:59.809379 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e36c0f2b-6706-43fa-a712-97120981004f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:50:59.810077 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e36c0f2b-6706-43fa-a712-97120981004f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:50:59.810873 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e36c0f2b-6706-43fa-a712-97120981004f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:50:59.811289 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e36c0f2b-6706-43fa-a712-97120981004f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:50:59.870854 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-e36c0f2b-6706-43fa-a712-97120981004f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:50:59.878490 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-e36c0f2b-6706-43fa-a712-97120981004f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.080076 Nov 01 01:50:59.879057 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1348/2787] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:50:59 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:51:00.894280 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-c6f5dd0d-10e5-4efd-b64f-79532b933143 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:51:00.895491 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-c6f5dd0d-10e5-4efd-b64f-79532b933143 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:51:00.901645 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c6f5dd0d-10e5-4efd-b64f-79532b933143 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:51:00.902077 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c6f5dd0d-10e5-4efd-b64f-79532b933143 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:51:00.902854 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c6f5dd0d-10e5-4efd-b64f-79532b933143 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:51:00.903283 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c6f5dd0d-10e5-4efd-b64f-79532b933143 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:51:00.961269 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-c6f5dd0d-10e5-4efd-b64f-79532b933143 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:51:00.968855 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-c6f5dd0d-10e5-4efd-b64f-79532b933143 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.078216 Nov 01 01:51:00.969401 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1440/2788] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:51:00 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:51:01.985161 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-a5354ed0-ea9a-4198-96fb-f00eb88d647b tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:51:01.985715 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-a5354ed0-ea9a-4198-96fb-f00eb88d647b tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:51:01.992428 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a5354ed0-ea9a-4198-96fb-f00eb88d647b tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:51:01.992868 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a5354ed0-ea9a-4198-96fb-f00eb88d647b tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:51:01.993622 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a5354ed0-ea9a-4198-96fb-f00eb88d647b tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:51:01.994058 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a5354ed0-ea9a-4198-96fb-f00eb88d647b tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:51:02.052373 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-a5354ed0-ea9a-4198-96fb-f00eb88d647b tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:51:02.060272 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-a5354ed0-ea9a-4198-96fb-f00eb88d647b tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.079064 Nov 01 01:51:02.060825 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1349/2789] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:51:01 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:51:03.076982 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-c2f39ad8-8787-419b-8a3d-6d6158f437d6 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:51:03.077563 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-c2f39ad8-8787-419b-8a3d-6d6158f437d6 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:51:03.083704 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c2f39ad8-8787-419b-8a3d-6d6158f437d6 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:51:03.084142 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c2f39ad8-8787-419b-8a3d-6d6158f437d6 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:51:03.084891 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c2f39ad8-8787-419b-8a3d-6d6158f437d6 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:51:03.085318 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c2f39ad8-8787-419b-8a3d-6d6158f437d6 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:51:03.145037 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-c2f39ad8-8787-419b-8a3d-6d6158f437d6 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:51:03.151188 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-c2f39ad8-8787-419b-8a3d-6d6158f437d6 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.077933 Nov 01 01:51:03.151739 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1441/2790] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:51:03 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:51:04.168354 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-bdabf096-cdef-4cb5-8de1-bdad78aa3d07 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:51:04.168896 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-bdabf096-cdef-4cb5-8de1-bdad78aa3d07 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:51:04.175160 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-bdabf096-cdef-4cb5-8de1-bdad78aa3d07 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:51:04.175658 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-bdabf096-cdef-4cb5-8de1-bdad78aa3d07 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:51:04.176418 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-bdabf096-cdef-4cb5-8de1-bdad78aa3d07 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:51:04.176848 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-bdabf096-cdef-4cb5-8de1-bdad78aa3d07 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:51:04.238395 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-bdabf096-cdef-4cb5-8de1-bdad78aa3d07 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:51:04.246122 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-bdabf096-cdef-4cb5-8de1-bdad78aa3d07 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.081685 Nov 01 01:51:04.246786 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1350/2791] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:51:04 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:51:05.262735 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-3cb69913-60d8-4752-b837-30f21723cd4d tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:51:05.263328 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-3cb69913-60d8-4752-b837-30f21723cd4d tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:51:05.270117 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3cb69913-60d8-4752-b837-30f21723cd4d tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:51:05.270586 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3cb69913-60d8-4752-b837-30f21723cd4d tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:51:05.271348 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3cb69913-60d8-4752-b837-30f21723cd4d tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:51:05.271774 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3cb69913-60d8-4752-b837-30f21723cd4d tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:51:05.329402 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-3cb69913-60d8-4752-b837-30f21723cd4d tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:51:05.337805 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-3cb69913-60d8-4752-b837-30f21723cd4d tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.078654 Nov 01 01:51:05.338319 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1442/2792] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:51:05 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:51:06.354468 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-47639d5f-3309-4aff-8b32-3b1985e43670 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:51:06.355068 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-47639d5f-3309-4aff-8b32-3b1985e43670 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:51:06.361316 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-47639d5f-3309-4aff-8b32-3b1985e43670 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:51:06.361760 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-47639d5f-3309-4aff-8b32-3b1985e43670 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:51:06.362541 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-47639d5f-3309-4aff-8b32-3b1985e43670 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:51:06.362978 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-47639d5f-3309-4aff-8b32-3b1985e43670 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:51:06.420887 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-47639d5f-3309-4aff-8b32-3b1985e43670 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:51:06.428657 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-47639d5f-3309-4aff-8b32-3b1985e43670 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.077928 Nov 01 01:51:06.429224 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1351/2793] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:51:06 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:51:07.445838 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-1fffe4f7-f0dc-4335-bd9f-fb5a941ab91a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:51:07.446454 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-1fffe4f7-f0dc-4335-bd9f-fb5a941ab91a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:51:07.452909 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-1fffe4f7-f0dc-4335-bd9f-fb5a941ab91a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:51:07.453657 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-1fffe4f7-f0dc-4335-bd9f-fb5a941ab91a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:51:07.454499 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-1fffe4f7-f0dc-4335-bd9f-fb5a941ab91a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:51:07.454867 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-1fffe4f7-f0dc-4335-bd9f-fb5a941ab91a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:51:07.512617 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-1fffe4f7-f0dc-4335-bd9f-fb5a941ab91a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:51:07.520261 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-1fffe4f7-f0dc-4335-bd9f-fb5a941ab91a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.078131 Nov 01 01:51:07.520813 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1443/2794] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:51:07 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:51:08.536079 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-d801b144-2562-49b6-b89c-2f8eb0cdbba4 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:51:08.536715 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-d801b144-2562-49b6-b89c-2f8eb0cdbba4 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:51:08.542971 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d801b144-2562-49b6-b89c-2f8eb0cdbba4 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:51:08.543417 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d801b144-2562-49b6-b89c-2f8eb0cdbba4 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:51:08.544174 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d801b144-2562-49b6-b89c-2f8eb0cdbba4 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:51:08.544605 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d801b144-2562-49b6-b89c-2f8eb0cdbba4 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:51:08.603825 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-d801b144-2562-49b6-b89c-2f8eb0cdbba4 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:51:08.611438 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-d801b144-2562-49b6-b89c-2f8eb0cdbba4 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.079025 Nov 01 01:51:08.611997 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1352/2795] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:51:08 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:51:09.628993 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-ce401841-6242-4316-8a3e-c90587bb58da tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:51:09.629621 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-ce401841-6242-4316-8a3e-c90587bb58da tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:51:09.635741 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ce401841-6242-4316-8a3e-c90587bb58da tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:51:09.636182 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ce401841-6242-4316-8a3e-c90587bb58da tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:51:09.636937 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ce401841-6242-4316-8a3e-c90587bb58da tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:51:09.637362 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ce401841-6242-4316-8a3e-c90587bb58da tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:51:09.696530 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-ce401841-6242-4316-8a3e-c90587bb58da tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:51:09.704334 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-ce401841-6242-4316-8a3e-c90587bb58da tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.079606 Nov 01 01:51:09.704889 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1444/2796] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:51:09 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:51:10.721260 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-88c653b2-ae0a-44d6-b421-7c4fd7c192cf tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:51:10.721845 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-88c653b2-ae0a-44d6-b421-7c4fd7c192cf tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:51:10.728631 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-88c653b2-ae0a-44d6-b421-7c4fd7c192cf tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:51:10.729090 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-88c653b2-ae0a-44d6-b421-7c4fd7c192cf tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:51:10.729827 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-88c653b2-ae0a-44d6-b421-7c4fd7c192cf tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:51:10.730253 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-88c653b2-ae0a-44d6-b421-7c4fd7c192cf tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:51:10.792637 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-88c653b2-ae0a-44d6-b421-7c4fd7c192cf tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:51:10.800408 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-88c653b2-ae0a-44d6-b421-7c4fd7c192cf tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.082856 Nov 01 01:51:10.800961 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1353/2797] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:51:10 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:51:11.817896 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-ef3aa612-07a8-4939-a517-1f474150027c tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:51:11.818514 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-ef3aa612-07a8-4939-a517-1f474150027c tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:51:11.824795 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ef3aa612-07a8-4939-a517-1f474150027c tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:51:11.825233 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ef3aa612-07a8-4939-a517-1f474150027c tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:51:11.825981 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ef3aa612-07a8-4939-a517-1f474150027c tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:51:11.826405 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ef3aa612-07a8-4939-a517-1f474150027c tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:51:11.884690 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-ef3aa612-07a8-4939-a517-1f474150027c tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:51:11.892276 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-ef3aa612-07a8-4939-a517-1f474150027c tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.078705 Nov 01 01:51:11.892822 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1445/2798] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:51:11 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:51:12.908757 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-f5bc8b88-ce5c-4d2c-a7b5-786bca910f61 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:51:12.909343 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-f5bc8b88-ce5c-4d2c-a7b5-786bca910f61 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:51:12.915581 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f5bc8b88-ce5c-4d2c-a7b5-786bca910f61 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:51:12.916021 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f5bc8b88-ce5c-4d2c-a7b5-786bca910f61 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:51:12.916764 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f5bc8b88-ce5c-4d2c-a7b5-786bca910f61 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:51:12.917186 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f5bc8b88-ce5c-4d2c-a7b5-786bca910f61 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:51:12.975847 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-f5bc8b88-ce5c-4d2c-a7b5-786bca910f61 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:51:12.983505 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-f5bc8b88-ce5c-4d2c-a7b5-786bca910f61 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.078376 Nov 01 01:51:12.984063 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1354/2799] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:51:12 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:51:14.000364 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-1fb74ab5-8007-40bc-8e03-486da6b4ab02 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:51:14.000972 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-1fb74ab5-8007-40bc-8e03-486da6b4ab02 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:51:14.007843 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-1fb74ab5-8007-40bc-8e03-486da6b4ab02 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:51:14.008288 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-1fb74ab5-8007-40bc-8e03-486da6b4ab02 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:51:14.009039 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-1fb74ab5-8007-40bc-8e03-486da6b4ab02 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:51:14.009469 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-1fb74ab5-8007-40bc-8e03-486da6b4ab02 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:51:14.069065 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-1fb74ab5-8007-40bc-8e03-486da6b4ab02 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:51:14.076132 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-1fb74ab5-8007-40bc-8e03-486da6b4ab02 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.079436 Nov 01 01:51:14.076679 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1446/2800] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:51:13 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:51:15.091822 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-05c11ed7-3950-49dd-a1ee-6e98de4f0989 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:51:15.092345 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-05c11ed7-3950-49dd-a1ee-6e98de4f0989 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:51:15.099179 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-05c11ed7-3950-49dd-a1ee-6e98de4f0989 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:51:15.099618 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-05c11ed7-3950-49dd-a1ee-6e98de4f0989 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:51:15.100367 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-05c11ed7-3950-49dd-a1ee-6e98de4f0989 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:51:15.100790 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-05c11ed7-3950-49dd-a1ee-6e98de4f0989 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:51:15.158585 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-05c11ed7-3950-49dd-a1ee-6e98de4f0989 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:51:15.166674 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-05c11ed7-3950-49dd-a1ee-6e98de4f0989 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.078513 Nov 01 01:51:15.167437 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1355/2801] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:51:15 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:51:16.183820 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-07250d8a-3dd3-48e3-88b8-f05b116a32bf tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:51:16.184670 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-07250d8a-3dd3-48e3-88b8-f05b116a32bf tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:51:16.191498 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-07250d8a-3dd3-48e3-88b8-f05b116a32bf tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:51:16.191983 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-07250d8a-3dd3-48e3-88b8-f05b116a32bf tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:51:16.192729 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-07250d8a-3dd3-48e3-88b8-f05b116a32bf tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:51:16.193151 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-07250d8a-3dd3-48e3-88b8-f05b116a32bf tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:51:16.250261 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-07250d8a-3dd3-48e3-88b8-f05b116a32bf tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:51:16.258296 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-07250d8a-3dd3-48e3-88b8-f05b116a32bf tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.078129 Nov 01 01:51:16.258873 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1447/2802] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:51:16 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:51:17.275263 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-4f517cd1-30a5-49fe-999f-14a80809befa tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:51:17.275863 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-4f517cd1-30a5-49fe-999f-14a80809befa tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:51:17.282039 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4f517cd1-30a5-49fe-999f-14a80809befa tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:51:17.282506 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4f517cd1-30a5-49fe-999f-14a80809befa tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:51:17.283252 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4f517cd1-30a5-49fe-999f-14a80809befa tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:51:17.283681 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4f517cd1-30a5-49fe-999f-14a80809befa tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:51:17.345112 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-4f517cd1-30a5-49fe-999f-14a80809befa tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:51:17.353449 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-4f517cd1-30a5-49fe-999f-14a80809befa tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.081812 Nov 01 01:51:17.354002 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1356/2803] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:51:17 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:51:18.370699 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-49d5c1c4-84a0-4d55-9df6-59f5be776beb tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:51:18.371300 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-49d5c1c4-84a0-4d55-9df6-59f5be776beb tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:51:18.377446 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-49d5c1c4-84a0-4d55-9df6-59f5be776beb tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:51:18.377882 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-49d5c1c4-84a0-4d55-9df6-59f5be776beb tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:51:18.378670 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-49d5c1c4-84a0-4d55-9df6-59f5be776beb tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:51:18.379094 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-49d5c1c4-84a0-4d55-9df6-59f5be776beb tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:51:18.438444 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-49d5c1c4-84a0-4d55-9df6-59f5be776beb tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:51:18.446764 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-49d5c1c4-84a0-4d55-9df6-59f5be776beb tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.079735 Nov 01 01:51:18.447314 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1448/2804] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:51:18 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:51:19.463432 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-97e39d94-c0c2-4a8b-bb95-1ec03ffbc0a3 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:51:19.464035 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-97e39d94-c0c2-4a8b-bb95-1ec03ffbc0a3 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:51:19.470213 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-97e39d94-c0c2-4a8b-bb95-1ec03ffbc0a3 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:51:19.470686 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-97e39d94-c0c2-4a8b-bb95-1ec03ffbc0a3 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:51:19.471440 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-97e39d94-c0c2-4a8b-bb95-1ec03ffbc0a3 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:51:19.471914 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-97e39d94-c0c2-4a8b-bb95-1ec03ffbc0a3 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:51:19.531680 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-97e39d94-c0c2-4a8b-bb95-1ec03ffbc0a3 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:51:19.539277 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-97e39d94-c0c2-4a8b-bb95-1ec03ffbc0a3 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.079492 Nov 01 01:51:19.539832 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1357/2805] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:51:19 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:51:20.556377 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-25a018a3-3c94-4061-8e91-94d2917c4e8b tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:51:20.557016 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-25a018a3-3c94-4061-8e91-94d2917c4e8b tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:51:20.563499 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-25a018a3-3c94-4061-8e91-94d2917c4e8b tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:51:20.563944 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-25a018a3-3c94-4061-8e91-94d2917c4e8b tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:51:20.564696 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-25a018a3-3c94-4061-8e91-94d2917c4e8b tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:51:20.565122 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-25a018a3-3c94-4061-8e91-94d2917c4e8b tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:51:20.629830 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-25a018a3-3c94-4061-8e91-94d2917c4e8b tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:51:20.637483 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-25a018a3-3c94-4061-8e91-94d2917c4e8b tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.084795 Nov 01 01:51:20.638036 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1449/2806] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:51:20 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:51:21.654144 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-8a967f4a-8e85-4899-ba8a-34342da9d2aa tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:51:21.654736 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-8a967f4a-8e85-4899-ba8a-34342da9d2aa tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:51:21.660928 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8a967f4a-8e85-4899-ba8a-34342da9d2aa tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:51:21.661374 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8a967f4a-8e85-4899-ba8a-34342da9d2aa tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:51:21.662130 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8a967f4a-8e85-4899-ba8a-34342da9d2aa tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:51:21.662597 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8a967f4a-8e85-4899-ba8a-34342da9d2aa tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:51:21.722559 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-8a967f4a-8e85-4899-ba8a-34342da9d2aa tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:51:21.730129 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-8a967f4a-8e85-4899-ba8a-34342da9d2aa tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.079720 Nov 01 01:51:21.730725 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1358/2807] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:51:21 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:51:22.746496 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-3ccc9e0f-75a1-4821-ab3c-8eb9aa8c5819 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:51:22.747098 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-3ccc9e0f-75a1-4821-ab3c-8eb9aa8c5819 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:51:22.753242 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3ccc9e0f-75a1-4821-ab3c-8eb9aa8c5819 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:51:22.753700 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3ccc9e0f-75a1-4821-ab3c-8eb9aa8c5819 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:51:22.754458 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3ccc9e0f-75a1-4821-ab3c-8eb9aa8c5819 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:51:22.754887 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3ccc9e0f-75a1-4821-ab3c-8eb9aa8c5819 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:51:22.814711 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-3ccc9e0f-75a1-4821-ab3c-8eb9aa8c5819 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:51:22.822222 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-3ccc9e0f-75a1-4821-ab3c-8eb9aa8c5819 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.079405 Nov 01 01:51:22.822795 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1450/2808] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:51:22 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:51:23.839456 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-95f69f15-72dd-45f3-887b-cf15f15e6c19 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:51:23.840090 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-95f69f15-72dd-45f3-887b-cf15f15e6c19 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:51:23.846491 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-95f69f15-72dd-45f3-887b-cf15f15e6c19 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:51:23.846940 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-95f69f15-72dd-45f3-887b-cf15f15e6c19 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:51:23.848252 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-95f69f15-72dd-45f3-887b-cf15f15e6c19 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:51:23.848681 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-95f69f15-72dd-45f3-887b-cf15f15e6c19 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:51:23.911022 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-95f69f15-72dd-45f3-887b-cf15f15e6c19 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:51:23.918771 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-95f69f15-72dd-45f3-887b-cf15f15e6c19 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.082967 Nov 01 01:51:23.919329 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1359/2809] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:51:23 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:51:24.936172 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-f433d523-d99a-405d-9e5d-f364550462a9 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:51:24.936780 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-f433d523-d99a-405d-9e5d-f364550462a9 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:51:24.943728 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f433d523-d99a-405d-9e5d-f364550462a9 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:51:24.944176 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f433d523-d99a-405d-9e5d-f364550462a9 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:51:24.944930 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f433d523-d99a-405d-9e5d-f364550462a9 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:51:24.945358 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f433d523-d99a-405d-9e5d-f364550462a9 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:51:25.002400 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-f433d523-d99a-405d-9e5d-f364550462a9 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:51:25.010973 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-f433d523-d99a-405d-9e5d-f364550462a9 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.078652 Nov 01 01:51:25.011532 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1451/2810] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:51:24 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:51:26.027803 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-82453b1a-697c-496e-a9c8-1e62c3fbab59 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:51:26.028433 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-82453b1a-697c-496e-a9c8-1e62c3fbab59 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:51:26.034382 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-82453b1a-697c-496e-a9c8-1e62c3fbab59 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:51:26.034864 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-82453b1a-697c-496e-a9c8-1e62c3fbab59 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:51:26.035625 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-82453b1a-697c-496e-a9c8-1e62c3fbab59 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:51:26.036061 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-82453b1a-697c-496e-a9c8-1e62c3fbab59 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:51:26.094317 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-82453b1a-697c-496e-a9c8-1e62c3fbab59 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:51:26.102576 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-82453b1a-697c-496e-a9c8-1e62c3fbab59 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.078341 Nov 01 01:51:26.103142 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1360/2811] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:51:26 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:51:27.119796 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-792bd6f0-2455-45df-adf0-d4d881d234a6 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:51:27.120349 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-792bd6f0-2455-45df-adf0-d4d881d234a6 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:51:27.126164 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-792bd6f0-2455-45df-adf0-d4d881d234a6 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:51:27.126656 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-792bd6f0-2455-45df-adf0-d4d881d234a6 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:51:27.133417 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-792bd6f0-2455-45df-adf0-d4d881d234a6 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:51:27.133417 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-792bd6f0-2455-45df-adf0-d4d881d234a6 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:51:27.187272 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-792bd6f0-2455-45df-adf0-d4d881d234a6 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:51:27.195517 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-792bd6f0-2455-45df-adf0-d4d881d234a6 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.079656 Nov 01 01:51:27.196077 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1452/2812] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:51:27 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:51:28.212905 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-1d53b4d6-4c24-45f2-a27d-673ff82b16bf tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:51:28.213561 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-1d53b4d6-4c24-45f2-a27d-673ff82b16bf tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:51:28.219820 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1d53b4d6-4c24-45f2-a27d-673ff82b16bf tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:51:28.220258 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1d53b4d6-4c24-45f2-a27d-673ff82b16bf tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:51:28.221031 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1d53b4d6-4c24-45f2-a27d-673ff82b16bf tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:51:28.221437 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1d53b4d6-4c24-45f2-a27d-673ff82b16bf tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:51:28.279695 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-1d53b4d6-4c24-45f2-a27d-673ff82b16bf tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:51:28.287336 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-1d53b4d6-4c24-45f2-a27d-673ff82b16bf tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.078948 Nov 01 01:51:28.287889 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1361/2813] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:51:28 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:51:29.304030 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-e40ff79d-c062-4949-b2bb-642755128992 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:51:29.304658 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-e40ff79d-c062-4949-b2bb-642755128992 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:51:29.311417 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e40ff79d-c062-4949-b2bb-642755128992 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:51:29.311867 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e40ff79d-c062-4949-b2bb-642755128992 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:51:29.312627 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e40ff79d-c062-4949-b2bb-642755128992 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:51:29.313056 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e40ff79d-c062-4949-b2bb-642755128992 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:51:29.444614 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-e40ff79d-c062-4949-b2bb-642755128992 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:51:29.452270 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-e40ff79d-c062-4949-b2bb-642755128992 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.152470 Nov 01 01:51:29.452821 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1453/2814] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:51:29 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:51:30.468246 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-2648f128-1168-44af-aa68-c33aea40e99e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:51:30.468845 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-2648f128-1168-44af-aa68-c33aea40e99e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:51:30.475543 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2648f128-1168-44af-aa68-c33aea40e99e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:51:30.475980 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2648f128-1168-44af-aa68-c33aea40e99e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:51:30.476723 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2648f128-1168-44af-aa68-c33aea40e99e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:51:30.477149 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2648f128-1168-44af-aa68-c33aea40e99e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:51:30.538442 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-2648f128-1168-44af-aa68-c33aea40e99e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:51:30.546051 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-2648f128-1168-44af-aa68-c33aea40e99e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.081445 Nov 01 01:51:30.546624 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1362/2815] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:51:30 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:51:31.562982 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-fbb4dc08-d694-4eba-9910-e879cded2b51 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:51:31.563610 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-fbb4dc08-d694-4eba-9910-e879cded2b51 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:51:31.570250 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-fbb4dc08-d694-4eba-9910-e879cded2b51 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:51:31.570721 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-fbb4dc08-d694-4eba-9910-e879cded2b51 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:51:31.571467 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-fbb4dc08-d694-4eba-9910-e879cded2b51 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:51:31.571888 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-fbb4dc08-d694-4eba-9910-e879cded2b51 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:51:31.629518 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-fbb4dc08-d694-4eba-9910-e879cded2b51 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:51:31.637672 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-fbb4dc08-d694-4eba-9910-e879cded2b51 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.078372 Nov 01 01:51:31.638217 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1454/2816] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:51:31 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:51:32.654024 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-869d0fe6-2478-44a6-84a4-df3160c350b4 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:51:32.654580 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-869d0fe6-2478-44a6-84a4-df3160c350b4 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:51:32.660750 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-869d0fe6-2478-44a6-84a4-df3160c350b4 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:51:32.661193 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-869d0fe6-2478-44a6-84a4-df3160c350b4 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:51:32.661942 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-869d0fe6-2478-44a6-84a4-df3160c350b4 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:51:32.662409 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-869d0fe6-2478-44a6-84a4-df3160c350b4 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:51:32.722118 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-869d0fe6-2478-44a6-84a4-df3160c350b4 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:51:32.730852 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-869d0fe6-2478-44a6-84a4-df3160c350b4 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.080438 Nov 01 01:51:32.731432 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1363/2817] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:51:32 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:51:33.747545 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-1c4ab01c-49f7-4162-81fa-9f580e516eaf tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:51:33.748156 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-1c4ab01c-49f7-4162-81fa-9f580e516eaf tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:51:33.754386 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-1c4ab01c-49f7-4162-81fa-9f580e516eaf tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:51:33.754860 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-1c4ab01c-49f7-4162-81fa-9f580e516eaf tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:51:33.755617 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-1c4ab01c-49f7-4162-81fa-9f580e516eaf tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:51:33.756044 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-1c4ab01c-49f7-4162-81fa-9f580e516eaf tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:51:33.814715 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-1c4ab01c-49f7-4162-81fa-9f580e516eaf tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:51:33.822514 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-1c4ab01c-49f7-4162-81fa-9f580e516eaf tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.078576 Nov 01 01:51:33.823076 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1455/2818] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:51:33 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:51:34.839246 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-5e1af474-1392-47d0-9808-71fa28ec0cff tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:51:34.839857 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-5e1af474-1392-47d0-9808-71fa28ec0cff tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:51:34.846047 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5e1af474-1392-47d0-9808-71fa28ec0cff tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:51:34.846527 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5e1af474-1392-47d0-9808-71fa28ec0cff tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:51:34.847288 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5e1af474-1392-47d0-9808-71fa28ec0cff tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:51:34.847719 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5e1af474-1392-47d0-9808-71fa28ec0cff tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:51:34.905485 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-5e1af474-1392-47d0-9808-71fa28ec0cff tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:51:34.913247 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-5e1af474-1392-47d0-9808-71fa28ec0cff tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.077755 Nov 01 01:51:34.913807 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1364/2819] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:51:34 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:51:35.930299 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-35a8c146-ed47-4641-bf29-9cb4e7055346 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:51:35.930944 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-35a8c146-ed47-4641-bf29-9cb4e7055346 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:51:35.937465 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-35a8c146-ed47-4641-bf29-9cb4e7055346 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:51:35.937905 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-35a8c146-ed47-4641-bf29-9cb4e7055346 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:51:35.938676 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-35a8c146-ed47-4641-bf29-9cb4e7055346 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:51:35.939104 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-35a8c146-ed47-4641-bf29-9cb4e7055346 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:51:35.998149 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-35a8c146-ed47-4641-bf29-9cb4e7055346 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:51:36.005780 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-35a8c146-ed47-4641-bf29-9cb4e7055346 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.079789 Nov 01 01:51:36.006329 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1456/2820] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:51:35 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:51:37.024889 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-f1ac7a1c-8c64-459f-a80f-d3c87d01eb8b tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:51:37.025489 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-f1ac7a1c-8c64-459f-a80f-d3c87d01eb8b tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:51:37.035052 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f1ac7a1c-8c64-459f-a80f-d3c87d01eb8b tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:51:37.035498 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f1ac7a1c-8c64-459f-a80f-d3c87d01eb8b tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:51:37.036260 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f1ac7a1c-8c64-459f-a80f-d3c87d01eb8b tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:51:37.036689 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f1ac7a1c-8c64-459f-a80f-d3c87d01eb8b tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:51:37.107055 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-f1ac7a1c-8c64-459f-a80f-d3c87d01eb8b tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:51:37.114838 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-f1ac7a1c-8c64-459f-a80f-d3c87d01eb8b tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.094193 Nov 01 01:51:37.115398 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1365/2821] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:51:37 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:51:38.131342 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-2f1d0c81-7151-4291-8a87-d7d285adb2d0 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:51:38.131930 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-2f1d0c81-7151-4291-8a87-d7d285adb2d0 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:51:38.138292 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-2f1d0c81-7151-4291-8a87-d7d285adb2d0 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:51:38.138767 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-2f1d0c81-7151-4291-8a87-d7d285adb2d0 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:51:38.139625 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-2f1d0c81-7151-4291-8a87-d7d285adb2d0 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:51:38.140066 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-2f1d0c81-7151-4291-8a87-d7d285adb2d0 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:51:38.200332 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-2f1d0c81-7151-4291-8a87-d7d285adb2d0 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:51:38.207993 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-2f1d0c81-7151-4291-8a87-d7d285adb2d0 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.080348 Nov 01 01:51:38.208554 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1457/2822] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:51:38 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:51:39.224463 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-2010a849-ec89-4fac-8044-8052e0589f35 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:51:39.225135 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-2010a849-ec89-4fac-8044-8052e0589f35 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:51:39.231377 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2010a849-ec89-4fac-8044-8052e0589f35 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:51:39.231820 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2010a849-ec89-4fac-8044-8052e0589f35 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:51:39.232570 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2010a849-ec89-4fac-8044-8052e0589f35 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:51:39.232998 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2010a849-ec89-4fac-8044-8052e0589f35 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:51:39.290821 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-2010a849-ec89-4fac-8044-8052e0589f35 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:51:39.298437 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-2010a849-ec89-4fac-8044-8052e0589f35 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.077592 Nov 01 01:51:39.299002 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1366/2823] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:51:39 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:51:40.315418 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-c5235a9a-9852-49f2-9e0f-133712e7f312 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:51:40.316008 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-c5235a9a-9852-49f2-9e0f-133712e7f312 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:51:40.322231 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c5235a9a-9852-49f2-9e0f-133712e7f312 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:51:40.322702 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c5235a9a-9852-49f2-9e0f-133712e7f312 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:51:40.323457 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c5235a9a-9852-49f2-9e0f-133712e7f312 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:51:40.323905 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c5235a9a-9852-49f2-9e0f-133712e7f312 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:51:40.383780 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-c5235a9a-9852-49f2-9e0f-133712e7f312 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:51:40.391916 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-c5235a9a-9852-49f2-9e0f-133712e7f312 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.080120 Nov 01 01:51:40.392616 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1458/2824] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:51:40 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:51:41.408274 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-b70c1601-b8b3-4491-82ad-2af6592cb005 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:51:41.408912 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-b70c1601-b8b3-4491-82ad-2af6592cb005 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:51:41.415752 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b70c1601-b8b3-4491-82ad-2af6592cb005 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:51:41.416198 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b70c1601-b8b3-4491-82ad-2af6592cb005 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:51:41.416949 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b70c1601-b8b3-4491-82ad-2af6592cb005 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:51:41.417380 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b70c1601-b8b3-4491-82ad-2af6592cb005 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:51:41.475111 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-b70c1601-b8b3-4491-82ad-2af6592cb005 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:51:41.483326 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-b70c1601-b8b3-4491-82ad-2af6592cb005 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.078678 Nov 01 01:51:41.483890 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1367/2825] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:51:41 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:51:42.500091 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-0c07cf13-1fa0-4ddc-b2c2-6a95e49f0dab tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:51:42.500696 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-0c07cf13-1fa0-4ddc-b2c2-6a95e49f0dab tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:51:42.506875 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0c07cf13-1fa0-4ddc-b2c2-6a95e49f0dab tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:51:42.507315 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0c07cf13-1fa0-4ddc-b2c2-6a95e49f0dab tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:51:42.508066 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0c07cf13-1fa0-4ddc-b2c2-6a95e49f0dab tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:51:42.508490 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0c07cf13-1fa0-4ddc-b2c2-6a95e49f0dab tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:51:42.566566 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-0c07cf13-1fa0-4ddc-b2c2-6a95e49f0dab tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:51:42.574311 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-0c07cf13-1fa0-4ddc-b2c2-6a95e49f0dab tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.077929 Nov 01 01:51:42.574886 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1459/2826] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:51:42 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:51:43.591186 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-20f833e3-36b5-4b88-9b2a-fe146a4688ee tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:51:43.591820 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-20f833e3-36b5-4b88-9b2a-fe146a4688ee tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:51:43.598019 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-20f833e3-36b5-4b88-9b2a-fe146a4688ee tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:51:43.598492 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-20f833e3-36b5-4b88-9b2a-fe146a4688ee tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:51:43.599247 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-20f833e3-36b5-4b88-9b2a-fe146a4688ee tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:51:43.599678 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-20f833e3-36b5-4b88-9b2a-fe146a4688ee tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:51:43.661974 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-20f833e3-36b5-4b88-9b2a-fe146a4688ee tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:51:43.670444 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-20f833e3-36b5-4b88-9b2a-fe146a4688ee tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.082867 Nov 01 01:51:43.671021 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1368/2827] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:51:43 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:51:44.687731 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-baa220b5-f15f-48f0-a95c-c5b2dd56c1b4 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:51:44.688459 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-baa220b5-f15f-48f0-a95c-c5b2dd56c1b4 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:51:44.695489 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-baa220b5-f15f-48f0-a95c-c5b2dd56c1b4 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:51:44.695930 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-baa220b5-f15f-48f0-a95c-c5b2dd56c1b4 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:51:44.696675 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-baa220b5-f15f-48f0-a95c-c5b2dd56c1b4 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:51:44.697097 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-baa220b5-f15f-48f0-a95c-c5b2dd56c1b4 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:51:44.757555 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-baa220b5-f15f-48f0-a95c-c5b2dd56c1b4 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:51:44.765199 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-baa220b5-f15f-48f0-a95c-c5b2dd56c1b4 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.081231 Nov 01 01:51:44.765745 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1460/2828] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:51:44 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:51:45.780739 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-b226cec5-8d4e-4a50-bf04-2455ba7af6f0 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:51:45.781359 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-b226cec5-8d4e-4a50-bf04-2455ba7af6f0 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:51:45.787603 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b226cec5-8d4e-4a50-bf04-2455ba7af6f0 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:51:45.788048 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b226cec5-8d4e-4a50-bf04-2455ba7af6f0 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:51:45.788796 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b226cec5-8d4e-4a50-bf04-2455ba7af6f0 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:51:45.789906 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b226cec5-8d4e-4a50-bf04-2455ba7af6f0 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:51:45.847678 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-b226cec5-8d4e-4a50-bf04-2455ba7af6f0 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:51:45.855906 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-b226cec5-8d4e-4a50-bf04-2455ba7af6f0 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.078837 Nov 01 01:51:45.856483 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1369/2829] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:51:45 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:51:46.871441 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-751da5cb-7397-441a-b8ec-8f87eef36c33 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:51:46.872052 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-751da5cb-7397-441a-b8ec-8f87eef36c33 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:51:46.878263 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-751da5cb-7397-441a-b8ec-8f87eef36c33 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:51:46.878744 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-751da5cb-7397-441a-b8ec-8f87eef36c33 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:51:46.879506 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-751da5cb-7397-441a-b8ec-8f87eef36c33 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:51:46.879938 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-751da5cb-7397-441a-b8ec-8f87eef36c33 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:51:46.938689 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-751da5cb-7397-441a-b8ec-8f87eef36c33 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:51:46.946818 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-751da5cb-7397-441a-b8ec-8f87eef36c33 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.079070 Nov 01 01:51:46.947373 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1461/2830] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:51:46 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:51:47.963131 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-e123f8b8-e13a-4b68-a0ea-e7bf3ea90aec tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:51:47.963738 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-e123f8b8-e13a-4b68-a0ea-e7bf3ea90aec tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:51:47.969897 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e123f8b8-e13a-4b68-a0ea-e7bf3ea90aec tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:51:47.970343 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e123f8b8-e13a-4b68-a0ea-e7bf3ea90aec tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:51:47.971139 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e123f8b8-e13a-4b68-a0ea-e7bf3ea90aec tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:51:47.971574 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e123f8b8-e13a-4b68-a0ea-e7bf3ea90aec tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:51:48.030070 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-e123f8b8-e13a-4b68-a0ea-e7bf3ea90aec tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:51:48.037719 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-e123f8b8-e13a-4b68-a0ea-e7bf3ea90aec tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.078286 Nov 01 01:51:48.038275 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1370/2831] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:51:47 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:51:49.053926 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-048ddd6b-c422-46e0-9d09-e25ebd16c58b tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:51:49.054565 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-048ddd6b-c422-46e0-9d09-e25ebd16c58b tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:51:49.061065 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-048ddd6b-c422-46e0-9d09-e25ebd16c58b tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:51:49.061507 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-048ddd6b-c422-46e0-9d09-e25ebd16c58b tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:51:49.062257 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-048ddd6b-c422-46e0-9d09-e25ebd16c58b tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:51:49.062706 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-048ddd6b-c422-46e0-9d09-e25ebd16c58b tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:51:49.122536 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-048ddd6b-c422-46e0-9d09-e25ebd16c58b tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:51:49.130126 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-048ddd6b-c422-46e0-9d09-e25ebd16c58b tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.079893 Nov 01 01:51:49.130712 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1462/2832] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:51:49 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:51:50.146970 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-65a49f48-6d2b-494b-8b23-3e6be275ce38 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:51:50.147572 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-65a49f48-6d2b-494b-8b23-3e6be275ce38 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:51:50.154232 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-65a49f48-6d2b-494b-8b23-3e6be275ce38 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:51:50.154702 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-65a49f48-6d2b-494b-8b23-3e6be275ce38 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:51:50.155449 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-65a49f48-6d2b-494b-8b23-3e6be275ce38 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:51:50.155872 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-65a49f48-6d2b-494b-8b23-3e6be275ce38 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:51:50.217272 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-65a49f48-6d2b-494b-8b23-3e6be275ce38 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:51:50.224843 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-65a49f48-6d2b-494b-8b23-3e6be275ce38 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.081474 Nov 01 01:51:50.225397 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1371/2833] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:51:50 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:51:51.242072 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-26900a9d-a3ac-44f2-b61b-4d8c389e2d96 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:51:51.242702 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-26900a9d-a3ac-44f2-b61b-4d8c389e2d96 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:51:51.249544 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-26900a9d-a3ac-44f2-b61b-4d8c389e2d96 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:51:51.249986 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-26900a9d-a3ac-44f2-b61b-4d8c389e2d96 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:51:51.250767 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-26900a9d-a3ac-44f2-b61b-4d8c389e2d96 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:51:51.251296 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-26900a9d-a3ac-44f2-b61b-4d8c389e2d96 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:51:51.310512 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-26900a9d-a3ac-44f2-b61b-4d8c389e2d96 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:51:51.318085 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-26900a9d-a3ac-44f2-b61b-4d8c389e2d96 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.079694 Nov 01 01:51:51.318671 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1463/2834] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:51:51 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:51:52.334377 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-e6e1b6c2-da36-4b88-ae42-a2eaf101ca77 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:51:52.334997 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-e6e1b6c2-da36-4b88-ae42-a2eaf101ca77 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:51:52.341277 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e6e1b6c2-da36-4b88-ae42-a2eaf101ca77 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:51:52.341720 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e6e1b6c2-da36-4b88-ae42-a2eaf101ca77 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:51:52.342563 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e6e1b6c2-da36-4b88-ae42-a2eaf101ca77 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:51:52.342987 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e6e1b6c2-da36-4b88-ae42-a2eaf101ca77 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:51:52.411216 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-e6e1b6c2-da36-4b88-ae42-a2eaf101ca77 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:51:52.418961 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-e6e1b6c2-da36-4b88-ae42-a2eaf101ca77 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.088219 Nov 01 01:51:52.419516 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1372/2835] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:51:52 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:51:53.436310 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-22e06ee4-922d-4c5f-97b7-5da5ae7f1576 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:51:53.436916 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-22e06ee4-922d-4c5f-97b7-5da5ae7f1576 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:51:53.443103 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-22e06ee4-922d-4c5f-97b7-5da5ae7f1576 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:51:53.443543 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-22e06ee4-922d-4c5f-97b7-5da5ae7f1576 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:51:53.444289 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-22e06ee4-922d-4c5f-97b7-5da5ae7f1576 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:51:53.444709 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-22e06ee4-922d-4c5f-97b7-5da5ae7f1576 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:51:53.503804 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-22e06ee4-922d-4c5f-97b7-5da5ae7f1576 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:51:53.511457 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-22e06ee4-922d-4c5f-97b7-5da5ae7f1576 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.079147 Nov 01 01:51:53.512004 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1464/2836] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:51:53 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:51:54.528069 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-d9994ca2-8223-4ac5-9e51-b455f2af030d tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:51:54.528644 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-d9994ca2-8223-4ac5-9e51-b455f2af030d tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:51:54.534860 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d9994ca2-8223-4ac5-9e51-b455f2af030d tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:51:54.535305 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d9994ca2-8223-4ac5-9e51-b455f2af030d tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:51:54.536053 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d9994ca2-8223-4ac5-9e51-b455f2af030d tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:51:54.536475 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d9994ca2-8223-4ac5-9e51-b455f2af030d tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:51:54.594839 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-d9994ca2-8223-4ac5-9e51-b455f2af030d tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:51:54.602397 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-d9994ca2-8223-4ac5-9e51-b455f2af030d tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.078146 Nov 01 01:51:54.603008 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1373/2837] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:51:54 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:51:55.618878 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-44124e1c-9e9b-43f3-96a7-3f1cf7f00c03 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:51:55.619422 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-44124e1c-9e9b-43f3-96a7-3f1cf7f00c03 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:51:55.625891 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-44124e1c-9e9b-43f3-96a7-3f1cf7f00c03 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:51:55.626332 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-44124e1c-9e9b-43f3-96a7-3f1cf7f00c03 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:51:55.627110 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-44124e1c-9e9b-43f3-96a7-3f1cf7f00c03 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:51:55.627535 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-44124e1c-9e9b-43f3-96a7-3f1cf7f00c03 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:51:55.685283 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-44124e1c-9e9b-43f3-96a7-3f1cf7f00c03 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:51:55.692794 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-44124e1c-9e9b-43f3-96a7-3f1cf7f00c03 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.077692 Nov 01 01:51:55.693340 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1465/2838] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:51:55 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:51:56.709121 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-de62b987-41d4-4869-a128-50edd4f04090 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:51:56.709721 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-de62b987-41d4-4869-a128-50edd4f04090 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:51:56.715702 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-de62b987-41d4-4869-a128-50edd4f04090 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:51:56.716142 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-de62b987-41d4-4869-a128-50edd4f04090 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:51:56.716896 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-de62b987-41d4-4869-a128-50edd4f04090 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:51:56.717323 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-de62b987-41d4-4869-a128-50edd4f04090 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:51:56.778383 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-de62b987-41d4-4869-a128-50edd4f04090 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:51:56.786148 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-de62b987-41d4-4869-a128-50edd4f04090 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.080659 Nov 01 01:51:56.786740 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1374/2839] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:51:56 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:51:57.802808 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-0e63b85d-4105-40fe-94c7-a80e8cbd7209 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:51:57.803418 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-0e63b85d-4105-40fe-94c7-a80e8cbd7209 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:51:57.810591 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0e63b85d-4105-40fe-94c7-a80e8cbd7209 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:51:57.811041 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0e63b85d-4105-40fe-94c7-a80e8cbd7209 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:51:57.811800 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0e63b85d-4105-40fe-94c7-a80e8cbd7209 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:51:57.812228 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0e63b85d-4105-40fe-94c7-a80e8cbd7209 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:51:57.870664 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-0e63b85d-4105-40fe-94c7-a80e8cbd7209 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:51:57.878273 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-0e63b85d-4105-40fe-94c7-a80e8cbd7209 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.079189 Nov 01 01:51:57.878854 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1466/2840] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:51:57 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:51:58.894687 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-8f760001-9337-40da-9e69-18bc2321083e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:51:58.895286 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-8f760001-9337-40da-9e69-18bc2321083e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:51:58.902281 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8f760001-9337-40da-9e69-18bc2321083e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:51:58.902757 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8f760001-9337-40da-9e69-18bc2321083e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:51:58.903569 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8f760001-9337-40da-9e69-18bc2321083e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:51:58.903994 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8f760001-9337-40da-9e69-18bc2321083e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:51:58.962733 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-8f760001-9337-40da-9e69-18bc2321083e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:51:58.970296 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-8f760001-9337-40da-9e69-18bc2321083e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.079253 Nov 01 01:51:58.970892 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1375/2841] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:51:58 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:51:59.986688 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-6032d529-317d-4538-9727-78901ee83c71 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:51:59.987315 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-6032d529-317d-4538-9727-78901ee83c71 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:51:59.993451 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-6032d529-317d-4538-9727-78901ee83c71 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:51:59.993890 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-6032d529-317d-4538-9727-78901ee83c71 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:51:59.994720 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-6032d529-317d-4538-9727-78901ee83c71 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:51:59.995108 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-6032d529-317d-4538-9727-78901ee83c71 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:52:00.053697 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-6032d529-317d-4538-9727-78901ee83c71 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:52:00.061601 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-6032d529-317d-4538-9727-78901ee83c71 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.078611 Nov 01 01:52:00.062161 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1467/2842] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:51:59 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:52:01.077936 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-826f98f7-181e-4ed3-9aca-9cbe2b768a33 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:52:01.078577 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-826f98f7-181e-4ed3-9aca-9cbe2b768a33 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:52:01.084873 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-826f98f7-181e-4ed3-9aca-9cbe2b768a33 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:52:01.085317 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-826f98f7-181e-4ed3-9aca-9cbe2b768a33 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:52:01.086076 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-826f98f7-181e-4ed3-9aca-9cbe2b768a33 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:52:01.086542 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-826f98f7-181e-4ed3-9aca-9cbe2b768a33 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:52:01.145022 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-826f98f7-181e-4ed3-9aca-9cbe2b768a33 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:52:01.153114 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-826f98f7-181e-4ed3-9aca-9cbe2b768a33 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.078898 Nov 01 01:52:01.153679 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1376/2843] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:52:01 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:52:02.170562 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-af07ef96-0f10-4c9c-9e18-1b72139ba96a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:52:02.171181 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-af07ef96-0f10-4c9c-9e18-1b72139ba96a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:52:02.177364 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-af07ef96-0f10-4c9c-9e18-1b72139ba96a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:52:02.177812 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-af07ef96-0f10-4c9c-9e18-1b72139ba96a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:52:02.178595 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-af07ef96-0f10-4c9c-9e18-1b72139ba96a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:52:02.179026 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-af07ef96-0f10-4c9c-9e18-1b72139ba96a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:52:02.236995 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-af07ef96-0f10-4c9c-9e18-1b72139ba96a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:52:02.244658 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-af07ef96-0f10-4c9c-9e18-1b72139ba96a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.077738 Nov 01 01:52:02.245216 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1468/2844] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:52:02 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:52:03.261685 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-7d345911-9f3f-4523-a722-562467e53ffe tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:52:03.262289 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-7d345911-9f3f-4523-a722-562467e53ffe tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:52:03.268522 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7d345911-9f3f-4523-a722-562467e53ffe tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:52:03.268965 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7d345911-9f3f-4523-a722-562467e53ffe tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:52:03.269743 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7d345911-9f3f-4523-a722-562467e53ffe tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:52:03.270198 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7d345911-9f3f-4523-a722-562467e53ffe tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:52:03.331371 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-7d345911-9f3f-4523-a722-562467e53ffe tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:52:03.339631 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-7d345911-9f3f-4523-a722-562467e53ffe tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.082063 Nov 01 01:52:03.340188 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1377/2845] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:52:03 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:52:04.356270 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-8d752d7b-a29d-4a80-b85c-0e201c84f0fd tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:52:04.356810 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-8d752d7b-a29d-4a80-b85c-0e201c84f0fd tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:52:04.363171 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8d752d7b-a29d-4a80-b85c-0e201c84f0fd tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:52:04.363617 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8d752d7b-a29d-4a80-b85c-0e201c84f0fd tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:52:04.364380 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8d752d7b-a29d-4a80-b85c-0e201c84f0fd tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:52:04.364813 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8d752d7b-a29d-4a80-b85c-0e201c84f0fd tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:52:04.422784 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-8d752d7b-a29d-4a80-b85c-0e201c84f0fd tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:52:04.430363 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-8d752d7b-a29d-4a80-b85c-0e201c84f0fd tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.077897 Nov 01 01:52:04.431483 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1469/2846] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:52:04 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:52:05.449070 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-453f78d0-8999-4c57-b825-a6bd2515b188 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:52:05.449700 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-453f78d0-8999-4c57-b825-a6bd2515b188 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:52:05.455926 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-453f78d0-8999-4c57-b825-a6bd2515b188 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:52:05.456364 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-453f78d0-8999-4c57-b825-a6bd2515b188 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:52:05.457137 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-453f78d0-8999-4c57-b825-a6bd2515b188 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:52:05.457562 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-453f78d0-8999-4c57-b825-a6bd2515b188 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:52:05.515762 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-453f78d0-8999-4c57-b825-a6bd2515b188 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:52:05.523489 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-453f78d0-8999-4c57-b825-a6bd2515b188 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.078525 Nov 01 01:52:05.524044 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1378/2847] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:52:05 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:52:06.541145 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-23f8bc90-d306-4f54-a614-e4f71a10ec73 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:52:06.541728 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-23f8bc90-d306-4f54-a614-e4f71a10ec73 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:52:06.547869 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-23f8bc90-d306-4f54-a614-e4f71a10ec73 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:52:06.548310 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-23f8bc90-d306-4f54-a614-e4f71a10ec73 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:52:06.549057 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-23f8bc90-d306-4f54-a614-e4f71a10ec73 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:52:06.549481 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-23f8bc90-d306-4f54-a614-e4f71a10ec73 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:52:06.607707 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-23f8bc90-d306-4f54-a614-e4f71a10ec73 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:52:06.615267 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-23f8bc90-d306-4f54-a614-e4f71a10ec73 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.078510 Nov 01 01:52:06.615822 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1470/2848] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:52:06 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:52:07.631685 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-22b20ef1-f87c-44a4-a9ed-74f90cc5247a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:52:07.632262 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-22b20ef1-f87c-44a4-a9ed-74f90cc5247a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:52:07.638406 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-22b20ef1-f87c-44a4-a9ed-74f90cc5247a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:52:07.638871 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-22b20ef1-f87c-44a4-a9ed-74f90cc5247a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:52:07.639619 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-22b20ef1-f87c-44a4-a9ed-74f90cc5247a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:52:07.640045 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-22b20ef1-f87c-44a4-a9ed-74f90cc5247a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:52:07.699026 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-22b20ef1-f87c-44a4-a9ed-74f90cc5247a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:52:07.706590 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-22b20ef1-f87c-44a4-a9ed-74f90cc5247a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.078549 Nov 01 01:52:07.707143 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1379/2849] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:52:07 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:52:08.723213 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-f99e5cd9-859a-4809-be4b-77c546af718e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:52:08.723826 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-f99e5cd9-859a-4809-be4b-77c546af718e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:52:08.730124 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f99e5cd9-859a-4809-be4b-77c546af718e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:52:08.730611 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f99e5cd9-859a-4809-be4b-77c546af718e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:52:08.731368 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f99e5cd9-859a-4809-be4b-77c546af718e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:52:08.731797 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f99e5cd9-859a-4809-be4b-77c546af718e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:52:08.792662 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-f99e5cd9-859a-4809-be4b-77c546af718e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:52:08.800332 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-f99e5cd9-859a-4809-be4b-77c546af718e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.080783 Nov 01 01:52:08.800883 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1471/2850] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:52:08 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:52:09.817474 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-da200da9-d145-4289-89d0-57b5b2643f94 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:52:09.818068 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-da200da9-d145-4289-89d0-57b5b2643f94 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:52:09.824775 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-da200da9-d145-4289-89d0-57b5b2643f94 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:52:09.825216 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-da200da9-d145-4289-89d0-57b5b2643f94 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:52:09.825959 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-da200da9-d145-4289-89d0-57b5b2643f94 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:52:09.826381 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-da200da9-d145-4289-89d0-57b5b2643f94 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:52:09.894982 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-da200da9-d145-4289-89d0-57b5b2643f94 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:52:09.895371 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-da200da9-d145-4289-89d0-57b5b2643f94 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.081415 Nov 01 01:52:09.895925 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1380/2851] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:52:09 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:52:10.912173 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-635e5893-20db-4b32-9ad6-1c8de399e130 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:52:10.915397 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-635e5893-20db-4b32-9ad6-1c8de399e130 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:52:10.919643 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-635e5893-20db-4b32-9ad6-1c8de399e130 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:52:10.920079 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-635e5893-20db-4b32-9ad6-1c8de399e130 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:52:10.920826 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-635e5893-20db-4b32-9ad6-1c8de399e130 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:52:10.921249 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-635e5893-20db-4b32-9ad6-1c8de399e130 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:52:10.979783 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-635e5893-20db-4b32-9ad6-1c8de399e130 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:52:10.987383 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-635e5893-20db-4b32-9ad6-1c8de399e130 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.078859 Nov 01 01:52:10.987933 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1472/2852] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:52:10 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:52:12.003747 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-a58b4141-38f2-4f1c-9017-ec842bac9ad9 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:52:12.004357 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-a58b4141-38f2-4f1c-9017-ec842bac9ad9 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:52:12.011223 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a58b4141-38f2-4f1c-9017-ec842bac9ad9 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:52:12.011665 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a58b4141-38f2-4f1c-9017-ec842bac9ad9 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:52:12.012413 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a58b4141-38f2-4f1c-9017-ec842bac9ad9 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:52:12.012834 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a58b4141-38f2-4f1c-9017-ec842bac9ad9 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:52:12.070764 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-a58b4141-38f2-4f1c-9017-ec842bac9ad9 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:52:12.078319 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-a58b4141-38f2-4f1c-9017-ec842bac9ad9 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.078224 Nov 01 01:52:12.078910 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1381/2853] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:52:11 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:52:12.702817 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 01 01:52:12.703408 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: Mon Nov 1 01:52:12 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 01 01:52:13.094838 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-dd211a75-5879-4e21-8b41-be1b9d657e67 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:52:13.094838 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-dd211a75-5879-4e21-8b41-be1b9d657e67 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:52:13.100917 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-dd211a75-5879-4e21-8b41-be1b9d657e67 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:52:13.101357 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-dd211a75-5879-4e21-8b41-be1b9d657e67 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:52:13.102639 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-dd211a75-5879-4e21-8b41-be1b9d657e67 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:52:13.103069 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-dd211a75-5879-4e21-8b41-be1b9d657e67 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:52:13.164220 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-dd211a75-5879-4e21-8b41-be1b9d657e67 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:52:13.172631 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-dd211a75-5879-4e21-8b41-be1b9d657e67 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.082178 Nov 01 01:52:13.173188 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1473/2854] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:52:13 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:52:14.189004 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-2a7527dd-6af1-4452-812d-a1bb7fc3ce1c tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:52:14.189641 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-2a7527dd-6af1-4452-812d-a1bb7fc3ce1c tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:52:14.196792 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2a7527dd-6af1-4452-812d-a1bb7fc3ce1c tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:52:14.197234 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2a7527dd-6af1-4452-812d-a1bb7fc3ce1c tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:52:14.197984 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2a7527dd-6af1-4452-812d-a1bb7fc3ce1c tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:52:14.198405 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2a7527dd-6af1-4452-812d-a1bb7fc3ce1c tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:52:14.256232 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-2a7527dd-6af1-4452-812d-a1bb7fc3ce1c tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:52:14.264227 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-2a7527dd-6af1-4452-812d-a1bb7fc3ce1c tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.078843 Nov 01 01:52:14.264782 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1382/2855] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:52:14 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:52:15.281142 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-08869047-02ef-4408-81d2-1787cca6c1a7 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:52:15.281761 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-08869047-02ef-4408-81d2-1787cca6c1a7 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:52:15.287870 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-08869047-02ef-4408-81d2-1787cca6c1a7 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:52:15.289873 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-08869047-02ef-4408-81d2-1787cca6c1a7 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:52:15.289873 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-08869047-02ef-4408-81d2-1787cca6c1a7 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:52:15.289873 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-08869047-02ef-4408-81d2-1787cca6c1a7 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:52:15.348452 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-08869047-02ef-4408-81d2-1787cca6c1a7 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:52:15.356387 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-08869047-02ef-4408-81d2-1787cca6c1a7 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.078850 Nov 01 01:52:15.356884 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1474/2856] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:52:15 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:52:16.372864 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-00ebd94d-d402-436c-961e-e58f03e30609 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:52:16.373469 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-00ebd94d-d402-436c-961e-e58f03e30609 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:52:16.379670 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-00ebd94d-d402-436c-961e-e58f03e30609 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:52:16.380109 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-00ebd94d-d402-436c-961e-e58f03e30609 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:52:16.380860 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-00ebd94d-d402-436c-961e-e58f03e30609 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:52:16.381286 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-00ebd94d-d402-436c-961e-e58f03e30609 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:52:16.614128 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-00ebd94d-d402-436c-961e-e58f03e30609 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:52:16.621964 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-00ebd94d-d402-436c-961e-e58f03e30609 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.252800 Nov 01 01:52:16.622582 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1383/2857] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:52:16 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:52:17.638786 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-01051691-48c3-48ad-aa25-93a95fdca26a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:52:17.639324 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-01051691-48c3-48ad-aa25-93a95fdca26a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:52:17.645486 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-01051691-48c3-48ad-aa25-93a95fdca26a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:52:17.645936 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-01051691-48c3-48ad-aa25-93a95fdca26a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:52:17.646726 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-01051691-48c3-48ad-aa25-93a95fdca26a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:52:17.647159 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-01051691-48c3-48ad-aa25-93a95fdca26a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:52:17.706243 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-01051691-48c3-48ad-aa25-93a95fdca26a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:52:17.714538 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-01051691-48c3-48ad-aa25-93a95fdca26a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.078949 Nov 01 01:52:17.715091 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1475/2858] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:52:17 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:52:18.731471 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-c7777ed7-55cf-4036-a72c-9af521106156 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:52:18.732079 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-c7777ed7-55cf-4036-a72c-9af521106156 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:52:18.738042 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c7777ed7-55cf-4036-a72c-9af521106156 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:52:18.738519 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c7777ed7-55cf-4036-a72c-9af521106156 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:52:18.739277 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c7777ed7-55cf-4036-a72c-9af521106156 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:52:18.739707 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c7777ed7-55cf-4036-a72c-9af521106156 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:52:18.800702 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-c7777ed7-55cf-4036-a72c-9af521106156 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:52:18.813024 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-c7777ed7-55cf-4036-a72c-9af521106156 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.085627 Nov 01 01:52:18.813599 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1384/2859] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:52:18 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:52:19.830115 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-9121ceea-7b97-4d34-8c82-cdfe5b922142 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:52:19.830748 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-9121ceea-7b97-4d34-8c82-cdfe5b922142 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:52:19.837099 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9121ceea-7b97-4d34-8c82-cdfe5b922142 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:52:19.838364 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9121ceea-7b97-4d34-8c82-cdfe5b922142 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:52:19.838364 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9121ceea-7b97-4d34-8c82-cdfe5b922142 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:52:19.839511 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9121ceea-7b97-4d34-8c82-cdfe5b922142 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:52:19.898766 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-9121ceea-7b97-4d34-8c82-cdfe5b922142 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:52:19.916243 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-9121ceea-7b97-4d34-8c82-cdfe5b922142 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.080114 Nov 01 01:52:19.916243 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1476/2860] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:52:19 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:52:20.923544 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-8ffb13ea-4cda-448a-9025-ddb4a09ed4b0 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:52:20.924175 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-8ffb13ea-4cda-448a-9025-ddb4a09ed4b0 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:52:20.930358 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8ffb13ea-4cda-448a-9025-ddb4a09ed4b0 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:52:20.930838 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8ffb13ea-4cda-448a-9025-ddb4a09ed4b0 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:52:20.931591 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8ffb13ea-4cda-448a-9025-ddb4a09ed4b0 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:52:20.932274 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8ffb13ea-4cda-448a-9025-ddb4a09ed4b0 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:52:20.992455 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-8ffb13ea-4cda-448a-9025-ddb4a09ed4b0 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:52:21.000081 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-8ffb13ea-4cda-448a-9025-ddb4a09ed4b0 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.080170 Nov 01 01:52:21.000641 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1385/2861] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:52:20 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:52:22.016684 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-a35720a5-2538-4450-826b-5abf874eaa52 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:52:22.017278 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-a35720a5-2538-4450-826b-5abf874eaa52 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:52:22.023483 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a35720a5-2538-4450-826b-5abf874eaa52 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:52:22.023928 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a35720a5-2538-4450-826b-5abf874eaa52 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:52:22.024686 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a35720a5-2538-4450-826b-5abf874eaa52 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:52:22.025115 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a35720a5-2538-4450-826b-5abf874eaa52 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:52:22.085956 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-a35720a5-2538-4450-826b-5abf874eaa52 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:52:22.093586 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-a35720a5-2538-4450-826b-5abf874eaa52 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.080575 Nov 01 01:52:22.097573 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1477/2862] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:52:22 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:52:23.110525 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-3c2ec0b0-95a0-46e6-a6b3-828e0b7d0212 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:52:23.111095 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-3c2ec0b0-95a0-46e6-a6b3-828e0b7d0212 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:52:23.117543 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3c2ec0b0-95a0-46e6-a6b3-828e0b7d0212 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:52:23.117981 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3c2ec0b0-95a0-46e6-a6b3-828e0b7d0212 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:52:23.118797 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3c2ec0b0-95a0-46e6-a6b3-828e0b7d0212 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:52:23.119222 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3c2ec0b0-95a0-46e6-a6b3-828e0b7d0212 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:52:23.183087 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-3c2ec0b0-95a0-46e6-a6b3-828e0b7d0212 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:52:23.192967 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-3c2ec0b0-95a0-46e6-a6b3-828e0b7d0212 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.086006 Nov 01 01:52:23.193535 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1386/2863] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:52:23 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:52:24.210685 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-6f80f7fa-7b4d-459f-8e3e-ce7523c698c6 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:52:24.211310 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-6f80f7fa-7b4d-459f-8e3e-ce7523c698c6 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:52:24.217425 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-6f80f7fa-7b4d-459f-8e3e-ce7523c698c6 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:52:24.218456 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-6f80f7fa-7b4d-459f-8e3e-ce7523c698c6 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:52:24.218623 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-6f80f7fa-7b4d-459f-8e3e-ce7523c698c6 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:52:24.219049 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-6f80f7fa-7b4d-459f-8e3e-ce7523c698c6 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:52:24.276702 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-6f80f7fa-7b4d-459f-8e3e-ce7523c698c6 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:52:24.284277 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-6f80f7fa-7b4d-459f-8e3e-ce7523c698c6 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.077249 Nov 01 01:52:24.284834 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1478/2864] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:52:24 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:52:25.365495 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-b996a6ae-46a5-4806-b323-8ab8dd1a4154 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:52:25.366103 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-b996a6ae-46a5-4806-b323-8ab8dd1a4154 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:52:25.372523 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b996a6ae-46a5-4806-b323-8ab8dd1a4154 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:52:25.372959 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b996a6ae-46a5-4806-b323-8ab8dd1a4154 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:52:25.373712 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b996a6ae-46a5-4806-b323-8ab8dd1a4154 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:52:25.374137 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b996a6ae-46a5-4806-b323-8ab8dd1a4154 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:52:25.433084 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-b996a6ae-46a5-4806-b323-8ab8dd1a4154 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:52:25.441303 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-b996a6ae-46a5-4806-b323-8ab8dd1a4154 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.143813 Nov 01 01:52:25.441864 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1387/2865] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:52:25 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:52:26.457783 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-947aed8c-85bf-48ce-af5e-4ace55dd6745 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:52:26.458397 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-947aed8c-85bf-48ce-af5e-4ace55dd6745 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:52:26.464084 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-947aed8c-85bf-48ce-af5e-4ace55dd6745 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:52:26.465536 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-947aed8c-85bf-48ce-af5e-4ace55dd6745 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:52:26.465536 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-947aed8c-85bf-48ce-af5e-4ace55dd6745 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:52:26.465758 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-947aed8c-85bf-48ce-af5e-4ace55dd6745 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:52:26.523723 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-947aed8c-85bf-48ce-af5e-4ace55dd6745 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:52:26.531381 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-947aed8c-85bf-48ce-af5e-4ace55dd6745 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.077392 Nov 01 01:52:26.531938 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1479/2866] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:52:26 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:52:27.547711 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-4e7b21b3-5a48-4db6-8db1-a051aaa11a53 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:52:27.548314 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-4e7b21b3-5a48-4db6-8db1-a051aaa11a53 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:52:27.554245 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4e7b21b3-5a48-4db6-8db1-a051aaa11a53 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:52:27.554724 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4e7b21b3-5a48-4db6-8db1-a051aaa11a53 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:52:27.555479 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4e7b21b3-5a48-4db6-8db1-a051aaa11a53 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:52:27.555907 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4e7b21b3-5a48-4db6-8db1-a051aaa11a53 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:52:27.613836 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-4e7b21b3-5a48-4db6-8db1-a051aaa11a53 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:52:27.622248 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-4e7b21b3-5a48-4db6-8db1-a051aaa11a53 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.078004 Nov 01 01:52:27.623218 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1388/2867] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:52:27 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:52:28.639598 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-7fde9ede-20ac-4616-8022-d4b375873c9f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:52:28.640141 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-7fde9ede-20ac-4616-8022-d4b375873c9f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:52:28.646384 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-7fde9ede-20ac-4616-8022-d4b375873c9f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:52:28.646863 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-7fde9ede-20ac-4616-8022-d4b375873c9f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:52:28.647617 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-7fde9ede-20ac-4616-8022-d4b375873c9f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:52:28.648046 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-7fde9ede-20ac-4616-8022-d4b375873c9f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:52:28.706174 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-7fde9ede-20ac-4616-8022-d4b375873c9f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:52:28.713888 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-7fde9ede-20ac-4616-8022-d4b375873c9f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.078549 Nov 01 01:52:28.714458 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1480/2868] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:52:28 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:52:29.731465 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-0c423440-6ca1-4928-b8c5-9f025a6adb49 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:52:29.732076 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-0c423440-6ca1-4928-b8c5-9f025a6adb49 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:52:29.738540 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0c423440-6ca1-4928-b8c5-9f025a6adb49 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:52:29.738988 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0c423440-6ca1-4928-b8c5-9f025a6adb49 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:52:29.739784 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0c423440-6ca1-4928-b8c5-9f025a6adb49 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:52:29.740211 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0c423440-6ca1-4928-b8c5-9f025a6adb49 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:52:29.802040 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-0c423440-6ca1-4928-b8c5-9f025a6adb49 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:52:29.810917 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-0c423440-6ca1-4928-b8c5-9f025a6adb49 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.083655 Nov 01 01:52:29.811461 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1389/2869] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:52:29 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:52:30.826821 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-051eb04c-d18d-4a7b-ba63-3ef61f7b8958 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:52:30.827507 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-051eb04c-d18d-4a7b-ba63-3ef61f7b8958 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:52:30.833773 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-051eb04c-d18d-4a7b-ba63-3ef61f7b8958 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:52:30.834216 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-051eb04c-d18d-4a7b-ba63-3ef61f7b8958 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:52:30.834997 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-051eb04c-d18d-4a7b-ba63-3ef61f7b8958 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:52:30.835430 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-051eb04c-d18d-4a7b-ba63-3ef61f7b8958 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:52:30.894003 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-051eb04c-d18d-4a7b-ba63-3ef61f7b8958 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:52:30.901780 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-051eb04c-d18d-4a7b-ba63-3ef61f7b8958 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.078695 Nov 01 01:52:30.902381 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1481/2870] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:52:30 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:52:31.918144 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-eb661b43-c7ad-4288-9361-e3da60c04011 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:52:31.918780 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-eb661b43-c7ad-4288-9361-e3da60c04011 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:52:31.925069 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-eb661b43-c7ad-4288-9361-e3da60c04011 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:52:31.925516 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-eb661b43-c7ad-4288-9361-e3da60c04011 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:52:31.926272 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-eb661b43-c7ad-4288-9361-e3da60c04011 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:52:31.926727 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-eb661b43-c7ad-4288-9361-e3da60c04011 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:52:31.985158 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-eb661b43-c7ad-4288-9361-e3da60c04011 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:52:31.992746 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-eb661b43-c7ad-4288-9361-e3da60c04011 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.078235 Nov 01 01:52:31.993306 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1390/2871] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:52:31 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:52:33.009535 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-4af5ba5d-1ede-4540-b202-15db17301635 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:52:33.010182 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-4af5ba5d-1ede-4540-b202-15db17301635 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:52:33.017135 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4af5ba5d-1ede-4540-b202-15db17301635 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:52:33.017584 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4af5ba5d-1ede-4540-b202-15db17301635 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:52:33.018346 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4af5ba5d-1ede-4540-b202-15db17301635 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:52:33.018805 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4af5ba5d-1ede-4540-b202-15db17301635 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:52:33.077391 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-4af5ba5d-1ede-4540-b202-15db17301635 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:52:33.084973 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-4af5ba5d-1ede-4540-b202-15db17301635 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.079112 Nov 01 01:52:33.085539 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1482/2872] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:52:33 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:52:34.101563 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-0f18d7a1-0b54-43fd-ae2f-761531d5283e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:52:34.102161 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-0f18d7a1-0b54-43fd-ae2f-761531d5283e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:52:34.109155 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0f18d7a1-0b54-43fd-ae2f-761531d5283e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:52:34.109602 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0f18d7a1-0b54-43fd-ae2f-761531d5283e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:52:34.110366 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0f18d7a1-0b54-43fd-ae2f-761531d5283e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:52:34.110829 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0f18d7a1-0b54-43fd-ae2f-761531d5283e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:52:34.168979 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-0f18d7a1-0b54-43fd-ae2f-761531d5283e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:52:34.176651 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-0f18d7a1-0b54-43fd-ae2f-761531d5283e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.078712 Nov 01 01:52:34.177207 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1391/2873] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:52:34 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:52:35.193127 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-2916dbce-1976-4769-b4fa-502b0c8bd065 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:52:35.193732 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-2916dbce-1976-4769-b4fa-502b0c8bd065 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:52:35.199995 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-2916dbce-1976-4769-b4fa-502b0c8bd065 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:52:35.200432 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-2916dbce-1976-4769-b4fa-502b0c8bd065 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:52:35.201183 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-2916dbce-1976-4769-b4fa-502b0c8bd065 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:52:35.201606 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-2916dbce-1976-4769-b4fa-502b0c8bd065 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:52:35.259428 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-2916dbce-1976-4769-b4fa-502b0c8bd065 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:52:35.267673 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-2916dbce-1976-4769-b4fa-502b0c8bd065 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.078138 Nov 01 01:52:35.268229 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1483/2874] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:52:35 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:52:36.284223 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-dd718991-b713-45eb-92c1-079daa8451b3 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:52:36.284866 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-dd718991-b713-45eb-92c1-079daa8451b3 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:52:36.291132 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-dd718991-b713-45eb-92c1-079daa8451b3 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:52:36.291577 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-dd718991-b713-45eb-92c1-079daa8451b3 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:52:36.292335 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-dd718991-b713-45eb-92c1-079daa8451b3 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:52:36.293308 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-dd718991-b713-45eb-92c1-079daa8451b3 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:52:36.356981 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-dd718991-b713-45eb-92c1-079daa8451b3 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:52:36.364684 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-dd718991-b713-45eb-92c1-079daa8451b3 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.084101 Nov 01 01:52:36.365260 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1392/2875] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:52:36 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:52:37.380838 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-13127328-7b8e-4fb8-89ed-1e59fece13d8 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:52:37.381449 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-13127328-7b8e-4fb8-89ed-1e59fece13d8 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:52:37.387880 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-13127328-7b8e-4fb8-89ed-1e59fece13d8 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:52:37.388325 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-13127328-7b8e-4fb8-89ed-1e59fece13d8 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:52:37.389114 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-13127328-7b8e-4fb8-89ed-1e59fece13d8 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:52:37.389542 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-13127328-7b8e-4fb8-89ed-1e59fece13d8 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:52:37.449797 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-13127328-7b8e-4fb8-89ed-1e59fece13d8 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:52:37.457302 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-13127328-7b8e-4fb8-89ed-1e59fece13d8 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.080158 Nov 01 01:52:37.457855 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1484/2876] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:52:37 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:52:38.473838 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-4984ccea-3fdb-4bc4-8710-63184e948af0 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:52:38.474447 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-4984ccea-3fdb-4bc4-8710-63184e948af0 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:52:38.481073 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4984ccea-3fdb-4bc4-8710-63184e948af0 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:52:38.481509 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4984ccea-3fdb-4bc4-8710-63184e948af0 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:52:38.482253 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4984ccea-3fdb-4bc4-8710-63184e948af0 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:52:38.482708 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4984ccea-3fdb-4bc4-8710-63184e948af0 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:52:38.539525 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-4984ccea-3fdb-4bc4-8710-63184e948af0 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:52:38.547534 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-4984ccea-3fdb-4bc4-8710-63184e948af0 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.077310 Nov 01 01:52:38.548082 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1393/2877] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:52:38 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:52:39.564409 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-7a225930-adec-47bb-a486-f2150692c340 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:52:39.565016 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-7a225930-adec-47bb-a486-f2150692c340 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:52:39.571361 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-7a225930-adec-47bb-a486-f2150692c340 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:52:39.571805 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-7a225930-adec-47bb-a486-f2150692c340 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:52:39.572561 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-7a225930-adec-47bb-a486-f2150692c340 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:52:39.572991 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-7a225930-adec-47bb-a486-f2150692c340 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:52:39.630645 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-7a225930-adec-47bb-a486-f2150692c340 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:52:39.638332 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-7a225930-adec-47bb-a486-f2150692c340 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.077754 Nov 01 01:52:39.638927 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1485/2878] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:52:39 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:52:40.655776 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-c2d4337c-1dfd-46b6-9c55-49327c8082d1 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:52:40.656330 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-c2d4337c-1dfd-46b6-9c55-49327c8082d1 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:52:40.662508 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c2d4337c-1dfd-46b6-9c55-49327c8082d1 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:52:40.662964 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c2d4337c-1dfd-46b6-9c55-49327c8082d1 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:52:40.663715 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c2d4337c-1dfd-46b6-9c55-49327c8082d1 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:52:40.664152 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c2d4337c-1dfd-46b6-9c55-49327c8082d1 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:52:40.722553 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-c2d4337c-1dfd-46b6-9c55-49327c8082d1 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:52:40.730173 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-c2d4337c-1dfd-46b6-9c55-49327c8082d1 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.078727 Nov 01 01:52:40.730775 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1394/2879] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:52:40 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:52:41.746792 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-0d84663a-f773-411e-a86b-a8c67aae677e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:52:41.747386 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-0d84663a-f773-411e-a86b-a8c67aae677e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:52:41.753598 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0d84663a-f773-411e-a86b-a8c67aae677e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:52:41.754064 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0d84663a-f773-411e-a86b-a8c67aae677e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:52:41.754857 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0d84663a-f773-411e-a86b-a8c67aae677e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:52:41.755285 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0d84663a-f773-411e-a86b-a8c67aae677e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:52:41.813682 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-0d84663a-f773-411e-a86b-a8c67aae677e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:52:41.821518 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-0d84663a-f773-411e-a86b-a8c67aae677e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.078357 Nov 01 01:52:41.822073 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1486/2880] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:52:41 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:52:42.837859 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-82673428-150c-4614-9166-50dc1321995e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:52:42.838508 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-82673428-150c-4614-9166-50dc1321995e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:52:42.844655 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-82673428-150c-4614-9166-50dc1321995e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:52:42.845102 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-82673428-150c-4614-9166-50dc1321995e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:52:42.845858 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-82673428-150c-4614-9166-50dc1321995e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:52:42.846287 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-82673428-150c-4614-9166-50dc1321995e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:52:42.907555 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-82673428-150c-4614-9166-50dc1321995e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:52:42.915423 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-82673428-150c-4614-9166-50dc1321995e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.081194 Nov 01 01:52:42.916018 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1395/2881] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:52:42 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:52:43.932635 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-f637ee34-cb16-4b2d-9278-2c7937c297a3 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:52:43.933753 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-f637ee34-cb16-4b2d-9278-2c7937c297a3 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:52:43.940060 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f637ee34-cb16-4b2d-9278-2c7937c297a3 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:52:43.940506 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f637ee34-cb16-4b2d-9278-2c7937c297a3 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:52:43.941263 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f637ee34-cb16-4b2d-9278-2c7937c297a3 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:52:43.941694 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f637ee34-cb16-4b2d-9278-2c7937c297a3 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:52:44.000705 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-f637ee34-cb16-4b2d-9278-2c7937c297a3 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:52:44.008462 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-f637ee34-cb16-4b2d-9278-2c7937c297a3 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.079715 Nov 01 01:52:44.009016 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1487/2882] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:52:43 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:52:45.025349 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-ab25a7d2-973c-4030-9ecd-8372bfb1a9e8 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:52:45.025953 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-ab25a7d2-973c-4030-9ecd-8372bfb1a9e8 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:52:45.032710 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ab25a7d2-973c-4030-9ecd-8372bfb1a9e8 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:52:45.033147 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ab25a7d2-973c-4030-9ecd-8372bfb1a9e8 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:52:45.033926 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ab25a7d2-973c-4030-9ecd-8372bfb1a9e8 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:52:45.034346 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ab25a7d2-973c-4030-9ecd-8372bfb1a9e8 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:52:45.092690 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-ab25a7d2-973c-4030-9ecd-8372bfb1a9e8 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:52:45.100271 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-ab25a7d2-973c-4030-9ecd-8372bfb1a9e8 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.078566 Nov 01 01:52:45.100818 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1396/2883] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:52:45 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:52:46.116502 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-49300e14-8eb1-439b-a7be-2046e699905a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:52:46.117105 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-49300e14-8eb1-439b-a7be-2046e699905a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:52:46.123362 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-49300e14-8eb1-439b-a7be-2046e699905a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:52:46.123832 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-49300e14-8eb1-439b-a7be-2046e699905a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:52:46.124582 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-49300e14-8eb1-439b-a7be-2046e699905a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:52:46.125010 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-49300e14-8eb1-439b-a7be-2046e699905a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:52:46.183524 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-49300e14-8eb1-439b-a7be-2046e699905a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:52:46.191106 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-49300e14-8eb1-439b-a7be-2046e699905a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.078257 Nov 01 01:52:46.191664 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1488/2884] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:52:46 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:52:47.207405 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-b9dd22a6-d86f-46c2-8a5c-46811d188d63 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:52:47.208005 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-b9dd22a6-d86f-46c2-8a5c-46811d188d63 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:52:47.214185 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b9dd22a6-d86f-46c2-8a5c-46811d188d63 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:52:47.214659 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b9dd22a6-d86f-46c2-8a5c-46811d188d63 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:52:47.215406 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b9dd22a6-d86f-46c2-8a5c-46811d188d63 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:52:47.215826 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b9dd22a6-d86f-46c2-8a5c-46811d188d63 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:52:47.273303 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-b9dd22a6-d86f-46c2-8a5c-46811d188d63 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:52:47.281001 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-b9dd22a6-d86f-46c2-8a5c-46811d188d63 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.077237 Nov 01 01:52:47.281551 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1397/2885] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:52:47 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:52:48.296437 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-1d08aff7-0cfa-4dbd-9a21-454fb29917b4 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:52:48.297071 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-1d08aff7-0cfa-4dbd-9a21-454fb29917b4 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:52:48.303276 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-1d08aff7-0cfa-4dbd-9a21-454fb29917b4 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:52:48.303716 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-1d08aff7-0cfa-4dbd-9a21-454fb29917b4 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:52:48.304472 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-1d08aff7-0cfa-4dbd-9a21-454fb29917b4 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:52:48.304900 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-1d08aff7-0cfa-4dbd-9a21-454fb29917b4 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:52:48.363393 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-1d08aff7-0cfa-4dbd-9a21-454fb29917b4 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:52:48.371671 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-1d08aff7-0cfa-4dbd-9a21-454fb29917b4 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.078879 Nov 01 01:52:48.372225 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1489/2886] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:52:48 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:52:49.387829 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-2225fb8f-5cc5-4628-ac1f-9a71ac222389 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:52:49.388465 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-2225fb8f-5cc5-4628-ac1f-9a71ac222389 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:52:49.394732 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2225fb8f-5cc5-4628-ac1f-9a71ac222389 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:52:49.395173 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2225fb8f-5cc5-4628-ac1f-9a71ac222389 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:52:49.395935 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2225fb8f-5cc5-4628-ac1f-9a71ac222389 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:52:49.396365 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2225fb8f-5cc5-4628-ac1f-9a71ac222389 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:52:49.457377 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-2225fb8f-5cc5-4628-ac1f-9a71ac222389 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:52:49.464976 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-2225fb8f-5cc5-4628-ac1f-9a71ac222389 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.081493 Nov 01 01:52:49.465537 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1398/2887] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:52:49 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:52:50.481605 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-3d2ee892-361b-4de4-9560-8966310cda6d tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:52:50.482244 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-3d2ee892-361b-4de4-9560-8966310cda6d tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:52:50.488452 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3d2ee892-361b-4de4-9560-8966310cda6d tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:52:50.488895 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3d2ee892-361b-4de4-9560-8966310cda6d tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:52:50.489654 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3d2ee892-361b-4de4-9560-8966310cda6d tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:52:50.490080 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3d2ee892-361b-4de4-9560-8966310cda6d tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:52:50.548548 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-3d2ee892-361b-4de4-9560-8966310cda6d tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:52:50.556374 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-3d2ee892-361b-4de4-9560-8966310cda6d tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.078192 Nov 01 01:52:50.556927 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1490/2888] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:52:50 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:52:51.572728 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-2906a59e-1744-4346-aad1-e034822583dc tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:52:51.573499 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-2906a59e-1744-4346-aad1-e034822583dc tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:52:51.580027 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2906a59e-1744-4346-aad1-e034822583dc tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:52:51.580472 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2906a59e-1744-4346-aad1-e034822583dc tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:52:51.581228 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2906a59e-1744-4346-aad1-e034822583dc tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:52:51.581658 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2906a59e-1744-4346-aad1-e034822583dc tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:52:51.640998 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-2906a59e-1744-4346-aad1-e034822583dc tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:52:51.648616 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-2906a59e-1744-4346-aad1-e034822583dc tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.079526 Nov 01 01:52:51.649172 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1399/2889] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:52:51 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:52:52.665459 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-59322114-8953-4bea-bc86-b6cfefb8f785 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:52:52.666033 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-59322114-8953-4bea-bc86-b6cfefb8f785 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:52:52.672744 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-59322114-8953-4bea-bc86-b6cfefb8f785 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:52:52.673190 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-59322114-8953-4bea-bc86-b6cfefb8f785 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:52:52.673944 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-59322114-8953-4bea-bc86-b6cfefb8f785 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:52:52.674369 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-59322114-8953-4bea-bc86-b6cfefb8f785 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:52:52.734830 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-59322114-8953-4bea-bc86-b6cfefb8f785 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:52:52.742397 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-59322114-8953-4bea-bc86-b6cfefb8f785 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.080621 Nov 01 01:52:52.742981 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1491/2890] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:52:52 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:52:53.759699 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-3fecd794-0b64-452e-a198-7576637ca20a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:52:53.760294 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-3fecd794-0b64-452e-a198-7576637ca20a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:52:53.767150 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3fecd794-0b64-452e-a198-7576637ca20a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:52:53.767595 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3fecd794-0b64-452e-a198-7576637ca20a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:52:53.768362 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3fecd794-0b64-452e-a198-7576637ca20a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:52:53.768793 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3fecd794-0b64-452e-a198-7576637ca20a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:52:53.827587 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-3fecd794-0b64-452e-a198-7576637ca20a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:52:53.835235 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-3fecd794-0b64-452e-a198-7576637ca20a tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.079241 Nov 01 01:52:53.835805 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1400/2891] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:52:53 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:52:54.851820 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-60a4a6f5-4268-48e5-9e7f-c981f4554d09 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:52:54.852456 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-60a4a6f5-4268-48e5-9e7f-c981f4554d09 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:52:54.858665 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-60a4a6f5-4268-48e5-9e7f-c981f4554d09 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:52:54.859102 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-60a4a6f5-4268-48e5-9e7f-c981f4554d09 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:52:54.859846 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-60a4a6f5-4268-48e5-9e7f-c981f4554d09 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:52:54.860270 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-60a4a6f5-4268-48e5-9e7f-c981f4554d09 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:52:54.919713 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-60a4a6f5-4268-48e5-9e7f-c981f4554d09 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:52:54.927299 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-60a4a6f5-4268-48e5-9e7f-c981f4554d09 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.079132 Nov 01 01:52:54.927853 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1492/2892] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:52:54 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:52:55.943916 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-db422de3-d41e-4ebe-ad3a-73f944f72f86 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:52:55.944550 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-db422de3-d41e-4ebe-ad3a-73f944f72f86 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:52:55.950466 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-db422de3-d41e-4ebe-ad3a-73f944f72f86 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:52:55.950920 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-db422de3-d41e-4ebe-ad3a-73f944f72f86 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:52:55.951670 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-db422de3-d41e-4ebe-ad3a-73f944f72f86 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:52:55.952101 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-db422de3-d41e-4ebe-ad3a-73f944f72f86 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:52:56.013509 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-db422de3-d41e-4ebe-ad3a-73f944f72f86 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:52:56.021528 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-db422de3-d41e-4ebe-ad3a-73f944f72f86 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.081233 Nov 01 01:52:56.022079 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1401/2893] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:52:55 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:52:57.037522 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-564bcacd-1a24-4086-86d4-c75dfa2d9947 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:52:57.038120 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-564bcacd-1a24-4086-86d4-c75dfa2d9947 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:52:57.044800 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-564bcacd-1a24-4086-86d4-c75dfa2d9947 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:52:57.045237 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-564bcacd-1a24-4086-86d4-c75dfa2d9947 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:52:57.045984 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-564bcacd-1a24-4086-86d4-c75dfa2d9947 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:52:57.046409 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-564bcacd-1a24-4086-86d4-c75dfa2d9947 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:52:57.104301 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-564bcacd-1a24-4086-86d4-c75dfa2d9947 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:52:57.112403 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-564bcacd-1a24-4086-86d4-c75dfa2d9947 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.078675 Nov 01 01:52:57.112961 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1493/2894] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:52:57 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:52:58.129547 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-6e0e48de-ba3d-435c-a554-cee65a98408f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:52:58.130127 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-6e0e48de-ba3d-435c-a554-cee65a98408f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:52:58.137090 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6e0e48de-ba3d-435c-a554-cee65a98408f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:52:58.137529 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6e0e48de-ba3d-435c-a554-cee65a98408f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:52:58.138282 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6e0e48de-ba3d-435c-a554-cee65a98408f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:52:58.138737 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6e0e48de-ba3d-435c-a554-cee65a98408f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:52:58.196178 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-6e0e48de-ba3d-435c-a554-cee65a98408f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:52:58.204415 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-6e0e48de-ba3d-435c-a554-cee65a98408f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.078497 Nov 01 01:52:58.204977 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1402/2895] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:52:58 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:52:58.291337 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 01 01:52:58.291506 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: Mon Nov 1 01:52:58 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 01 01:52:59.221184 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-b590bc5a-5fd8-40cd-9545-0c544a9e6cb1 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:52:59.221790 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-b590bc5a-5fd8-40cd-9545-0c544a9e6cb1 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:52:59.227972 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b590bc5a-5fd8-40cd-9545-0c544a9e6cb1 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:52:59.228409 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b590bc5a-5fd8-40cd-9545-0c544a9e6cb1 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:52:59.229153 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b590bc5a-5fd8-40cd-9545-0c544a9e6cb1 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:52:59.229574 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b590bc5a-5fd8-40cd-9545-0c544a9e6cb1 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:52:59.287901 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-b590bc5a-5fd8-40cd-9545-0c544a9e6cb1 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:52:59.295557 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-b590bc5a-5fd8-40cd-9545-0c544a9e6cb1 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.078022 Nov 01 01:52:59.296111 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1494/2896] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:52:59 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:53:00.312200 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-bcfe62e9-73b8-4b51-893e-cd4daebab1c1 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:53:00.312761 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-bcfe62e9-73b8-4b51-893e-cd4daebab1c1 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:53:00.319729 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-bcfe62e9-73b8-4b51-893e-cd4daebab1c1 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:53:00.320172 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-bcfe62e9-73b8-4b51-893e-cd4daebab1c1 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:53:00.320943 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-bcfe62e9-73b8-4b51-893e-cd4daebab1c1 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:53:00.321373 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-bcfe62e9-73b8-4b51-893e-cd4daebab1c1 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:53:00.381967 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-bcfe62e9-73b8-4b51-893e-cd4daebab1c1 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:53:00.389813 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-bcfe62e9-73b8-4b51-893e-cd4daebab1c1 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.081396 Nov 01 01:53:00.390365 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1403/2897] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:53:00 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:53:01.405449 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-a00772be-3cde-485d-a053-139ec1197e04 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:53:01.406054 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-a00772be-3cde-485d-a053-139ec1197e04 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:53:01.412323 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a00772be-3cde-485d-a053-139ec1197e04 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:53:01.412767 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a00772be-3cde-485d-a053-139ec1197e04 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:53:01.413520 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a00772be-3cde-485d-a053-139ec1197e04 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:53:01.413951 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a00772be-3cde-485d-a053-139ec1197e04 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:53:01.472006 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-a00772be-3cde-485d-a053-139ec1197e04 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:53:01.480028 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-a00772be-3cde-485d-a053-139ec1197e04 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.077671 Nov 01 01:53:01.480578 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1495/2898] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:53:01 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:53:02.496942 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-20f7846d-3a5b-479b-8b5c-53e7bfe08980 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:53:02.497548 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-20f7846d-3a5b-479b-8b5c-53e7bfe08980 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:53:02.503800 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-20f7846d-3a5b-479b-8b5c-53e7bfe08980 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:53:02.504245 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-20f7846d-3a5b-479b-8b5c-53e7bfe08980 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:53:02.504999 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-20f7846d-3a5b-479b-8b5c-53e7bfe08980 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:53:02.505429 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-20f7846d-3a5b-479b-8b5c-53e7bfe08980 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:53:02.566454 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-20f7846d-3a5b-479b-8b5c-53e7bfe08980 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:53:02.574072 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-20f7846d-3a5b-479b-8b5c-53e7bfe08980 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.081364 Nov 01 01:53:02.574658 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1404/2899] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:53:02 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:53:03.590529 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-79679eb1-a9ef-4ada-a6c8-fc06bd33b859 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:53:03.591140 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-79679eb1-a9ef-4ada-a6c8-fc06bd33b859 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:53:03.597434 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-79679eb1-a9ef-4ada-a6c8-fc06bd33b859 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:53:03.597880 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-79679eb1-a9ef-4ada-a6c8-fc06bd33b859 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:53:03.598671 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-79679eb1-a9ef-4ada-a6c8-fc06bd33b859 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:53:03.599102 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-79679eb1-a9ef-4ada-a6c8-fc06bd33b859 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:53:03.657399 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-79679eb1-a9ef-4ada-a6c8-fc06bd33b859 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:53:03.665016 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-79679eb1-a9ef-4ada-a6c8-fc06bd33b859 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.078218 Nov 01 01:53:03.665575 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1496/2900] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:53:03 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:53:04.682118 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-0871ca48-f017-4cb5-b282-424f1294ce81 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:53:04.682742 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-0871ca48-f017-4cb5-b282-424f1294ce81 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:53:04.688916 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0871ca48-f017-4cb5-b282-424f1294ce81 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:53:04.689355 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0871ca48-f017-4cb5-b282-424f1294ce81 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:53:04.690095 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0871ca48-f017-4cb5-b282-424f1294ce81 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:53:04.690549 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0871ca48-f017-4cb5-b282-424f1294ce81 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:53:04.748908 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-0871ca48-f017-4cb5-b282-424f1294ce81 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:53:04.756433 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-0871ca48-f017-4cb5-b282-424f1294ce81 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.078237 Nov 01 01:53:04.756991 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1405/2901] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:53:04 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:53:05.226271 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 01 01:53:05.226478 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: Mon Nov 1 01:53:05 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 01 01:53:05.773019 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-4bb5a0b5-92bb-433e-b093-70ee53240677 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:53:05.773623 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-4bb5a0b5-92bb-433e-b093-70ee53240677 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:53:05.780360 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4bb5a0b5-92bb-433e-b093-70ee53240677 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:53:05.780779 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4bb5a0b5-92bb-433e-b093-70ee53240677 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:53:05.781527 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4bb5a0b5-92bb-433e-b093-70ee53240677 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:53:05.781948 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4bb5a0b5-92bb-433e-b093-70ee53240677 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:53:05.839389 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-4bb5a0b5-92bb-433e-b093-70ee53240677 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:53:05.847423 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-4bb5a0b5-92bb-433e-b093-70ee53240677 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.078111 Nov 01 01:53:05.847980 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1497/2902] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:53:05 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:53:06.864359 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-c0c332af-a2e2-49a7-b55c-de91f43f7793 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:53:06.864955 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-c0c332af-a2e2-49a7-b55c-de91f43f7793 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:53:06.871804 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c0c332af-a2e2-49a7-b55c-de91f43f7793 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:53:06.872243 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c0c332af-a2e2-49a7-b55c-de91f43f7793 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:53:06.872990 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c0c332af-a2e2-49a7-b55c-de91f43f7793 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:53:06.873414 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c0c332af-a2e2-49a7-b55c-de91f43f7793 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:53:06.933103 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-c0c332af-a2e2-49a7-b55c-de91f43f7793 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:53:06.941378 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-c0c332af-a2e2-49a7-b55c-de91f43f7793 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.080654 Nov 01 01:53:06.941932 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1406/2903] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:53:06 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:53:07.956850 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-54a0244b-d4e0-4dd8-b21a-76fc4047cf1c tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:53:07.957444 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-54a0244b-d4e0-4dd8-b21a-76fc4047cf1c tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:53:07.963695 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-54a0244b-d4e0-4dd8-b21a-76fc4047cf1c tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:53:07.964139 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-54a0244b-d4e0-4dd8-b21a-76fc4047cf1c tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:53:07.964895 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-54a0244b-d4e0-4dd8-b21a-76fc4047cf1c tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:53:07.965325 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-54a0244b-d4e0-4dd8-b21a-76fc4047cf1c tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:53:08.024614 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-54a0244b-d4e0-4dd8-b21a-76fc4047cf1c tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:53:08.032277 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-54a0244b-d4e0-4dd8-b21a-76fc4047cf1c tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.079108 Nov 01 01:53:08.032831 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1498/2904] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:53:07 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:53:09.049576 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-811a438b-018a-4aef-9189-50905ecd59b0 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:53:09.050387 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-811a438b-018a-4aef-9189-50905ecd59b0 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:53:09.057011 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-811a438b-018a-4aef-9189-50905ecd59b0 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:53:09.057453 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-811a438b-018a-4aef-9189-50905ecd59b0 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:53:09.058206 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-811a438b-018a-4aef-9189-50905ecd59b0 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:53:09.059327 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-811a438b-018a-4aef-9189-50905ecd59b0 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:53:09.120244 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-811a438b-018a-4aef-9189-50905ecd59b0 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:53:09.128694 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-811a438b-018a-4aef-9189-50905ecd59b0 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.082741 Nov 01 01:53:09.129248 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1407/2905] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:53:09 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:53:10.144840 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-aadfb59f-8901-450d-93d3-b7a6ab9fec39 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:53:10.145435 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-aadfb59f-8901-450d-93d3-b7a6ab9fec39 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:53:10.151693 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-aadfb59f-8901-450d-93d3-b7a6ab9fec39 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:53:10.152143 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-aadfb59f-8901-450d-93d3-b7a6ab9fec39 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:53:10.152900 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-aadfb59f-8901-450d-93d3-b7a6ab9fec39 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:53:10.153368 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-aadfb59f-8901-450d-93d3-b7a6ab9fec39 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:53:10.212397 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-aadfb59f-8901-450d-93d3-b7a6ab9fec39 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:53:10.220082 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-aadfb59f-8901-450d-93d3-b7a6ab9fec39 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.078967 Nov 01 01:53:10.220638 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1499/2906] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:53:10 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:53:11.236046 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-74cede36-c31c-4a78-bbef-54d764e8ea41 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:53:11.236685 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-74cede36-c31c-4a78-bbef-54d764e8ea41 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:53:11.242894 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-74cede36-c31c-4a78-bbef-54d764e8ea41 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:53:11.243332 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-74cede36-c31c-4a78-bbef-54d764e8ea41 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:53:11.244079 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-74cede36-c31c-4a78-bbef-54d764e8ea41 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:53:11.244505 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-74cede36-c31c-4a78-bbef-54d764e8ea41 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:53:11.302228 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-74cede36-c31c-4a78-bbef-54d764e8ea41 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:53:11.310130 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-74cede36-c31c-4a78-bbef-54d764e8ea41 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.077761 Nov 01 01:53:11.310718 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1408/2907] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:53:11 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:53:12.327106 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-ca15d387-22b3-4cb5-bf86-99278bc362d0 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:53:12.327740 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-ca15d387-22b3-4cb5-bf86-99278bc362d0 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:53:12.333861 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ca15d387-22b3-4cb5-bf86-99278bc362d0 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:53:12.334297 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ca15d387-22b3-4cb5-bf86-99278bc362d0 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:53:12.335071 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ca15d387-22b3-4cb5-bf86-99278bc362d0 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:53:12.335495 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ca15d387-22b3-4cb5-bf86-99278bc362d0 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:53:12.394210 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-ca15d387-22b3-4cb5-bf86-99278bc362d0 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:53:12.401929 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-ca15d387-22b3-4cb5-bf86-99278bc362d0 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.079122 Nov 01 01:53:12.402501 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1500/2908] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:53:12 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:53:13.418435 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-c1b19cce-8d0e-49f8-8ba9-cd039cd5c6a0 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:53:13.419095 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-c1b19cce-8d0e-49f8-8ba9-cd039cd5c6a0 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:53:13.425483 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c1b19cce-8d0e-49f8-8ba9-cd039cd5c6a0 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:53:13.425931 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c1b19cce-8d0e-49f8-8ba9-cd039cd5c6a0 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:53:13.426714 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c1b19cce-8d0e-49f8-8ba9-cd039cd5c6a0 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:53:13.427148 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c1b19cce-8d0e-49f8-8ba9-cd039cd5c6a0 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:53:13.486123 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-c1b19cce-8d0e-49f8-8ba9-cd039cd5c6a0 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:53:13.493656 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-c1b19cce-8d0e-49f8-8ba9-cd039cd5c6a0 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.078959 Nov 01 01:53:13.494202 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1409/2909] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:53:13 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:53:14.510183 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-5ef75d67-ea8a-4ce5-a1e5-5cb19b9f15f3 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:53:14.510853 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-5ef75d67-ea8a-4ce5-a1e5-5cb19b9f15f3 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:53:14.517070 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-5ef75d67-ea8a-4ce5-a1e5-5cb19b9f15f3 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:53:14.517514 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-5ef75d67-ea8a-4ce5-a1e5-5cb19b9f15f3 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:53:14.518294 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-5ef75d67-ea8a-4ce5-a1e5-5cb19b9f15f3 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:53:14.518752 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-5ef75d67-ea8a-4ce5-a1e5-5cb19b9f15f3 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:53:14.577020 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-5ef75d67-ea8a-4ce5-a1e5-5cb19b9f15f3 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:53:14.584567 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-5ef75d67-ea8a-4ce5-a1e5-5cb19b9f15f3 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.078054 Nov 01 01:53:14.585118 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1501/2910] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:53:14 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:53:15.601439 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-0ec5a1c1-bdc3-4332-a461-3336f69eddd3 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:53:15.602029 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-0ec5a1c1-bdc3-4332-a461-3336f69eddd3 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:53:15.608265 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0ec5a1c1-bdc3-4332-a461-3336f69eddd3 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:53:15.608693 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0ec5a1c1-bdc3-4332-a461-3336f69eddd3 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:53:15.609476 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0ec5a1c1-bdc3-4332-a461-3336f69eddd3 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:53:15.609906 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0ec5a1c1-bdc3-4332-a461-3336f69eddd3 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:53:15.671216 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-0ec5a1c1-bdc3-4332-a461-3336f69eddd3 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:53:15.678835 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-0ec5a1c1-bdc3-4332-a461-3336f69eddd3 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.081040 Nov 01 01:53:15.679389 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1410/2911] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:53:15 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:53:16.696114 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-4b149903-bb2a-4a49-816e-ba026cb53f61 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:53:16.696724 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-4b149903-bb2a-4a49-816e-ba026cb53f61 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:53:16.703507 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4b149903-bb2a-4a49-816e-ba026cb53f61 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:53:16.703954 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4b149903-bb2a-4a49-816e-ba026cb53f61 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:53:16.704748 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4b149903-bb2a-4a49-816e-ba026cb53f61 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:53:16.705178 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4b149903-bb2a-4a49-816e-ba026cb53f61 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:53:16.765180 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-4b149903-bb2a-4a49-816e-ba026cb53f61 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:53:16.772922 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-4b149903-bb2a-4a49-816e-ba026cb53f61 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.080563 Nov 01 01:53:16.773477 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1502/2912] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:53:16 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:53:17.789960 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-e7920ae4-7ad1-4f94-92c7-675b8a4b7d99 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:53:17.790609 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-e7920ae4-7ad1-4f94-92c7-675b8a4b7d99 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:53:17.797400 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e7920ae4-7ad1-4f94-92c7-675b8a4b7d99 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:53:17.797831 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e7920ae4-7ad1-4f94-92c7-675b8a4b7d99 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:53:17.798619 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e7920ae4-7ad1-4f94-92c7-675b8a4b7d99 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:53:17.799048 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e7920ae4-7ad1-4f94-92c7-675b8a4b7d99 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:53:17.857336 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-e7920ae4-7ad1-4f94-92c7-675b8a4b7d99 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:53:17.864944 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-e7920ae4-7ad1-4f94-92c7-675b8a4b7d99 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.078742 Nov 01 01:53:17.865527 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1411/2913] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:53:17 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:53:18.880957 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-56c4f864-f97e-493a-9b4e-386207ef9182 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:53:18.881567 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-56c4f864-f97e-493a-9b4e-386207ef9182 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:53:18.888465 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-56c4f864-f97e-493a-9b4e-386207ef9182 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:53:18.888753 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-56c4f864-f97e-493a-9b4e-386207ef9182 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:53:18.889509 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-56c4f864-f97e-493a-9b4e-386207ef9182 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:53:18.889937 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-56c4f864-f97e-493a-9b4e-386207ef9182 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:53:18.949371 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-56c4f864-f97e-493a-9b4e-386207ef9182 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:53:18.956976 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-56c4f864-f97e-493a-9b4e-386207ef9182 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.079661 Nov 01 01:53:18.957539 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1503/2914] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:53:18 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:53:19.973334 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-bb004c2a-63fa-480b-9731-043260958b2e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:53:19.973936 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-bb004c2a-63fa-480b-9731-043260958b2e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:53:19.980201 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-bb004c2a-63fa-480b-9731-043260958b2e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:53:19.980645 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-bb004c2a-63fa-480b-9731-043260958b2e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:53:19.981403 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-bb004c2a-63fa-480b-9731-043260958b2e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:53:19.981833 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-bb004c2a-63fa-480b-9731-043260958b2e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:53:20.045152 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-bb004c2a-63fa-480b-9731-043260958b2e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:53:20.053552 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-bb004c2a-63fa-480b-9731-043260958b2e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.083817 Nov 01 01:53:20.054124 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1412/2915] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:53:19 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:53:21.070735 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-dc42e06e-3310-4579-b200-d031c6b4f943 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:53:21.071351 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-dc42e06e-3310-4579-b200-d031c6b4f943 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:53:21.077511 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-dc42e06e-3310-4579-b200-d031c6b4f943 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:53:21.077959 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-dc42e06e-3310-4579-b200-d031c6b4f943 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:53:21.078747 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-dc42e06e-3310-4579-b200-d031c6b4f943 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:53:21.079179 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-dc42e06e-3310-4579-b200-d031c6b4f943 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:53:21.139236 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-dc42e06e-3310-4579-b200-d031c6b4f943 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:53:21.146804 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-dc42e06e-3310-4579-b200-d031c6b4f943 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.079698 Nov 01 01:53:21.147362 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1504/2916] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:53:21 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:53:22.163146 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-4397dbb5-acaf-48ec-b8d1-252f7b32213f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:53:22.163733 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-4397dbb5-acaf-48ec-b8d1-252f7b32213f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:53:22.169884 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4397dbb5-acaf-48ec-b8d1-252f7b32213f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:53:22.170321 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4397dbb5-acaf-48ec-b8d1-252f7b32213f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:53:22.171213 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4397dbb5-acaf-48ec-b8d1-252f7b32213f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:53:22.171647 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4397dbb5-acaf-48ec-b8d1-252f7b32213f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:53:22.233499 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-4397dbb5-acaf-48ec-b8d1-252f7b32213f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:53:22.241081 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-4397dbb5-acaf-48ec-b8d1-252f7b32213f tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.081596 Nov 01 01:53:22.241633 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1413/2917] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:53:22 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:53:23.258046 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-dc0b35d2-2892-4055-974b-86dcef015e9d tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:53:23.258715 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-dc0b35d2-2892-4055-974b-86dcef015e9d tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:53:23.265544 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-dc0b35d2-2892-4055-974b-86dcef015e9d tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:53:23.265995 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-dc0b35d2-2892-4055-974b-86dcef015e9d tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:53:23.266877 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-dc0b35d2-2892-4055-974b-86dcef015e9d tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:53:23.267313 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-dc0b35d2-2892-4055-974b-86dcef015e9d tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:53:23.325776 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-dc0b35d2-2892-4055-974b-86dcef015e9d tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:53:23.333455 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-dc0b35d2-2892-4055-974b-86dcef015e9d tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.079099 Nov 01 01:53:23.334015 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1505/2918] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:53:23 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:53:24.350279 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-e88c0a8c-a817-409b-a6ce-449a63bf1c5e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:53:24.350909 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-e88c0a8c-a817-409b-a6ce-449a63bf1c5e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:53:24.357795 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e88c0a8c-a817-409b-a6ce-449a63bf1c5e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:53:24.358243 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e88c0a8c-a817-409b-a6ce-449a63bf1c5e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:53:24.359029 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e88c0a8c-a817-409b-a6ce-449a63bf1c5e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:53:24.359460 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e88c0a8c-a817-409b-a6ce-449a63bf1c5e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:53:24.425041 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-e88c0a8c-a817-409b-a6ce-449a63bf1c5e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:53:24.433269 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-e88c0a8c-a817-409b-a6ce-449a63bf1c5e tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.086442 Nov 01 01:53:24.433833 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1414/2919] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:53:24 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:53:25.450103 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-8d1572fb-f20d-414c-8f85-b109f92250a3 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:53:25.452175 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-8d1572fb-f20d-414c-8f85-b109f92250a3 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:53:25.458178 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8d1572fb-f20d-414c-8f85-b109f92250a3 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:53:25.459042 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8d1572fb-f20d-414c-8f85-b109f92250a3 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:53:25.460430 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8d1572fb-f20d-414c-8f85-b109f92250a3 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:53:25.461240 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8d1572fb-f20d-414c-8f85-b109f92250a3 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:53:25.522106 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-8d1572fb-f20d-414c-8f85-b109f92250a3 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:53:25.529765 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-8d1572fb-f20d-414c-8f85-b109f92250a3 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.083534 Nov 01 01:53:25.530321 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1506/2920] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:53:25 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:53:26.546136 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-e586db55-6ad9-488e-a38b-66cf98ab6c58 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:53:26.546764 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-e586db55-6ad9-488e-a38b-66cf98ab6c58 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:53:26.552807 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e586db55-6ad9-488e-a38b-66cf98ab6c58 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:53:26.553251 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e586db55-6ad9-488e-a38b-66cf98ab6c58 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:53:26.554022 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e586db55-6ad9-488e-a38b-66cf98ab6c58 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:53:26.554478 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e586db55-6ad9-488e-a38b-66cf98ab6c58 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:53:26.612924 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-e586db55-6ad9-488e-a38b-66cf98ab6c58 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:53:26.621252 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-e586db55-6ad9-488e-a38b-66cf98ab6c58 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.078732 Nov 01 01:53:26.621750 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1415/2921] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:53:26 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:53:27.637757 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-7680e19e-90c0-4b96-aa4a-e16e0c3b3be2 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:53:27.638372 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-7680e19e-90c0-4b96-aa4a-e16e0c3b3be2 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:53:27.644905 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-7680e19e-90c0-4b96-aa4a-e16e0c3b3be2 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:53:27.645350 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-7680e19e-90c0-4b96-aa4a-e16e0c3b3be2 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:53:27.646181 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-7680e19e-90c0-4b96-aa4a-e16e0c3b3be2 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:53:27.646717 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-7680e19e-90c0-4b96-aa4a-e16e0c3b3be2 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:53:27.710247 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-7680e19e-90c0-4b96-aa4a-e16e0c3b3be2 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:53:27.720705 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-7680e19e-90c0-4b96-aa4a-e16e0c3b3be2 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1353 microversion: 2.1 time: 0.087105 Nov 01 01:53:27.721451 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1507/2922] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:53:27 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1353 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:53:28.738063 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-1f802a49-4d6d-434a-b7ba-8d6ec0460d42 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:53:28.738715 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-1f802a49-4d6d-434a-b7ba-8d6ec0460d42 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:53:28.745071 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1f802a49-4d6d-434a-b7ba-8d6ec0460d42 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:53:28.745527 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1f802a49-4d6d-434a-b7ba-8d6ec0460d42 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:53:28.746346 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1f802a49-4d6d-434a-b7ba-8d6ec0460d42 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:53:28.746740 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1f802a49-4d6d-434a-b7ba-8d6ec0460d42 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:53:28.779134 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1f802a49-4d6d-434a-b7ba-8d6ec0460d42 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:53:28.779684 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1f802a49-4d6d-434a-b7ba-8d6ec0460d42 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:53:28.780130 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.objects.instance [None req-1f802a49-4d6d-434a-b7ba-8d6ec0460d42 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lazy-loading 'fault' on Instance uuid f02098be-ed15-45a0-a599-941cb0e1eebb {{(pid=116266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 01 01:53:28.823204 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-1f802a49-4d6d-434a-b7ba-8d6ec0460d42 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a505f0e83744cbd9cb8dadcbfdb7de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3834c4e78a0d45ac88f2ad9e4c7a8111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:53:28.831210 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-1f802a49-4d6d-434a-b7ba-8d6ec0460d42 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 200 len: 1447 microversion: 2.1 time: 0.096920 Nov 01 01:53:28.831776 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1416/2923] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:53:28 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 1447 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:53:29.855098 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-653ff3c1-a57e-49e2-920d-ee1118c737b8 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:53:29.855709 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-653ff3c1-a57e-49e2-920d-ee1118c737b8 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] [instance: f02098be-ed15-45a0-a599-941cb0e1eebb] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:53:29.862024 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-653ff3c1-a57e-49e2-920d-ee1118c737b8 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:53:29.862504 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-653ff3c1-a57e-49e2-920d-ee1118c737b8 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:53:29.863262 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-653ff3c1-a57e-49e2-920d-ee1118c737b8 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:53:29.863718 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-653ff3c1-a57e-49e2-920d-ee1118c737b8 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:53:29.877296 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.wsgi [None req-653ff3c1-a57e-49e2-920d-ee1118c737b8 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] HTTP exception thrown: Instance f02098be-ed15-45a0-a599-941cb0e1eebb could not be found. Nov 01 01:53:29.877913 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-653ff3c1-a57e-49e2-920d-ee1118c737b8 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] Returning 404 to user: Instance f02098be-ed15-45a0-a599-941cb0e1eebb could not be found. {{(pid=116267) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 01 01:53:29.878763 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-653ff3c1-a57e-49e2-920d-ee1118c737b8 tempest-ServerRescueNegativeTestJSON-16499516 tempest-ServerRescueNegativeTestJSON-16499516-project] 10.222.0.47 "GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb" status: 404 len: 111 microversion: 2.1 time: 0.033269 Nov 01 01:53:29.879289 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1508/2924] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:53:29 2021] GET /compute/v2.1/servers/f02098be-ed15-45a0-a599-941cb0e1eebb => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 01:53:36.382772 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [req-9716a2b3-70a2-45bd-b3c6-fa2597eda5e3 req-52b18d58-c00f-486a-999c-98980ec85d16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0eb63a66-7e46-40fb-9087-543fbf9cad4b", "name": "network-vif-deleted", "tag": "28667542-04d5-40d8-bfae-df6a7f6e3a3e"}]} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:53:36.384935 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 01 01:53:36.384935 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: warnings.warn(msg) Nov 01 01:53:36.392491 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [req-9716a2b3-70a2-45bd-b3c6-fa2597eda5e3 req-52b18d58-c00f-486a-999c-98980ec85d16 service nova] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:53:36.392931 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [req-9716a2b3-70a2-45bd-b3c6-fa2597eda5e3 req-52b18d58-c00f-486a-999c-98980ec85d16 service nova] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:53:36.404192 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.compute.server_external_events [req-9716a2b3-70a2-45bd-b3c6-fa2597eda5e3 req-52b18d58-c00f-486a-999c-98980ec85d16 service nova] Creating event network-vif-deleted:28667542-04d5-40d8-bfae-df6a7f6e3a3e for instance 0eb63a66-7e46-40fb-9087-543fbf9cad4b on hv-cinder-81561 Nov 01 01:53:36.410020 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [req-9716a2b3-70a2-45bd-b3c6-fa2597eda5e3 req-52b18d58-c00f-486a-999c-98980ec85d16 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031090 Nov 01 01:53:36.410888 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1417/2925] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Nov 1 01:53:36 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:53:36.694319 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-020c0662-edc6-4940-8b9d-fce4cf551112 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-234051324", "imageRef": "b9068d8d-b02d-4043-9f0c-3d774cb372b3", "flavorRef": "452", "networks": [{"uuid": "440f0e53-d165-4c61-9245-e254f1d4e308"}]}} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:53:36.746782 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.network.neutron [None req-020c0662-edc6-4940-8b9d-fce4cf551112 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] validate_networks() for [('440f0e53-d165-4c61-9245-e254f1d4e308', None, None, None, None, None)] {{(pid=116267) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Nov 01 01:53:37.288648 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.virt.hardware [None req-020c0662-edc6-4940-8b9d-fce4cf551112 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Flavor limits 0:0:0 {{(pid=116267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 01 01:53:37.289076 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.virt.hardware [None req-020c0662-edc6-4940-8b9d-fce4cf551112 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Image limits 0:0:0 {{(pid=116267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 01 01:53:37.289550 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.virt.hardware [None req-020c0662-edc6-4940-8b9d-fce4cf551112 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Flavor pref 0:0:0 {{(pid=116267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 01 01:53:37.289962 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.virt.hardware [None req-020c0662-edc6-4940-8b9d-fce4cf551112 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Image pref 0:0:0 {{(pid=116267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 01 01:53:37.290367 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.virt.hardware [None req-020c0662-edc6-4940-8b9d-fce4cf551112 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 01 01:53:37.299602 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-020c0662-edc6-4940-8b9d-fce4cf551112 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:53:37.300042 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-020c0662-edc6-4940-8b9d-fce4cf551112 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:53:37.300855 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-020c0662-edc6-4940-8b9d-fce4cf551112 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:53:37.301303 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-020c0662-edc6-4940-8b9d-fce4cf551112 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:53:37.318091 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.quota [None req-020c0662-edc6-4940-8b9d-fce4cf551112 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Getting quotas for project 7795ef4656624d11a3adb196fe6c9681. Resources: {'instances', 'cores', 'ram'} {{(pid=116267) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 01 01:53:37.322885 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.quota [None req-020c0662-edc6-4940-8b9d-fce4cf551112 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Getting quotas for user ca4329fdd4b147af8b18f26b0656abd6 and project 7795ef4656624d11a3adb196fe6c9681. Resources: {'instances', 'cores', 'ram'} {{(pid=116267) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 01 01:53:37.335458 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-020c0662-edc6-4940-8b9d-fce4cf551112 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Going to run 1 instances... {{(pid=116267) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 01 01:53:37.338138 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-020c0662-edc6-4940-8b9d-fce4cf551112 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: c9b2dd10-f0d9-486c-9501-728c89f9d25a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b9068d8d-b02d-4043-9f0c-3d774cb372b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116267) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 01 01:53:37.494804 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-020c0662-edc6-4940-8b9d-fce4cf551112 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.803857 Nov 01 01:53:37.495457 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1509/2926] 10.222.0.47 () {60 vars in 1146 bytes} [Mon Nov 1 01:53:36 2021] POST /compute/v2.1/servers => generated 380 bytes in 805 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 01 01:53:37.507982 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-396a5ef4-c084-4782-a7db-a46dcb91deb1 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:53:37.509767 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-396a5ef4-c084-4782-a7db-a46dcb91deb1 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: c9b2dd10-f0d9-486c-9501-728c89f9d25a] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:53:37.578011 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-396a5ef4-c084-4782-a7db-a46dcb91deb1 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:53:37.585025 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-396a5ef4-c084-4782-a7db-a46dcb91deb1 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/c9b2dd10-f0d9-486c-9501-728c89f9d25a" status: 200 len: 1218 microversion: 2.1 time: 0.082315 Nov 01 01:53:37.585807 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1418/2927] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:53:37 2021] GET /compute/v2.1/servers/c9b2dd10-f0d9-486c-9501-728c89f9d25a => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:53:38.603123 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-66cbede4-772f-4c21-9f16-707e52b694fe tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:53:38.603736 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-66cbede4-772f-4c21-9f16-707e52b694fe tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: c9b2dd10-f0d9-486c-9501-728c89f9d25a] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:53:38.614171 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-66cbede4-772f-4c21-9f16-707e52b694fe tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:53:38.617128 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-66cbede4-772f-4c21-9f16-707e52b694fe tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:53:38.618004 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-66cbede4-772f-4c21-9f16-707e52b694fe tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:53:38.618461 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-66cbede4-772f-4c21-9f16-707e52b694fe tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:53:38.727617 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-66cbede4-772f-4c21-9f16-707e52b694fe tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:53:38.735138 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-66cbede4-772f-4c21-9f16-707e52b694fe tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/c9b2dd10-f0d9-486c-9501-728c89f9d25a" status: 200 len: 1222 microversion: 2.1 time: 0.136533 Nov 01 01:53:38.735926 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1510/2928] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:53:38 2021] GET /compute/v2.1/servers/c9b2dd10-f0d9-486c-9501-728c89f9d25a => generated 1222 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:53:39.756517 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-d3d9dbf7-13b3-4a84-a6be-d0ff31047940 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:53:39.757189 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-d3d9dbf7-13b3-4a84-a6be-d0ff31047940 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: c9b2dd10-f0d9-486c-9501-728c89f9d25a] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:53:39.766247 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d3d9dbf7-13b3-4a84-a6be-d0ff31047940 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:53:39.767009 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d3d9dbf7-13b3-4a84-a6be-d0ff31047940 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:53:39.767976 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d3d9dbf7-13b3-4a84-a6be-d0ff31047940 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:53:39.768701 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d3d9dbf7-13b3-4a84-a6be-d0ff31047940 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:53:39.887823 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-d3d9dbf7-13b3-4a84-a6be-d0ff31047940 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:53:39.895477 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-d3d9dbf7-13b3-4a84-a6be-d0ff31047940 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/c9b2dd10-f0d9-486c-9501-728c89f9d25a" status: 200 len: 1278 microversion: 2.1 time: 0.147418 Nov 01 01:53:39.897067 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1419/2929] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:53:39 2021] GET /compute/v2.1/servers/c9b2dd10-f0d9-486c-9501-728c89f9d25a => generated 1278 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:53:40.916934 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-fa437058-d2cb-4806-b7f0-c2960eea8df2 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:53:40.918850 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-fa437058-d2cb-4806-b7f0-c2960eea8df2 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: c9b2dd10-f0d9-486c-9501-728c89f9d25a] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:53:40.930846 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-fa437058-d2cb-4806-b7f0-c2960eea8df2 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:53:40.931299 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-fa437058-d2cb-4806-b7f0-c2960eea8df2 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:53:40.932106 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-fa437058-d2cb-4806-b7f0-c2960eea8df2 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:53:40.932488 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-fa437058-d2cb-4806-b7f0-c2960eea8df2 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:53:41.260142 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-fa437058-d2cb-4806-b7f0-c2960eea8df2 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:53:41.279127 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-fa437058-d2cb-4806-b7f0-c2960eea8df2 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/c9b2dd10-f0d9-486c-9501-728c89f9d25a" status: 200 len: 1318 microversion: 2.1 time: 0.364110 Nov 01 01:53:41.290299 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1511/2930] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:53:40 2021] GET /compute/v2.1/servers/c9b2dd10-f0d9-486c-9501-728c89f9d25a => generated 1318 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:53:41.713895 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-a1a1d5dc-0679-4fce-bc78-daf5732c787f tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Action: 'create', calling method: .version_select at 0x7fccf6a2ddc0>, body: {"keypair": {"name": "tempest-keypair-363146548"}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:53:41.741408 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.quota [None req-a1a1d5dc-0679-4fce-bc78-daf5732c787f tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Getting quotas for project 561a6514bbe449b2b35c20f16ffaddda. Resources: {'key_pairs'} {{(pid=116266) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 01 01:53:41.745313 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.quota [None req-a1a1d5dc-0679-4fce-bc78-daf5732c787f tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Getting quotas for user 1828ba5acba040a38cbeb610db7952c2 and project 561a6514bbe449b2b35c20f16ffaddda. Resources: {'key_pairs'} {{(pid=116266) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 01 01:53:41.873471 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [req-30bd613f-2535-4d85-9738-a2649bdc9922 req-b9ea6531-a0c2-412c-8b5b-a02f93d51ed8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9b2dd10-f0d9-486c-9501-728c89f9d25a", "tag": "6431126b-da71-4d2d-822c-a38936efa7ba"}]} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:53:41.875553 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 01 01:53:41.875553 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: warnings.warn(msg) Nov 01 01:53:41.888328 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [req-30bd613f-2535-4d85-9738-a2649bdc9922 req-b9ea6531-a0c2-412c-8b5b-a02f93d51ed8 service nova] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:53:41.891762 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [req-30bd613f-2535-4d85-9738-a2649bdc9922 req-b9ea6531-a0c2-412c-8b5b-a02f93d51ed8 service nova] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:53:41.912248 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.compute.server_external_events [req-30bd613f-2535-4d85-9738-a2649bdc9922 req-b9ea6531-a0c2-412c-8b5b-a02f93d51ed8 service nova] Creating event network-changed:6431126b-da71-4d2d-822c-a38936efa7ba for instance c9b2dd10-f0d9-486c-9501-728c89f9d25a on hv-cinder-81561 Nov 01 01:53:41.915617 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: ERROR oslo.messaging._drivers.impl_rabbit [req-30bd613f-2535-4d85-9738-a2649bdc9922 req-b9ea6531-a0c2-412c-8b5b-a02f93d51ed8 service nova] [d6748a1e-8370-493e-b3b5-ff17386f722d] AMQP server on 10.222.0.47:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 01 01:53:42.076933 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.quota [None req-a1a1d5dc-0679-4fce-bc78-daf5732c787f tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Getting quotas for project 561a6514bbe449b2b35c20f16ffaddda. Resources: {'key_pairs'} {{(pid=116266) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 01 01:53:42.080862 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.quota [None req-a1a1d5dc-0679-4fce-bc78-daf5732c787f tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Getting quotas for user 1828ba5acba040a38cbeb610db7952c2 and project 561a6514bbe449b2b35c20f16ffaddda. Resources: {'key_pairs'} {{(pid=116266) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 01 01:53:42.095516 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-a1a1d5dc-0679-4fce-bc78-daf5732c787f tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 201 len: 2319 microversion: 2.20 time: 0.513134 Nov 01 01:53:42.096129 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1420/2931] 10.222.0.47 () {62 vars in 1198 bytes} [Mon Nov 1 01:53:41 2021] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 514 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Nov 01 01:53:42.297517 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-d13fcd1b-1826-4a62-b830-456dcefc8580 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:53:42.298128 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-d13fcd1b-1826-4a62-b830-456dcefc8580 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: c9b2dd10-f0d9-486c-9501-728c89f9d25a] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:53:42.304066 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d13fcd1b-1826-4a62-b830-456dcefc8580 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:53:42.304772 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d13fcd1b-1826-4a62-b830-456dcefc8580 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:53:42.305537 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d13fcd1b-1826-4a62-b830-456dcefc8580 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:53:42.305967 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d13fcd1b-1826-4a62-b830-456dcefc8580 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:53:42.437630 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-d13fcd1b-1826-4a62-b830-456dcefc8580 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:53:42.445161 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-d13fcd1b-1826-4a62-b830-456dcefc8580 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/c9b2dd10-f0d9-486c-9501-728c89f9d25a" status: 200 len: 1318 microversion: 2.1 time: 0.152053 Nov 01 01:53:42.445788 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1421/2932] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:53:42 2021] GET /compute/v2.1/servers/c9b2dd10-f0d9-486c-9501-728c89f9d25a => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:53:42.948248 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO oslo.messaging._drivers.impl_rabbit [req-30bd613f-2535-4d85-9738-a2649bdc9922 req-b9ea6531-a0c2-412c-8b5b-a02f93d51ed8 service nova] [d6748a1e-8370-493e-b3b5-ff17386f722d] Reconnected to AMQP server on 10.222.0.47:5672 via [amqp] client with port 53148. Nov 01 01:53:42.953948 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [req-30bd613f-2535-4d85-9738-a2649bdc9922 req-b9ea6531-a0c2-412c-8b5b-a02f93d51ed8 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.085217 Nov 01 01:53:42.955376 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1512/2933] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Nov 1 01:53:41 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:53:43.461960 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-d0e97999-8337-46ef-a3e1-0a80abb831f5 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:53:43.467109 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-d0e97999-8337-46ef-a3e1-0a80abb831f5 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: c9b2dd10-f0d9-486c-9501-728c89f9d25a] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:53:43.469242 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d0e97999-8337-46ef-a3e1-0a80abb831f5 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:53:43.469692 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d0e97999-8337-46ef-a3e1-0a80abb831f5 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:53:43.470479 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d0e97999-8337-46ef-a3e1-0a80abb831f5 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:53:43.470913 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d0e97999-8337-46ef-a3e1-0a80abb831f5 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:53:43.617678 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-d0e97999-8337-46ef-a3e1-0a80abb831f5 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:53:43.626283 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-d0e97999-8337-46ef-a3e1-0a80abb831f5 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/c9b2dd10-f0d9-486c-9501-728c89f9d25a" status: 200 len: 1318 microversion: 2.1 time: 0.168158 Nov 01 01:53:43.627017 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1422/2934] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:53:43 2021] GET /compute/v2.1/servers/c9b2dd10-f0d9-486c-9501-728c89f9d25a => generated 1318 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:53:44.646808 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-8d3d59c1-5990-4943-9681-85e4486fdeb4 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:53:44.647713 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-8d3d59c1-5990-4943-9681-85e4486fdeb4 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: c9b2dd10-f0d9-486c-9501-728c89f9d25a] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:53:44.654300 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8d3d59c1-5990-4943-9681-85e4486fdeb4 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:53:44.655040 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8d3d59c1-5990-4943-9681-85e4486fdeb4 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:53:44.655955 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8d3d59c1-5990-4943-9681-85e4486fdeb4 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:53:44.656477 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8d3d59c1-5990-4943-9681-85e4486fdeb4 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:53:44.794293 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-8d3d59c1-5990-4943-9681-85e4486fdeb4 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:53:44.802169 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-8d3d59c1-5990-4943-9681-85e4486fdeb4 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/c9b2dd10-f0d9-486c-9501-728c89f9d25a" status: 200 len: 1318 microversion: 2.1 time: 0.162555 Nov 01 01:53:44.802782 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1513/2935] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:53:44 2021] GET /compute/v2.1/servers/c9b2dd10-f0d9-486c-9501-728c89f9d25a => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:53:44.857668 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-4b7a4626-37d7-4045-a994-fa416f483a6c tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1646723306", "imageRef": "b9068d8d-b02d-4043-9f0c-3d774cb372b3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "85b31de6-bb92-45e7-936a-0c2a3c2bb592"}], "security_groups": [{"name": "tempest-securitygroup--1712678839"}], "key_name": "tempest-keypair-363146548", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:53:44.959419 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.network.neutron [None req-4b7a4626-37d7-4045-a994-fa416f483a6c tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] validate_networks() for [('85b31de6-bb92-45e7-936a-0c2a3c2bb592', None, None, None, None, None)] {{(pid=116266) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Nov 01 01:53:45.409537 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.virt.hardware [None req-4b7a4626-37d7-4045-a994-fa416f483a6c tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Flavor limits 0:0:0 {{(pid=116266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 01 01:53:45.409953 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.virt.hardware [None req-4b7a4626-37d7-4045-a994-fa416f483a6c tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Image limits 0:0:0 {{(pid=116266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 01 01:53:45.410441 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.virt.hardware [None req-4b7a4626-37d7-4045-a994-fa416f483a6c tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Flavor pref 0:0:0 {{(pid=116266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 01 01:53:45.410908 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.virt.hardware [None req-4b7a4626-37d7-4045-a994-fa416f483a6c tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Image pref 0:0:0 {{(pid=116266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 01 01:53:45.411321 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.virt.hardware [None req-4b7a4626-37d7-4045-a994-fa416f483a6c tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 01 01:53:45.420198 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4b7a4626-37d7-4045-a994-fa416f483a6c tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:53:45.420644 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4b7a4626-37d7-4045-a994-fa416f483a6c tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:53:45.421435 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4b7a4626-37d7-4045-a994-fa416f483a6c tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:53:45.421863 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4b7a4626-37d7-4045-a994-fa416f483a6c tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:53:45.437949 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.quota [None req-4b7a4626-37d7-4045-a994-fa416f483a6c tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Getting quotas for project 561a6514bbe449b2b35c20f16ffaddda. Resources: {'instances', 'cores', 'ram'} {{(pid=116266) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 01 01:53:45.441795 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.quota [None req-4b7a4626-37d7-4045-a994-fa416f483a6c tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Getting quotas for user 1828ba5acba040a38cbeb610db7952c2 and project 561a6514bbe449b2b35c20f16ffaddda. Resources: {'instances', 'cores', 'ram'} {{(pid=116266) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 01 01:53:45.452754 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-4b7a4626-37d7-4045-a994-fa416f483a6c tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Going to run 1 instances... {{(pid=116266) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 01 01:53:45.455057 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-4b7a4626-37d7-4045-a994-fa416f483a6c tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: 6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b9068d8d-b02d-4043-9f0c-3d774cb372b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116266) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 01 01:53:45.577612 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: ERROR oslo.messaging._drivers.impl_rabbit [None req-4b7a4626-37d7-4045-a994-fa416f483a6c tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [211a9f18-ca32-4c3f-ac40-d148dfd998f8] AMQP server on 10.222.0.47:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 01 01:53:45.824840 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-d5ee24c8-7d69-46a8-8407-96f032e38bd5 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:53:45.825534 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-d5ee24c8-7d69-46a8-8407-96f032e38bd5 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: c9b2dd10-f0d9-486c-9501-728c89f9d25a] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:53:45.831982 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d5ee24c8-7d69-46a8-8407-96f032e38bd5 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:53:45.832498 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d5ee24c8-7d69-46a8-8407-96f032e38bd5 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:53:45.833414 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d5ee24c8-7d69-46a8-8407-96f032e38bd5 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:53:45.833838 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d5ee24c8-7d69-46a8-8407-96f032e38bd5 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:53:45.958810 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-d5ee24c8-7d69-46a8-8407-96f032e38bd5 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:53:45.967590 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-d5ee24c8-7d69-46a8-8407-96f032e38bd5 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/c9b2dd10-f0d9-486c-9501-728c89f9d25a" status: 200 len: 1318 microversion: 2.1 time: 0.146844 Nov 01 01:53:45.968512 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1514/2936] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:53:45 2021] GET /compute/v2.1/servers/c9b2dd10-f0d9-486c-9501-728c89f9d25a => generated 1318 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:53:46.593520 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO oslo.messaging._drivers.impl_rabbit [None req-4b7a4626-37d7-4045-a994-fa416f483a6c tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [211a9f18-ca32-4c3f-ac40-d148dfd998f8] Reconnected to AMQP server on 10.222.0.47:5672 via [amqp] client with port 53178. Nov 01 01:53:46.597502 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-4b7a4626-37d7-4045-a994-fa416f483a6c tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.744579 Nov 01 01:53:46.598318 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1423/2937] 10.222.0.47 () {62 vars in 1187 bytes} [Mon Nov 1 01:53:44 2021] POST /compute/v2.1/servers => generated 402 bytes in 1746 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 01 01:53:46.608348 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-cea9b4a2-be7e-45e8-8b5f-b6070186f44a tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:53:46.608927 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-cea9b4a2-be7e-45e8-8b5f-b6070186f44a tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: 6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:53:46.659370 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-cea9b4a2-be7e-45e8-8b5f-b6070186f44a tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:53:46.666348 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-cea9b4a2-be7e-45e8-8b5f-b6070186f44a tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:53:46.668375 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-cea9b4a2-be7e-45e8-8b5f-b6070186f44a tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:53:46.669485 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-cea9b4a2-be7e-45e8-8b5f-b6070186f44a tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "GET /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad" status: 200 len: 1281 microversion: 2.20 time: 0.065358 Nov 01 01:53:46.670035 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1515/2938] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Nov 1 01:53:46 2021] GET /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad => generated 1281 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 01:53:46.985645 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-ba9d109f-1252-432c-98f2-7512cce36555 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:53:46.986247 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-ba9d109f-1252-432c-98f2-7512cce36555 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: c9b2dd10-f0d9-486c-9501-728c89f9d25a] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:53:46.992987 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ba9d109f-1252-432c-98f2-7512cce36555 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:53:46.993428 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ba9d109f-1252-432c-98f2-7512cce36555 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:53:46.994187 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ba9d109f-1252-432c-98f2-7512cce36555 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:53:46.994642 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ba9d109f-1252-432c-98f2-7512cce36555 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:53:47.111265 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-ba9d109f-1252-432c-98f2-7512cce36555 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:53:47.118510 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-ba9d109f-1252-432c-98f2-7512cce36555 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/c9b2dd10-f0d9-486c-9501-728c89f9d25a" status: 200 len: 1318 microversion: 2.1 time: 0.138548 Nov 01 01:53:47.119065 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1424/2939] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:53:46 2021] GET /compute/v2.1/servers/c9b2dd10-f0d9-486c-9501-728c89f9d25a => generated 1318 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:53:47.687225 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-71eec161-fab5-4185-bdde-cd94b7fcaaee tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:53:47.687857 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-71eec161-fab5-4185-bdde-cd94b7fcaaee tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: 6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:53:47.739526 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-71eec161-fab5-4185-bdde-cd94b7fcaaee tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:53:47.747640 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-71eec161-fab5-4185-bdde-cd94b7fcaaee tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:53:47.749133 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-71eec161-fab5-4185-bdde-cd94b7fcaaee tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:53:47.750227 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-71eec161-fab5-4185-bdde-cd94b7fcaaee tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "GET /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad" status: 200 len: 1281 microversion: 2.20 time: 0.067179 Nov 01 01:53:47.750996 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1516/2940] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Nov 1 01:53:47 2021] GET /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad => generated 1281 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 01:53:47.974347 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [req-10c2234f-319a-45ec-9ad5-092e43c402c3 req-84954945-abb7-4538-9736-662f4bbf0beb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9b2dd10-f0d9-486c-9501-728c89f9d25a", "name": "network-vif-plugged", "status": "completed", "tag": "6431126b-da71-4d2d-822c-a38936efa7ba"}]} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:53:47.975997 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 01 01:53:47.975997 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: warnings.warn(msg) Nov 01 01:53:47.983092 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [req-10c2234f-319a-45ec-9ad5-092e43c402c3 req-84954945-abb7-4538-9736-662f4bbf0beb service nova] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:53:47.986881 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [req-10c2234f-319a-45ec-9ad5-092e43c402c3 req-84954945-abb7-4538-9736-662f4bbf0beb service nova] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:53:47.994033 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.compute.server_external_events [req-10c2234f-319a-45ec-9ad5-092e43c402c3 req-84954945-abb7-4538-9736-662f4bbf0beb service nova] Creating event network-vif-plugged:6431126b-da71-4d2d-822c-a38936efa7ba for instance c9b2dd10-f0d9-486c-9501-728c89f9d25a on hv-cinder-81561 Nov 01 01:53:47.998897 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [req-10c2234f-319a-45ec-9ad5-092e43c402c3 req-84954945-abb7-4538-9736-662f4bbf0beb service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083954 Nov 01 01:53:47.999466 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1425/2941] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Nov 1 01:53:47 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:53:48.135215 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-fb747770-b1d0-4a88-a9d4-14f7ebfb5a62 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:53:48.135752 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-fb747770-b1d0-4a88-a9d4-14f7ebfb5a62 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: c9b2dd10-f0d9-486c-9501-728c89f9d25a] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:53:48.142108 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-fb747770-b1d0-4a88-a9d4-14f7ebfb5a62 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:53:48.142606 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-fb747770-b1d0-4a88-a9d4-14f7ebfb5a62 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:53:48.143369 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-fb747770-b1d0-4a88-a9d4-14f7ebfb5a62 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:53:48.143804 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-fb747770-b1d0-4a88-a9d4-14f7ebfb5a62 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:53:48.265198 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-fb747770-b1d0-4a88-a9d4-14f7ebfb5a62 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:53:48.272554 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-fb747770-b1d0-4a88-a9d4-14f7ebfb5a62 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/c9b2dd10-f0d9-486c-9501-728c89f9d25a" status: 200 len: 1318 microversion: 2.1 time: 0.141249 Nov 01 01:53:48.273114 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1517/2942] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:53:48 2021] GET /compute/v2.1/servers/c9b2dd10-f0d9-486c-9501-728c89f9d25a => generated 1318 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:53:48.768268 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-27c7b978-e7b7-4c4d-8414-ad63befacde3 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:53:48.769086 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-27c7b978-e7b7-4c4d-8414-ad63befacde3 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: 6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:53:48.821985 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-27c7b978-e7b7-4c4d-8414-ad63befacde3 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:53:48.829353 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-27c7b978-e7b7-4c4d-8414-ad63befacde3 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:53:48.831025 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-27c7b978-e7b7-4c4d-8414-ad63befacde3 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:53:48.832123 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-27c7b978-e7b7-4c4d-8414-ad63befacde3 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "GET /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad" status: 200 len: 1281 microversion: 2.20 time: 0.067898 Nov 01 01:53:48.833084 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1426/2943] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Nov 1 01:53:48 2021] GET /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad => generated 1281 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 01:53:49.288946 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-65d79121-0c07-427e-ba68-0ce420466cb4 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:53:49.289481 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-65d79121-0c07-427e-ba68-0ce420466cb4 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: c9b2dd10-f0d9-486c-9501-728c89f9d25a] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:53:49.296324 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-65d79121-0c07-427e-ba68-0ce420466cb4 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:53:49.296761 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-65d79121-0c07-427e-ba68-0ce420466cb4 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:53:49.297508 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-65d79121-0c07-427e-ba68-0ce420466cb4 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:53:49.297942 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-65d79121-0c07-427e-ba68-0ce420466cb4 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:53:49.416593 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-65d79121-0c07-427e-ba68-0ce420466cb4 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:53:49.423691 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-65d79121-0c07-427e-ba68-0ce420466cb4 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/c9b2dd10-f0d9-486c-9501-728c89f9d25a" status: 200 len: 1318 microversion: 2.1 time: 0.138482 Nov 01 01:53:49.424238 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1518/2944] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:53:49 2021] GET /compute/v2.1/servers/c9b2dd10-f0d9-486c-9501-728c89f9d25a => generated 1318 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:53:49.853906 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-140d3a40-775e-488b-8f4a-2aeb04638238 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:53:49.855072 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-140d3a40-775e-488b-8f4a-2aeb04638238 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: 6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:53:49.909828 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-140d3a40-775e-488b-8f4a-2aeb04638238 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:53:49.917743 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-140d3a40-775e-488b-8f4a-2aeb04638238 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:53:49.919291 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-140d3a40-775e-488b-8f4a-2aeb04638238 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:53:49.920390 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-140d3a40-775e-488b-8f4a-2aeb04638238 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "GET /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad" status: 200 len: 1281 microversion: 2.20 time: 0.070144 Nov 01 01:53:49.920937 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1427/2945] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Nov 1 01:53:49 2021] GET /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad => generated 1281 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 01:53:50.440409 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-73cdcce7-1e5a-4438-be00-924e4adb2d96 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:53:50.441011 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-73cdcce7-1e5a-4438-be00-924e4adb2d96 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: c9b2dd10-f0d9-486c-9501-728c89f9d25a] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:53:50.447275 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-73cdcce7-1e5a-4438-be00-924e4adb2d96 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:53:50.447713 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-73cdcce7-1e5a-4438-be00-924e4adb2d96 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:53:50.448460 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-73cdcce7-1e5a-4438-be00-924e4adb2d96 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:53:50.448885 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-73cdcce7-1e5a-4438-be00-924e4adb2d96 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:53:50.566636 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-73cdcce7-1e5a-4438-be00-924e4adb2d96 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:53:50.574221 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-73cdcce7-1e5a-4438-be00-924e4adb2d96 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/c9b2dd10-f0d9-486c-9501-728c89f9d25a" status: 200 len: 1506 microversion: 2.1 time: 0.137494 Nov 01 01:53:50.574853 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1519/2946] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:53:50 2021] GET /compute/v2.1/servers/c9b2dd10-f0d9-486c-9501-728c89f9d25a => generated 1506 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:53:50.590978 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-450b2ba6-4795-4a70-a307-c25cb3de5535 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5d910e56-ea5b-4ab7-9d48-4c977537d8b4", "device": "/dev/sdb"}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:53:50.592615 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-450b2ba6-4795-4a70-a307-c25cb3de5535 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: c9b2dd10-f0d9-486c-9501-728c89f9d25a] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:53:50.598939 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-450b2ba6-4795-4a70-a307-c25cb3de5535 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:53:50.599380 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-450b2ba6-4795-4a70-a307-c25cb3de5535 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:53:50.600130 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-450b2ba6-4795-4a70-a307-c25cb3de5535 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:53:50.600554 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-450b2ba6-4795-4a70-a307-c25cb3de5535 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:53:50.938411 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-7c29ca0d-9302-4d61-b986-85c515ceb955 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:53:50.939042 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-7c29ca0d-9302-4d61-b986-85c515ceb955 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: 6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:53:50.944765 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-7c29ca0d-9302-4d61-b986-85c515ceb955 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:53:50.945206 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-7c29ca0d-9302-4d61-b986-85c515ceb955 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:53:50.945953 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-7c29ca0d-9302-4d61-b986-85c515ceb955 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:53:50.946383 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-7c29ca0d-9302-4d61-b986-85c515ceb955 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:53:51.007883 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-7c29ca0d-9302-4d61-b986-85c515ceb955 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:53:51.016286 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-7c29ca0d-9302-4d61-b986-85c515ceb955 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:53:51.017820 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-7c29ca0d-9302-4d61-b986-85c515ceb955 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:53:51.018945 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-7c29ca0d-9302-4d61-b986-85c515ceb955 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "GET /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad" status: 200 len: 1285 microversion: 2.20 time: 0.084209 Nov 01 01:53:51.019501 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1520/2947] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Nov 1 01:53:50 2021] GET /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad => generated 1285 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 01 01:53:51.358247 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-450b2ba6-4795-4a70-a307-c25cb3de5535 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "POST /compute/v2.1/servers/c9b2dd10-f0d9-486c-9501-728c89f9d25a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.771460 Nov 01 01:53:51.358939 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1428/2948] 10.222.0.47 () {60 vars in 1322 bytes} [Mon Nov 1 01:53:50 2021] POST /compute/v2.1/servers/c9b2dd10-f0d9-486c-9501-728c89f9d25a/os-volume_attachments => generated 194 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:53:52.036803 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-b0e07b95-e25c-44ca-85ef-506ffb1ad9bd tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:53:52.037445 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-b0e07b95-e25c-44ca-85ef-506ffb1ad9bd tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: 6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:53:52.043697 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b0e07b95-e25c-44ca-85ef-506ffb1ad9bd tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:53:52.047709 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b0e07b95-e25c-44ca-85ef-506ffb1ad9bd tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:53:52.047709 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b0e07b95-e25c-44ca-85ef-506ffb1ad9bd tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:53:52.047709 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b0e07b95-e25c-44ca-85ef-506ffb1ad9bd tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:53:52.105450 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-b0e07b95-e25c-44ca-85ef-506ffb1ad9bd tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:53:52.113151 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-b0e07b95-e25c-44ca-85ef-506ffb1ad9bd tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:53:52.114684 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-b0e07b95-e25c-44ca-85ef-506ffb1ad9bd tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:53:52.115774 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-b0e07b95-e25c-44ca-85ef-506ffb1ad9bd tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "GET /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad" status: 200 len: 1277 microversion: 2.20 time: 0.082691 Nov 01 01:53:52.116322 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1521/2949] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Nov 1 01:53:52 2021] GET /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad => generated 1277 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 01:53:53.137281 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-abee1e36-56aa-4e50-9b12-28dc236c2338 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:53:53.137971 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-abee1e36-56aa-4e50-9b12-28dc236c2338 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: 6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:53:53.143937 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-abee1e36-56aa-4e50-9b12-28dc236c2338 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:53:53.144384 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-abee1e36-56aa-4e50-9b12-28dc236c2338 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:53:53.145142 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-abee1e36-56aa-4e50-9b12-28dc236c2338 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:53:53.145572 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-abee1e36-56aa-4e50-9b12-28dc236c2338 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:53:53.207312 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-abee1e36-56aa-4e50-9b12-28dc236c2338 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:53:53.215684 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-abee1e36-56aa-4e50-9b12-28dc236c2338 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:53:53.222945 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-abee1e36-56aa-4e50-9b12-28dc236c2338 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:53:53.222945 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-abee1e36-56aa-4e50-9b12-28dc236c2338 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "GET /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad" status: 200 len: 1339 microversion: 2.20 time: 0.086037 Nov 01 01:53:53.222945 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1429/2950] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Nov 1 01:53:53 2021] GET /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad => generated 1339 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 01:53:54.237034 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-41c3f053-0aa2-499e-a6b5-4c40c292a6ed tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:53:54.237618 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-41c3f053-0aa2-499e-a6b5-4c40c292a6ed tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: 6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:53:54.244012 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-41c3f053-0aa2-499e-a6b5-4c40c292a6ed tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:53:54.244537 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-41c3f053-0aa2-499e-a6b5-4c40c292a6ed tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:53:54.245376 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-41c3f053-0aa2-499e-a6b5-4c40c292a6ed tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:53:54.245936 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-41c3f053-0aa2-499e-a6b5-4c40c292a6ed tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:53:54.340452 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 01 01:53:54.340660 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: Mon Nov 1 01:53:54 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad (ip 10.222.0.47) !!! Nov 01 01:53:54.381054 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-41c3f053-0aa2-499e-a6b5-4c40c292a6ed tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:53:54.389746 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-41c3f053-0aa2-499e-a6b5-4c40c292a6ed tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:53:54.391894 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-41c3f053-0aa2-499e-a6b5-4c40c292a6ed tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:53:54.393240 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-41c3f053-0aa2-499e-a6b5-4c40c292a6ed tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "GET /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad" status: 200 len: 1407 microversion: 2.20 time: 0.160018 Nov 01 01:53:54.394697 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [req-11bb6002-5611-4b14-9729-f17a70bfb7f2 req-6aea4bf1-2ea5-41f6-901a-bcbe9ce7b4d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad", "tag": "0d980dc6-46c5-489a-a08f-baa507ecfcdd"}]} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:53:54.397064 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 01 01:53:54.397064 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: warnings.warn(msg) Nov 01 01:53:54.402616 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1522/2951] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Nov 1 01:53:54 2021] GET /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad => generated 1407 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 01:53:54.406362 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [req-11bb6002-5611-4b14-9729-f17a70bfb7f2 req-6aea4bf1-2ea5-41f6-901a-bcbe9ce7b4d4 service nova] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:53:54.409276 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [req-11bb6002-5611-4b14-9729-f17a70bfb7f2 req-6aea4bf1-2ea5-41f6-901a-bcbe9ce7b4d4 service nova] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:53:54.419107 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.compute.server_external_events [req-11bb6002-5611-4b14-9729-f17a70bfb7f2 req-6aea4bf1-2ea5-41f6-901a-bcbe9ce7b4d4 service nova] Creating event network-changed:0d980dc6-46c5-489a-a08f-baa507ecfcdd for instance 6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad on hv-cinder-81561 Nov 01 01:53:54.423646 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [req-11bb6002-5611-4b14-9729-f17a70bfb7f2 req-6aea4bf1-2ea5-41f6-901a-bcbe9ce7b4d4 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032865 Nov 01 01:53:54.424269 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1430/2952] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Nov 1 01:53:54 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 01 01:53:55.420097 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-d7b7ac24-562b-4c7d-a6a6-e8bb3923296a tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:53:55.420697 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-d7b7ac24-562b-4c7d-a6a6-e8bb3923296a tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: 6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:53:55.426782 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d7b7ac24-562b-4c7d-a6a6-e8bb3923296a tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:53:55.427226 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d7b7ac24-562b-4c7d-a6a6-e8bb3923296a tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:53:55.427972 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d7b7ac24-562b-4c7d-a6a6-e8bb3923296a tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:53:55.428395 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d7b7ac24-562b-4c7d-a6a6-e8bb3923296a tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:53:55.544981 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-d7b7ac24-562b-4c7d-a6a6-e8bb3923296a tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:53:55.552579 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-d7b7ac24-562b-4c7d-a6a6-e8bb3923296a tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:53:55.554362 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-d7b7ac24-562b-4c7d-a6a6-e8bb3923296a tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:53:55.555482 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-d7b7ac24-562b-4c7d-a6a6-e8bb3923296a tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "GET /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad" status: 200 len: 1407 microversion: 2.20 time: 0.139701 Nov 01 01:53:55.556030 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1523/2953] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Nov 1 01:53:55 2021] GET /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad => generated 1407 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 01:53:56.574790 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-384e6c2c-4c3d-489e-b1a6-f82e535542e3 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:53:56.575484 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-384e6c2c-4c3d-489e-b1a6-f82e535542e3 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: 6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:53:56.581506 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-384e6c2c-4c3d-489e-b1a6-f82e535542e3 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:53:56.581951 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-384e6c2c-4c3d-489e-b1a6-f82e535542e3 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:53:56.582744 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-384e6c2c-4c3d-489e-b1a6-f82e535542e3 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:53:56.583177 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-384e6c2c-4c3d-489e-b1a6-f82e535542e3 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:53:56.713012 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-384e6c2c-4c3d-489e-b1a6-f82e535542e3 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:53:56.719208 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-384e6c2c-4c3d-489e-b1a6-f82e535542e3 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:53:56.720714 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-384e6c2c-4c3d-489e-b1a6-f82e535542e3 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:53:56.721808 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-384e6c2c-4c3d-489e-b1a6-f82e535542e3 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "GET /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad" status: 200 len: 1407 microversion: 2.20 time: 0.152177 Nov 01 01:53:56.722353 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1431/2954] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Nov 1 01:53:56 2021] GET /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad => generated 1407 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 01:53:57.739419 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-9aa0048e-51ef-43c5-82ff-99a7ee16539b tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:53:57.740024 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-9aa0048e-51ef-43c5-82ff-99a7ee16539b tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: 6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:53:57.746536 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9aa0048e-51ef-43c5-82ff-99a7ee16539b tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:53:57.746985 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9aa0048e-51ef-43c5-82ff-99a7ee16539b tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:53:57.747751 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9aa0048e-51ef-43c5-82ff-99a7ee16539b tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:53:57.748175 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9aa0048e-51ef-43c5-82ff-99a7ee16539b tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:53:57.872598 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-9aa0048e-51ef-43c5-82ff-99a7ee16539b tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:53:57.880753 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-9aa0048e-51ef-43c5-82ff-99a7ee16539b tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:53:57.882333 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-9aa0048e-51ef-43c5-82ff-99a7ee16539b tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:53:57.883570 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-9aa0048e-51ef-43c5-82ff-99a7ee16539b tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "GET /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad" status: 200 len: 1407 microversion: 2.20 time: 0.147929 Nov 01 01:53:57.884127 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1524/2955] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Nov 1 01:53:57 2021] GET /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad => generated 1407 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 01:53:58.901587 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-cba8e4dc-dd4b-48b3-91c7-f926c2391ef8 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:53:58.902755 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-cba8e4dc-dd4b-48b3-91c7-f926c2391ef8 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: 6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:53:58.909107 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-cba8e4dc-dd4b-48b3-91c7-f926c2391ef8 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:53:58.909552 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-cba8e4dc-dd4b-48b3-91c7-f926c2391ef8 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:53:58.910309 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-cba8e4dc-dd4b-48b3-91c7-f926c2391ef8 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:53:58.910770 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-cba8e4dc-dd4b-48b3-91c7-f926c2391ef8 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:53:59.030530 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-cba8e4dc-dd4b-48b3-91c7-f926c2391ef8 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:53:59.038582 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-cba8e4dc-dd4b-48b3-91c7-f926c2391ef8 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:53:59.040098 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-cba8e4dc-dd4b-48b3-91c7-f926c2391ef8 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:53:59.041182 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-cba8e4dc-dd4b-48b3-91c7-f926c2391ef8 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "GET /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad" status: 200 len: 1407 microversion: 2.20 time: 0.143285 Nov 01 01:53:59.041738 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1432/2956] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Nov 1 01:53:58 2021] GET /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad => generated 1407 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 01:53:59.984221 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [req-928c3e4a-7622-4e33-966b-834d7d5d213b req-8f6daef4-f3ba-428d-a242-df122bc29927 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad", "name": "network-vif-plugged", "status": "completed", "tag": "0d980dc6-46c5-489a-a08f-baa507ecfcdd"}]} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:53:59.986740 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 01 01:53:59.986740 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: warnings.warn(msg) Nov 01 01:53:59.992996 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [req-928c3e4a-7622-4e33-966b-834d7d5d213b req-8f6daef4-f3ba-428d-a242-df122bc29927 service nova] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:53:59.993423 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [req-928c3e4a-7622-4e33-966b-834d7d5d213b req-8f6daef4-f3ba-428d-a242-df122bc29927 service nova] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:54:00.004726 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.compute.server_external_events [req-928c3e4a-7622-4e33-966b-834d7d5d213b req-8f6daef4-f3ba-428d-a242-df122bc29927 service nova] Creating event network-vif-plugged:0d980dc6-46c5-489a-a08f-baa507ecfcdd for instance 6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad on hv-cinder-81561 Nov 01 01:54:00.009911 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [req-928c3e4a-7622-4e33-966b-834d7d5d213b req-8f6daef4-f3ba-428d-a242-df122bc29927 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029795 Nov 01 01:54:00.010587 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1525/2957] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Nov 1 01:53:59 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:54:00.061093 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-79bbdf38-5e59-4297-ac64-ab2fbd590eb8 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:54:00.061758 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-79bbdf38-5e59-4297-ac64-ab2fbd590eb8 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: 6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:54:00.068237 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-79bbdf38-5e59-4297-ac64-ab2fbd590eb8 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:54:00.068733 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-79bbdf38-5e59-4297-ac64-ab2fbd590eb8 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:54:00.069450 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-79bbdf38-5e59-4297-ac64-ab2fbd590eb8 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:54:00.069877 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-79bbdf38-5e59-4297-ac64-ab2fbd590eb8 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:54:00.191980 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-79bbdf38-5e59-4297-ac64-ab2fbd590eb8 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:54:00.199762 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-79bbdf38-5e59-4297-ac64-ab2fbd590eb8 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:54:00.201617 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-79bbdf38-5e59-4297-ac64-ab2fbd590eb8 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:54:00.202730 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-79bbdf38-5e59-4297-ac64-ab2fbd590eb8 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "GET /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad" status: 200 len: 1407 microversion: 2.20 time: 0.146101 Nov 01 01:54:00.203383 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1433/2958] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Nov 1 01:54:00 2021] GET /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad => generated 1407 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 01:54:01.221155 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-f241ed54-182e-43ac-a35b-7f49426dfac3 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:54:01.221851 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-f241ed54-182e-43ac-a35b-7f49426dfac3 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: 6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:54:01.227983 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f241ed54-182e-43ac-a35b-7f49426dfac3 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:54:01.228435 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f241ed54-182e-43ac-a35b-7f49426dfac3 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:54:01.229233 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f241ed54-182e-43ac-a35b-7f49426dfac3 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:54:01.229666 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f241ed54-182e-43ac-a35b-7f49426dfac3 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:54:01.351061 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-f241ed54-182e-43ac-a35b-7f49426dfac3 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:54:01.359566 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-f241ed54-182e-43ac-a35b-7f49426dfac3 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:54:01.364485 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-f241ed54-182e-43ac-a35b-7f49426dfac3 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:54:01.368399 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-f241ed54-182e-43ac-a35b-7f49426dfac3 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "GET /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad" status: 200 len: 1407 microversion: 2.20 time: 0.151713 Nov 01 01:54:01.368978 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1526/2959] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Nov 1 01:54:01 2021] GET /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad => generated 1407 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 01:54:02.390482 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-0040623e-2bd7-493e-8678-313fb5a8fa34 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:54:02.391355 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-0040623e-2bd7-493e-8678-313fb5a8fa34 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: 6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:54:02.397571 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0040623e-2bd7-493e-8678-313fb5a8fa34 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:54:02.398016 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0040623e-2bd7-493e-8678-313fb5a8fa34 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:54:02.398823 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0040623e-2bd7-493e-8678-313fb5a8fa34 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:54:02.399253 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0040623e-2bd7-493e-8678-313fb5a8fa34 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:54:02.516628 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-0040623e-2bd7-493e-8678-313fb5a8fa34 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:54:02.524246 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-0040623e-2bd7-493e-8678-313fb5a8fa34 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:54:02.525764 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-0040623e-2bd7-493e-8678-313fb5a8fa34 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:54:02.526927 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-0040623e-2bd7-493e-8678-313fb5a8fa34 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "GET /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad" status: 200 len: 1407 microversion: 2.20 time: 0.140612 Nov 01 01:54:02.527492 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1434/2960] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Nov 1 01:54:02 2021] GET /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad => generated 1407 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 01:54:03.544553 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-1fc26012-58e1-48bd-8d7b-8b1cad6294e7 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:54:03.545156 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-1fc26012-58e1-48bd-8d7b-8b1cad6294e7 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: 6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:54:03.551409 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-1fc26012-58e1-48bd-8d7b-8b1cad6294e7 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:54:03.551856 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-1fc26012-58e1-48bd-8d7b-8b1cad6294e7 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:54:03.552609 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-1fc26012-58e1-48bd-8d7b-8b1cad6294e7 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:54:03.553039 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-1fc26012-58e1-48bd-8d7b-8b1cad6294e7 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:54:03.676454 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-1fc26012-58e1-48bd-8d7b-8b1cad6294e7 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:54:03.684859 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-1fc26012-58e1-48bd-8d7b-8b1cad6294e7 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:54:03.686341 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-1fc26012-58e1-48bd-8d7b-8b1cad6294e7 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:54:03.687461 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-1fc26012-58e1-48bd-8d7b-8b1cad6294e7 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "GET /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad" status: 200 len: 1407 microversion: 2.20 time: 0.146574 Nov 01 01:54:03.688008 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1527/2961] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Nov 1 01:54:03 2021] GET /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad => generated 1407 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 01:54:04.705231 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-a1fec830-19c2-41d1-83d4-e0db391422c3 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:54:04.705824 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-a1fec830-19c2-41d1-83d4-e0db391422c3 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: 6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:54:04.712046 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a1fec830-19c2-41d1-83d4-e0db391422c3 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:54:04.712486 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a1fec830-19c2-41d1-83d4-e0db391422c3 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:54:04.713231 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a1fec830-19c2-41d1-83d4-e0db391422c3 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:54:04.713654 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a1fec830-19c2-41d1-83d4-e0db391422c3 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:54:04.833865 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-a1fec830-19c2-41d1-83d4-e0db391422c3 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:54:04.841415 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-a1fec830-19c2-41d1-83d4-e0db391422c3 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:54:04.842916 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-a1fec830-19c2-41d1-83d4-e0db391422c3 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:54:04.843992 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-a1fec830-19c2-41d1-83d4-e0db391422c3 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "GET /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad" status: 200 len: 1407 microversion: 2.20 time: 0.142444 Nov 01 01:54:04.844552 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1435/2962] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Nov 1 01:54:04 2021] GET /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad => generated 1407 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 01:54:05.861576 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-bfc278fd-4427-4e2f-95c7-e2b6b09e376c tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:54:05.862180 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-bfc278fd-4427-4e2f-95c7-e2b6b09e376c tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: 6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:54:05.868440 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-bfc278fd-4427-4e2f-95c7-e2b6b09e376c tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:54:05.868878 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-bfc278fd-4427-4e2f-95c7-e2b6b09e376c tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:54:05.869623 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-bfc278fd-4427-4e2f-95c7-e2b6b09e376c tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:54:05.870050 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-bfc278fd-4427-4e2f-95c7-e2b6b09e376c tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:54:05.995629 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-bfc278fd-4427-4e2f-95c7-e2b6b09e376c tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:54:06.003747 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-bfc278fd-4427-4e2f-95c7-e2b6b09e376c tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:54:06.005247 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-bfc278fd-4427-4e2f-95c7-e2b6b09e376c tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:54:06.006341 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-bfc278fd-4427-4e2f-95c7-e2b6b09e376c tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "GET /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad" status: 200 len: 1407 microversion: 2.20 time: 0.148456 Nov 01 01:54:06.006934 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1528/2963] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Nov 1 01:54:05 2021] GET /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad => generated 1407 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 01:54:07.024067 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-5b042674-01b7-4c59-ac26-219df2e6062e tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:54:07.024672 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-5b042674-01b7-4c59-ac26-219df2e6062e tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: 6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:54:07.031459 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5b042674-01b7-4c59-ac26-219df2e6062e tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:54:07.031949 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5b042674-01b7-4c59-ac26-219df2e6062e tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:54:07.032708 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5b042674-01b7-4c59-ac26-219df2e6062e tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:54:07.033143 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5b042674-01b7-4c59-ac26-219df2e6062e tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:54:07.151751 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-5b042674-01b7-4c59-ac26-219df2e6062e tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:54:07.159858 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-5b042674-01b7-4c59-ac26-219df2e6062e tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:54:07.161381 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-5b042674-01b7-4c59-ac26-219df2e6062e tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:54:07.163560 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-5b042674-01b7-4c59-ac26-219df2e6062e tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "GET /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad" status: 200 len: 1599 microversion: 2.20 time: 0.142108 Nov 01 01:54:07.164181 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1436/2964] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Nov 1 01:54:07 2021] GET /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad => generated 1599 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 01:54:07.181893 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-b7c223aa-4f7c-4c4c-bf94-5096f4c2414f tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:54:07.182389 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-b7c223aa-4f7c-4c4c-bf94-5096f4c2414f tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: 6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:54:07.188605 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b7c223aa-4f7c-4c4c-bf94-5096f4c2414f tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:54:07.189049 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b7c223aa-4f7c-4c4c-bf94-5096f4c2414f tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:54:07.189806 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b7c223aa-4f7c-4c4c-bf94-5096f4c2414f tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:54:07.190234 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b7c223aa-4f7c-4c4c-bf94-5096f4c2414f tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:54:07.271597 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-b7c223aa-4f7c-4c4c-bf94-5096f4c2414f tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "GET /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.093647 Nov 01 01:54:07.272194 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1529/2965] 10.222.0.47 () {60 vars in 1315 bytes} [Mon Nov 1 01:54:07 2021] GET /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad/os-interface => generated 285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 01 01:54:08.477890 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-97613f6b-d19e-4336-9b77-7fe356c0d9c3 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:54:08.478822 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-97613f6b-d19e-4336-9b77-7fe356c0d9c3 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: 6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:54:08.486978 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-97613f6b-d19e-4336-9b77-7fe356c0d9c3 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:54:08.487422 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-97613f6b-d19e-4336-9b77-7fe356c0d9c3 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:54:08.488184 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-97613f6b-d19e-4336-9b77-7fe356c0d9c3 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:54:08.488606 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-97613f6b-d19e-4336-9b77-7fe356c0d9c3 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:54:08.543839 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [req-607b649e-0a76-42d1-a326-9653f1ac0c97 req-f15c72a5-165e-4158-baa9-8a515f34f282 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad", "tag": "0d980dc6-46c5-489a-a08f-baa507ecfcdd"}]} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:54:08.545456 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 01 01:54:08.545456 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: warnings.warn(msg) Nov 01 01:54:08.552230 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [req-607b649e-0a76-42d1-a326-9653f1ac0c97 req-f15c72a5-165e-4158-baa9-8a515f34f282 service nova] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:54:08.552815 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [req-607b649e-0a76-42d1-a326-9653f1ac0c97 req-f15c72a5-165e-4158-baa9-8a515f34f282 service nova] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:54:08.564150 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.compute.server_external_events [req-607b649e-0a76-42d1-a326-9653f1ac0c97 req-f15c72a5-165e-4158-baa9-8a515f34f282 service nova] Creating event network-changed:0d980dc6-46c5-489a-a08f-baa507ecfcdd for instance 6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad on hv-cinder-81561 Nov 01 01:54:08.569103 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [req-607b649e-0a76-42d1-a326-9653f1ac0c97 req-f15c72a5-165e-4158-baa9-8a515f34f282 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092569 Nov 01 01:54:08.569935 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1530/2966] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Nov 1 01:54:08 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:54:11.384796 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-97613f6b-d19e-4336-9b77-7fe356c0d9c3 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "POST /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad/action" status: 200 len: 14 microversion: 2.20 time: 2.910567 Nov 01 01:54:11.385607 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1437/2967] 10.222.0.47 () {62 vars in 1318 bytes} [Mon Nov 1 01:54:08 2021] POST /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad/action => generated 14 bytes in 2912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:54:12.396436 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-de3b6615-c57b-4cfd-a0d8-fc0c19280bbd tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:54:12.397459 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-de3b6615-c57b-4cfd-a0d8-fc0c19280bbd tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: 6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:54:12.404455 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-de3b6615-c57b-4cfd-a0d8-fc0c19280bbd tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:54:12.404895 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-de3b6615-c57b-4cfd-a0d8-fc0c19280bbd tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:54:12.405667 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-de3b6615-c57b-4cfd-a0d8-fc0c19280bbd tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:54:12.406070 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-de3b6615-c57b-4cfd-a0d8-fc0c19280bbd tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:54:12.489911 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-de3b6615-c57b-4cfd-a0d8-fc0c19280bbd tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "POST /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad/action" status: 200 len: 14 microversion: 2.20 time: 0.097357 Nov 01 01:54:12.490550 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1531/2968] 10.222.0.47 () {62 vars in 1318 bytes} [Mon Nov 1 01:54:12 2021] POST /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad/action => generated 14 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:54:13.501907 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-ea8bcfbb-4cc6-4765-b4ab-f209c3b87e3d tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:54:13.502940 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-ea8bcfbb-4cc6-4765-b4ab-f209c3b87e3d tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: 6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:54:13.509676 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ea8bcfbb-4cc6-4765-b4ab-f209c3b87e3d tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:54:13.510138 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ea8bcfbb-4cc6-4765-b4ab-f209c3b87e3d tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:54:13.510907 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ea8bcfbb-4cc6-4765-b4ab-f209c3b87e3d tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:54:13.511337 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ea8bcfbb-4cc6-4765-b4ab-f209c3b87e3d tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:54:13.592307 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-ea8bcfbb-4cc6-4765-b4ab-f209c3b87e3d tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "POST /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad/action" status: 200 len: 14 microversion: 2.20 time: 0.095331 Nov 01 01:54:13.592896 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1438/2969] 10.222.0.47 () {62 vars in 1318 bytes} [Mon Nov 1 01:54:13 2021] POST /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad/action => generated 14 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:54:14.603824 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-48ff7e92-3705-40aa-8be0-4a852be48701 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:54:14.604854 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-48ff7e92-3705-40aa-8be0-4a852be48701 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: 6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:54:14.612475 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-48ff7e92-3705-40aa-8be0-4a852be48701 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:54:14.612919 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-48ff7e92-3705-40aa-8be0-4a852be48701 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:54:14.613671 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-48ff7e92-3705-40aa-8be0-4a852be48701 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:54:14.614096 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-48ff7e92-3705-40aa-8be0-4a852be48701 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:54:14.706389 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-48ff7e92-3705-40aa-8be0-4a852be48701 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "POST /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad/action" status: 200 len: 14 microversion: 2.20 time: 0.106505 Nov 01 01:54:14.707106 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1532/2970] 10.222.0.47 () {62 vars in 1318 bytes} [Mon Nov 1 01:54:14 2021] POST /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad/action => generated 14 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:54:15.717644 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-382c5257-335f-41fa-9265-818d7d555e4c tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:54:15.719257 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-382c5257-335f-41fa-9265-818d7d555e4c tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: 6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:54:15.726270 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-382c5257-335f-41fa-9265-818d7d555e4c tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:54:15.726749 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-382c5257-335f-41fa-9265-818d7d555e4c tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:54:15.727583 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-382c5257-335f-41fa-9265-818d7d555e4c tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:54:15.728011 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-382c5257-335f-41fa-9265-818d7d555e4c tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:54:15.823786 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-382c5257-335f-41fa-9265-818d7d555e4c tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "POST /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad/action" status: 200 len: 14 microversion: 2.20 time: 0.110084 Nov 01 01:54:15.824405 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1439/2971] 10.222.0.47 () {62 vars in 1318 bytes} [Mon Nov 1 01:54:15 2021] POST /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad/action => generated 14 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:54:16.502199 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-e7c2602f-1db7-4720-9621-47be950bf696 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:54:16.502829 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-e7c2602f-1db7-4720-9621-47be950bf696 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: c9b2dd10-f0d9-486c-9501-728c89f9d25a] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:54:16.509662 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e7c2602f-1db7-4720-9621-47be950bf696 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:54:16.510095 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e7c2602f-1db7-4720-9621-47be950bf696 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:54:16.510887 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e7c2602f-1db7-4720-9621-47be950bf696 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:54:16.511324 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e7c2602f-1db7-4720-9621-47be950bf696 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:54:16.588026 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.objects.instance [None req-e7c2602f-1db7-4720-9621-47be950bf696 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lazy-loading 'services' on Instance uuid c9b2dd10-f0d9-486c-9501-728c89f9d25a {{(pid=116267) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 01 01:54:16.827409 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-e7c2602f-1db7-4720-9621-47be950bf696 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "DELETE /compute/v2.1/servers/c9b2dd10-f0d9-486c-9501-728c89f9d25a/os-volume_attachments/5d910e56-ea5b-4ab7-9d48-4c977537d8b4" status: 202 len: 0 microversion: 2.1 time: 0.329135 Nov 01 01:54:16.828007 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1533/2972] 10.222.0.47 () {58 vars in 1415 bytes} [Mon Nov 1 01:54:16 2021] DELETE /compute/v2.1/servers/c9b2dd10-f0d9-486c-9501-728c89f9d25a/os-volume_attachments/5d910e56-ea5b-4ab7-9d48-4c977537d8b4 => generated 0 bytes in 331 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 01 01:54:16.835839 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-155cda0d-17b2-4ea4-a627-a56b1648783c tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:54:16.836834 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-155cda0d-17b2-4ea4-a627-a56b1648783c tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: 6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:54:16.844491 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-155cda0d-17b2-4ea4-a627-a56b1648783c tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:54:16.844939 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-155cda0d-17b2-4ea4-a627-a56b1648783c tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:54:16.845728 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-155cda0d-17b2-4ea4-a627-a56b1648783c tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:54:16.846153 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-155cda0d-17b2-4ea4-a627-a56b1648783c tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:54:16.927203 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-155cda0d-17b2-4ea4-a627-a56b1648783c tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "POST /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad/action" status: 200 len: 14 microversion: 2.20 time: 0.095546 Nov 01 01:54:16.927854 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1440/2973] 10.222.0.47 () {62 vars in 1318 bytes} [Mon Nov 1 01:54:16 2021] POST /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad/action => generated 14 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 01:54:17.938944 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-557ff418-8c98-461b-9231-095027bb1483 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:54:17.939947 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-557ff418-8c98-461b-9231-095027bb1483 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: 6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:54:17.945894 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-557ff418-8c98-461b-9231-095027bb1483 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:54:17.946348 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-557ff418-8c98-461b-9231-095027bb1483 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:54:17.947140 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-557ff418-8c98-461b-9231-095027bb1483 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:54:17.947573 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-557ff418-8c98-461b-9231-095027bb1483 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:54:18.034110 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-557ff418-8c98-461b-9231-095027bb1483 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "POST /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad/action" status: 200 len: 14 microversion: 2.20 time: 0.098797 Nov 01 01:54:18.034685 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1534/2974] 10.222.0.47 () {62 vars in 1318 bytes} [Mon Nov 1 01:54:17 2021] POST /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad/action => generated 14 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:54:18.982210 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-986c04ba-71fd-47ef-b7b6-2a3bc9cb5e2f tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:54:18.982824 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-986c04ba-71fd-47ef-b7b6-2a3bc9cb5e2f tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: c9b2dd10-f0d9-486c-9501-728c89f9d25a] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:54:18.990336 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-986c04ba-71fd-47ef-b7b6-2a3bc9cb5e2f tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:54:18.990837 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-986c04ba-71fd-47ef-b7b6-2a3bc9cb5e2f tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:54:18.991598 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-986c04ba-71fd-47ef-b7b6-2a3bc9cb5e2f tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:54:18.992033 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-986c04ba-71fd-47ef-b7b6-2a3bc9cb5e2f tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:54:19.016300 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-986c04ba-71fd-47ef-b7b6-2a3bc9cb5e2f tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: c9b2dd10-f0d9-486c-9501-728c89f9d25a] Going to try to terminate instance {{(pid=116266) delete /opt/stack/nova/nova/compute/api.py:2612}} Nov 01 01:54:19.045211 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-2916796c-f7e3-4f5d-b423-73aff5091e7e tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:54:19.046225 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-2916796c-f7e3-4f5d-b423-73aff5091e7e tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: 6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:54:19.053793 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-2916796c-f7e3-4f5d-b423-73aff5091e7e tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:54:19.054236 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-2916796c-f7e3-4f5d-b423-73aff5091e7e tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:54:19.055025 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-2916796c-f7e3-4f5d-b423-73aff5091e7e tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:54:19.055454 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-2916796c-f7e3-4f5d-b423-73aff5091e7e tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:54:19.182001 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-2916796c-f7e3-4f5d-b423-73aff5091e7e tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "POST /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad/action" status: 200 len: 6573 microversion: 2.20 time: 0.140619 Nov 01 01:54:19.182677 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1535/2975] 10.222.0.47 () {62 vars in 1318 bytes} [Mon Nov 1 01:54:19 2021] POST /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad/action => generated 6573 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 01 01:54:19.354189 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-986c04ba-71fd-47ef-b7b6-2a3bc9cb5e2f tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "DELETE /compute/v2.1/servers/c9b2dd10-f0d9-486c-9501-728c89f9d25a" status: 204 len: 0 microversion: 2.1 time: 0.375607 Nov 01 01:54:19.354818 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1441/2976] 10.222.0.47 () {58 vars in 1238 bytes} [Mon Nov 1 01:54:18 2021] DELETE /compute/v2.1/servers/c9b2dd10-f0d9-486c-9501-728c89f9d25a => generated 0 bytes in 377 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 01 01:54:19.363313 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-26fbfe7d-f9eb-4033-b443-366a1d917b19 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:54:19.364018 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-26fbfe7d-f9eb-4033-b443-366a1d917b19 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: c9b2dd10-f0d9-486c-9501-728c89f9d25a] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:54:19.370967 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-26fbfe7d-f9eb-4033-b443-366a1d917b19 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:54:19.371405 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-26fbfe7d-f9eb-4033-b443-366a1d917b19 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:54:19.372167 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-26fbfe7d-f9eb-4033-b443-366a1d917b19 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:54:19.372591 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-26fbfe7d-f9eb-4033-b443-366a1d917b19 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:54:19.494129 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-26fbfe7d-f9eb-4033-b443-366a1d917b19 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:54:19.501507 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-26fbfe7d-f9eb-4033-b443-366a1d917b19 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/c9b2dd10-f0d9-486c-9501-728c89f9d25a" status: 200 len: 1512 microversion: 2.1 time: 0.142279 Nov 01 01:54:19.502064 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1536/2977] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:54:19 2021] GET /compute/v2.1/servers/c9b2dd10-f0d9-486c-9501-728c89f9d25a => generated 1512 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:54:20.194384 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-4a704fdb-15aa-4bed-be63-1e05c05ac91e tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:54:20.195478 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-4a704fdb-15aa-4bed-be63-1e05c05ac91e tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: 6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:54:20.202837 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4a704fdb-15aa-4bed-be63-1e05c05ac91e tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:54:20.203283 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4a704fdb-15aa-4bed-be63-1e05c05ac91e tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:54:20.204048 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4a704fdb-15aa-4bed-be63-1e05c05ac91e tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:54:20.204472 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4a704fdb-15aa-4bed-be63-1e05c05ac91e tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:54:20.297443 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-4a704fdb-15aa-4bed-be63-1e05c05ac91e tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "POST /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad/action" status: 200 len: 15025 microversion: 2.20 time: 0.107567 Nov 01 01:54:20.298109 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1442/2978] 10.222.0.47 () {62 vars in 1318 bytes} [Mon Nov 1 01:54:20 2021] POST /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad/action => generated 15025 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 01 01:54:20.518304 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-a469bffb-d893-4241-a404-1da4dfe8f79f tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:54:20.518945 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-a469bffb-d893-4241-a404-1da4dfe8f79f tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: c9b2dd10-f0d9-486c-9501-728c89f9d25a] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:54:20.525244 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a469bffb-d893-4241-a404-1da4dfe8f79f tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:54:20.525693 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a469bffb-d893-4241-a404-1da4dfe8f79f tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:54:20.526484 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a469bffb-d893-4241-a404-1da4dfe8f79f tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:54:20.526920 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a469bffb-d893-4241-a404-1da4dfe8f79f tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:54:20.644097 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-a469bffb-d893-4241-a404-1da4dfe8f79f tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:54:20.651768 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-a469bffb-d893-4241-a404-1da4dfe8f79f tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/c9b2dd10-f0d9-486c-9501-728c89f9d25a" status: 200 len: 1512 microversion: 2.1 time: 0.137143 Nov 01 01:54:20.652320 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1537/2979] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:54:20 2021] GET /compute/v2.1/servers/c9b2dd10-f0d9-486c-9501-728c89f9d25a => generated 1512 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:54:21.309482 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-23de4d07-2f14-4bbf-8fef-cebcf67c8b62 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:54:21.310526 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-23de4d07-2f14-4bbf-8fef-cebcf67c8b62 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: 6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:54:21.317794 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-23de4d07-2f14-4bbf-8fef-cebcf67c8b62 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:54:21.318241 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-23de4d07-2f14-4bbf-8fef-cebcf67c8b62 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:54:21.319039 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-23de4d07-2f14-4bbf-8fef-cebcf67c8b62 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:54:21.319468 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-23de4d07-2f14-4bbf-8fef-cebcf67c8b62 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:54:21.545295 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-23de4d07-2f14-4bbf-8fef-cebcf67c8b62 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "POST /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad/action" status: 200 len: 18356 microversion: 2.20 time: 0.239670 Nov 01 01:54:21.546010 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1443/2980] 10.222.0.47 () {62 vars in 1318 bytes} [Mon Nov 1 01:54:21 2021] POST /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad/action => generated 18356 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 01 01:54:21.675416 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-0eaa595f-bdf3-4aa2-a723-e0faf959c4f6 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:54:21.676034 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-0eaa595f-bdf3-4aa2-a723-e0faf959c4f6 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: c9b2dd10-f0d9-486c-9501-728c89f9d25a] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:54:21.682207 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0eaa595f-bdf3-4aa2-a723-e0faf959c4f6 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:54:21.682677 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0eaa595f-bdf3-4aa2-a723-e0faf959c4f6 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:54:21.683437 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0eaa595f-bdf3-4aa2-a723-e0faf959c4f6 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:54:21.683867 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0eaa595f-bdf3-4aa2-a723-e0faf959c4f6 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:54:21.807252 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-0eaa595f-bdf3-4aa2-a723-e0faf959c4f6 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:54:21.814519 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-0eaa595f-bdf3-4aa2-a723-e0faf959c4f6 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/c9b2dd10-f0d9-486c-9501-728c89f9d25a" status: 200 len: 1512 microversion: 2.1 time: 0.149272 Nov 01 01:54:21.815083 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1538/2981] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:54:21 2021] GET /compute/v2.1/servers/c9b2dd10-f0d9-486c-9501-728c89f9d25a => generated 1512 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:54:22.187079 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [req-0e39f6fa-ca5a-4935-a45b-48bcdfb277ed req-81fa5bb6-c57f-47d9-83d9-6521e19e30f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9b2dd10-f0d9-486c-9501-728c89f9d25a", "name": "network-vif-deleted", "tag": "6431126b-da71-4d2d-822c-a38936efa7ba"}]} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:54:22.188572 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 01 01:54:22.188572 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: warnings.warn(msg) Nov 01 01:54:22.196541 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [req-0e39f6fa-ca5a-4935-a45b-48bcdfb277ed req-81fa5bb6-c57f-47d9-83d9-6521e19e30f0 service nova] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:54:22.198205 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [req-0e39f6fa-ca5a-4935-a45b-48bcdfb277ed req-81fa5bb6-c57f-47d9-83d9-6521e19e30f0 service nova] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:54:22.208499 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.compute.server_external_events [req-0e39f6fa-ca5a-4935-a45b-48bcdfb277ed req-81fa5bb6-c57f-47d9-83d9-6521e19e30f0 service nova] Creating event network-vif-deleted:6431126b-da71-4d2d-822c-a38936efa7ba for instance c9b2dd10-f0d9-486c-9501-728c89f9d25a on hv-cinder-81561 Nov 01 01:54:22.213863 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [req-0e39f6fa-ca5a-4935-a45b-48bcdfb277ed req-81fa5bb6-c57f-47d9-83d9-6521e19e30f0 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030437 Nov 01 01:54:22.214477 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1444/2982] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Nov 1 01:54:22 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:54:22.556872 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-6fca780b-8e8c-498e-8976-aa40827f2f63 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:54:22.557894 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-6fca780b-8e8c-498e-8976-aa40827f2f63 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: 6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:54:22.564153 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-6fca780b-8e8c-498e-8976-aa40827f2f63 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:54:22.564592 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-6fca780b-8e8c-498e-8976-aa40827f2f63 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:54:22.565338 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-6fca780b-8e8c-498e-8976-aa40827f2f63 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:54:22.566266 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-6fca780b-8e8c-498e-8976-aa40827f2f63 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:54:22.660546 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-6fca780b-8e8c-498e-8976-aa40827f2f63 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "POST /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad/action" status: 200 len: 20148 microversion: 2.20 time: 0.107422 Nov 01 01:54:22.661319 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1539/2983] 10.222.0.47 () {62 vars in 1318 bytes} [Mon Nov 1 01:54:22 2021] POST /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad/action => generated 20148 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 01 01:54:22.831621 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-1de2dedb-06b6-4a55-820a-8078296a28aa tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:54:22.832303 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-1de2dedb-06b6-4a55-820a-8078296a28aa tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: c9b2dd10-f0d9-486c-9501-728c89f9d25a] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:54:22.838698 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1de2dedb-06b6-4a55-820a-8078296a28aa tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:54:22.839142 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1de2dedb-06b6-4a55-820a-8078296a28aa tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:54:22.839893 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1de2dedb-06b6-4a55-820a-8078296a28aa tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:54:22.840315 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1de2dedb-06b6-4a55-820a-8078296a28aa tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:54:22.870332 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1de2dedb-06b6-4a55-820a-8078296a28aa tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:54:22.870802 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1de2dedb-06b6-4a55-820a-8078296a28aa tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:54:22.871247 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.objects.instance [None req-1de2dedb-06b6-4a55-820a-8078296a28aa tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lazy-loading 'fault' on Instance uuid c9b2dd10-f0d9-486c-9501-728c89f9d25a {{(pid=116266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 01 01:54:22.912039 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-1de2dedb-06b6-4a55-820a-8078296a28aa tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4329fdd4b147af8b18f26b0656abd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795ef4656624d11a3adb196fe6c9681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:54:22.919158 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-1de2dedb-06b6-4a55-820a-8078296a28aa tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/c9b2dd10-f0d9-486c-9501-728c89f9d25a" status: 200 len: 1308 microversion: 2.1 time: 0.091518 Nov 01 01:54:22.919718 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1445/2984] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:54:22 2021] GET /compute/v2.1/servers/c9b2dd10-f0d9-486c-9501-728c89f9d25a => generated 1308 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:54:23.672696 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-c6f1e135-d313-4d93-b349-004f3b897464 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:54:23.673658 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-c6f1e135-d313-4d93-b349-004f3b897464 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: 6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:54:23.681316 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c6f1e135-d313-4d93-b349-004f3b897464 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:54:23.681766 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c6f1e135-d313-4d93-b349-004f3b897464 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:54:23.682556 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c6f1e135-d313-4d93-b349-004f3b897464 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:54:23.682991 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c6f1e135-d313-4d93-b349-004f3b897464 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:54:23.770192 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-c6f1e135-d313-4d93-b349-004f3b897464 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "POST /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad/action" status: 200 len: 22723 microversion: 2.20 time: 0.101587 Nov 01 01:54:23.770845 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1540/2985] 10.222.0.47 () {62 vars in 1318 bytes} [Mon Nov 1 01:54:23 2021] POST /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad/action => generated 22723 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 01 01:54:23.941446 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-8066a8b1-6e45-44a9-9c3e-677ec6143781 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:54:23.942052 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-8066a8b1-6e45-44a9-9c3e-677ec6143781 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] [instance: c9b2dd10-f0d9-486c-9501-728c89f9d25a] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:54:23.948287 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8066a8b1-6e45-44a9-9c3e-677ec6143781 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:54:23.948731 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8066a8b1-6e45-44a9-9c3e-677ec6143781 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:54:23.949485 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8066a8b1-6e45-44a9-9c3e-677ec6143781 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:54:23.949913 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8066a8b1-6e45-44a9-9c3e-677ec6143781 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:54:23.962626 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.wsgi [None req-8066a8b1-6e45-44a9-9c3e-677ec6143781 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] HTTP exception thrown: Instance c9b2dd10-f0d9-486c-9501-728c89f9d25a could not be found. Nov 01 01:54:23.963203 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-8066a8b1-6e45-44a9-9c3e-677ec6143781 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] Returning 404 to user: Instance c9b2dd10-f0d9-486c-9501-728c89f9d25a could not be found. {{(pid=116266) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 01 01:54:23.963985 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-8066a8b1-6e45-44a9-9c3e-677ec6143781 tempest-VolumesSnapshotTestJSON-1771750727 tempest-VolumesSnapshotTestJSON-1771750727-project] 10.222.0.47 "GET /compute/v2.1/servers/c9b2dd10-f0d9-486c-9501-728c89f9d25a" status: 404 len: 111 microversion: 2.1 time: 0.026858 Nov 01 01:54:23.964491 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1446/2986] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:54:23 2021] GET /compute/v2.1/servers/c9b2dd10-f0d9-486c-9501-728c89f9d25a => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 01:54:24.785296 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-358c44b3-345a-4681-9e81-53d026527292 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:54:24.785296 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-358c44b3-345a-4681-9e81-53d026527292 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: 6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:54:24.789652 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-358c44b3-345a-4681-9e81-53d026527292 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:54:24.790131 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-358c44b3-345a-4681-9e81-53d026527292 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:54:24.790936 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-358c44b3-345a-4681-9e81-53d026527292 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:54:24.791405 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-358c44b3-345a-4681-9e81-53d026527292 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:54:24.882990 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-358c44b3-345a-4681-9e81-53d026527292 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "POST /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad/action" status: 200 len: 24185 microversion: 2.20 time: 0.105137 Nov 01 01:54:24.883657 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1541/2987] 10.222.0.47 () {62 vars in 1318 bytes} [Mon Nov 1 01:54:24 2021] POST /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad/action => generated 24185 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 01 01:54:25.894129 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-cc1eb4cb-ee04-44a3-9eff-35599210aae6 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:54:25.895021 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-cc1eb4cb-ee04-44a3-9eff-35599210aae6 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: 6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:54:25.903707 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-cc1eb4cb-ee04-44a3-9eff-35599210aae6 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:54:25.904160 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-cc1eb4cb-ee04-44a3-9eff-35599210aae6 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:54:25.904915 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-cc1eb4cb-ee04-44a3-9eff-35599210aae6 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:54:25.905415 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-cc1eb4cb-ee04-44a3-9eff-35599210aae6 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:54:25.996614 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-cc1eb4cb-ee04-44a3-9eff-35599210aae6 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "POST /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad/action" status: 200 len: 25875 microversion: 2.20 time: 0.105930 Nov 01 01:54:25.997836 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1447/2988] 10.222.0.47 () {62 vars in 1318 bytes} [Mon Nov 1 01:54:25 2021] POST /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad/action => generated 25875 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 01 01:54:27.008912 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-15bc2928-ae8d-42db-bc4d-e5c62ef639a5 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:54:27.009941 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-15bc2928-ae8d-42db-bc4d-e5c62ef639a5 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: 6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:54:27.017959 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-15bc2928-ae8d-42db-bc4d-e5c62ef639a5 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:54:27.018410 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-15bc2928-ae8d-42db-bc4d-e5c62ef639a5 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:54:27.019226 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-15bc2928-ae8d-42db-bc4d-e5c62ef639a5 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:54:27.019648 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-15bc2928-ae8d-42db-bc4d-e5c62ef639a5 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:54:30.093979 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-15bc2928-ae8d-42db-bc4d-e5c62ef639a5 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "POST /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad/action" status: 200 len: 27727 microversion: 2.20 time: 3.089518 Nov 01 01:54:30.097944 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1542/2989] 10.222.0.47 () {62 vars in 1318 bytes} [Mon Nov 1 01:54:27 2021] POST /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad/action => generated 27727 bytes in 3091 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 01 01:54:31.106944 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-e6d5f582-ce8e-4b0b-9218-ddd55aa2bf17 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:54:31.107947 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-e6d5f582-ce8e-4b0b-9218-ddd55aa2bf17 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: 6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:54:31.114939 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e6d5f582-ce8e-4b0b-9218-ddd55aa2bf17 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:54:31.115376 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e6d5f582-ce8e-4b0b-9218-ddd55aa2bf17 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:54:31.116128 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e6d5f582-ce8e-4b0b-9218-ddd55aa2bf17 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:54:31.116552 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e6d5f582-ce8e-4b0b-9218-ddd55aa2bf17 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:54:31.210339 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-e6d5f582-ce8e-4b0b-9218-ddd55aa2bf17 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "POST /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad/action" status: 200 len: 27793 microversion: 2.20 time: 0.108085 Nov 01 01:54:31.212649 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1448/2990] 10.222.0.47 () {62 vars in 1318 bytes} [Mon Nov 1 01:54:31 2021] POST /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad/action => generated 27793 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 01 01:54:32.221821 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-1e5e9ea8-b1bc-4697-aa33-4d8325a75736 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:54:32.222725 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-1e5e9ea8-b1bc-4697-aa33-4d8325a75736 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: 6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:54:32.230892 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-1e5e9ea8-b1bc-4697-aa33-4d8325a75736 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:54:32.231339 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-1e5e9ea8-b1bc-4697-aa33-4d8325a75736 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:54:32.232098 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-1e5e9ea8-b1bc-4697-aa33-4d8325a75736 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:54:32.232527 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-1e5e9ea8-b1bc-4697-aa33-4d8325a75736 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:54:32.356172 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-1e5e9ea8-b1bc-4697-aa33-4d8325a75736 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "POST /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad/action" status: 200 len: 27793 microversion: 2.20 time: 0.138455 Nov 01 01:54:32.356807 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1543/2991] 10.222.0.47 () {62 vars in 1318 bytes} [Mon Nov 1 01:54:32 2021] POST /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad/action => generated 27793 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 01 01:54:33.367741 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-9ad42077-6e44-43db-843f-ffff7b3fcade tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:54:33.368771 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-9ad42077-6e44-43db-843f-ffff7b3fcade tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: 6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:54:33.376408 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9ad42077-6e44-43db-843f-ffff7b3fcade tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:54:33.376850 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9ad42077-6e44-43db-843f-ffff7b3fcade tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:54:33.377626 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9ad42077-6e44-43db-843f-ffff7b3fcade tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:54:33.378025 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9ad42077-6e44-43db-843f-ffff7b3fcade tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:54:33.500213 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-9ad42077-6e44-43db-843f-ffff7b3fcade tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "POST /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad/action" status: 200 len: 28038 microversion: 2.20 time: 0.136305 Nov 01 01:54:33.500891 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1449/2992] 10.222.0.47 () {62 vars in 1318 bytes} [Mon Nov 1 01:54:33 2021] POST /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad/action => generated 28038 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 01 01:54:34.512390 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-8e1061e0-f588-4905-88b4-fce9f1b04258 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:54:34.513396 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-8e1061e0-f588-4905-88b4-fce9f1b04258 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: 6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:54:34.520028 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8e1061e0-f588-4905-88b4-fce9f1b04258 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:54:34.520478 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8e1061e0-f588-4905-88b4-fce9f1b04258 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:54:34.521239 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8e1061e0-f588-4905-88b4-fce9f1b04258 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:54:34.521671 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8e1061e0-f588-4905-88b4-fce9f1b04258 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:54:34.613298 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-8e1061e0-f588-4905-88b4-fce9f1b04258 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "POST /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad/action" status: 200 len: 28155 microversion: 2.20 time: 0.104804 Nov 01 01:54:34.613920 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1544/2993] 10.222.0.47 () {62 vars in 1318 bytes} [Mon Nov 1 01:54:34 2021] POST /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad/action => generated 28155 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 01 01:54:35.625584 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-a6cead29-9a17-471d-b20f-2b10a260673d tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:54:35.626845 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-a6cead29-9a17-471d-b20f-2b10a260673d tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: 6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:54:35.633594 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a6cead29-9a17-471d-b20f-2b10a260673d tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:54:35.634038 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a6cead29-9a17-471d-b20f-2b10a260673d tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:54:35.634811 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a6cead29-9a17-471d-b20f-2b10a260673d tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:54:35.635232 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a6cead29-9a17-471d-b20f-2b10a260673d tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:54:35.716023 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-a6cead29-9a17-471d-b20f-2b10a260673d tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "POST /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad/action" status: 200 len: 28155 microversion: 2.20 time: 0.095064 Nov 01 01:54:35.716669 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1450/2994] 10.222.0.47 () {62 vars in 1318 bytes} [Mon Nov 1 01:54:35 2021] POST /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad/action => generated 28155 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 01 01:54:36.728145 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-147978e3-7d65-4917-b0cc-6f97c2226b2b tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:54:36.729159 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-147978e3-7d65-4917-b0cc-6f97c2226b2b tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: 6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:54:36.735970 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-147978e3-7d65-4917-b0cc-6f97c2226b2b tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:54:36.736415 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-147978e3-7d65-4917-b0cc-6f97c2226b2b tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:54:36.737198 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-147978e3-7d65-4917-b0cc-6f97c2226b2b tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:54:36.737626 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-147978e3-7d65-4917-b0cc-6f97c2226b2b tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:54:36.822784 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-147978e3-7d65-4917-b0cc-6f97c2226b2b tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "POST /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad/action" status: 200 len: 28155 microversion: 2.20 time: 0.098529 Nov 01 01:54:36.823397 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1545/2995] 10.222.0.47 () {62 vars in 1318 bytes} [Mon Nov 1 01:54:36 2021] POST /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad/action => generated 28155 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 01 01:54:37.835407 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-71c0da33-dfbe-460e-bde2-0e9babe3c913 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:54:37.836428 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-71c0da33-dfbe-460e-bde2-0e9babe3c913 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: 6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:54:37.843760 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-71c0da33-dfbe-460e-bde2-0e9babe3c913 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:54:37.844195 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-71c0da33-dfbe-460e-bde2-0e9babe3c913 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:54:37.844951 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-71c0da33-dfbe-460e-bde2-0e9babe3c913 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:54:37.845377 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-71c0da33-dfbe-460e-bde2-0e9babe3c913 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:54:40.765390 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-71c0da33-dfbe-460e-bde2-0e9babe3c913 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "POST /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad/action" status: 200 len: 28155 microversion: 2.20 time: 2.933804 Nov 01 01:54:40.770070 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1451/2996] 10.222.0.47 () {62 vars in 1318 bytes} [Mon Nov 1 01:54:37 2021] POST /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad/action => generated 28155 bytes in 2936 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 01 01:54:41.777825 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-b39ba74a-1140-41ce-9102-3fc38a0b45f1 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:54:41.778866 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-b39ba74a-1140-41ce-9102-3fc38a0b45f1 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: 6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:54:41.785842 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b39ba74a-1140-41ce-9102-3fc38a0b45f1 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:54:41.786297 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b39ba74a-1140-41ce-9102-3fc38a0b45f1 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:54:41.787167 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b39ba74a-1140-41ce-9102-3fc38a0b45f1 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:54:41.787721 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b39ba74a-1140-41ce-9102-3fc38a0b45f1 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:54:41.881558 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-b39ba74a-1140-41ce-9102-3fc38a0b45f1 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "POST /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad/action" status: 200 len: 28155 microversion: 2.20 time: 0.107839 Nov 01 01:54:41.882188 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1546/2997] 10.222.0.47 () {62 vars in 1318 bytes} [Mon Nov 1 01:54:41 2021] POST /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad/action => generated 28155 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 01 01:54:42.894344 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-d60281d0-a951-4f87-981e-4854110e367a tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:54:42.895413 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-d60281d0-a951-4f87-981e-4854110e367a tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: 6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:54:42.902996 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d60281d0-a951-4f87-981e-4854110e367a tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:54:42.903445 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d60281d0-a951-4f87-981e-4854110e367a tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:54:42.904198 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d60281d0-a951-4f87-981e-4854110e367a tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:54:42.904627 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d60281d0-a951-4f87-981e-4854110e367a tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:54:43.012261 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-d60281d0-a951-4f87-981e-4854110e367a tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "POST /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad/action" status: 200 len: 28155 microversion: 2.20 time: 0.122458 Nov 01 01:54:43.012900 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1452/2998] 10.222.0.47 () {62 vars in 1318 bytes} [Mon Nov 1 01:54:42 2021] POST /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad/action => generated 28155 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 01 01:54:44.024245 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-119c90e5-b108-4e4f-a6f4-22e696e6454d tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:54:44.025249 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-119c90e5-b108-4e4f-a6f4-22e696e6454d tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: 6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:54:44.032642 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-119c90e5-b108-4e4f-a6f4-22e696e6454d tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:54:44.033092 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-119c90e5-b108-4e4f-a6f4-22e696e6454d tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:54:44.033853 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-119c90e5-b108-4e4f-a6f4-22e696e6454d tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:54:44.034292 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-119c90e5-b108-4e4f-a6f4-22e696e6454d tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:54:44.115385 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-119c90e5-b108-4e4f-a6f4-22e696e6454d tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "POST /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad/action" status: 200 len: 28155 microversion: 2.20 time: 0.094943 Nov 01 01:54:44.116196 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1547/2999] 10.222.0.47 () {62 vars in 1318 bytes} [Mon Nov 1 01:54:44 2021] POST /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad/action => generated 28155 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 01 01:54:45.127541 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-5622e761-faa5-451b-a13e-d125e6909772 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:54:45.128535 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-5622e761-faa5-451b-a13e-d125e6909772 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: 6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:54:45.135353 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5622e761-faa5-451b-a13e-d125e6909772 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:54:45.135800 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5622e761-faa5-451b-a13e-d125e6909772 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:54:45.136583 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5622e761-faa5-451b-a13e-d125e6909772 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:54:45.137030 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5622e761-faa5-451b-a13e-d125e6909772 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:54:45.236474 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-5622e761-faa5-451b-a13e-d125e6909772 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "POST /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad/action" status: 200 len: 28155 microversion: 2.20 time: 0.113485 Nov 01 01:54:45.237429 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1453/3000] 10.222.0.47 () {62 vars in 1318 bytes} [Mon Nov 1 01:54:45 2021] POST /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad/action => generated 28155 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 01 01:54:46.248171 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-bcd1dd54-b77c-4041-b7d9-4b606180b18b tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:54:46.249168 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-bcd1dd54-b77c-4041-b7d9-4b606180b18b tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: 6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:54:46.256476 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-bcd1dd54-b77c-4041-b7d9-4b606180b18b tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:54:46.256924 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-bcd1dd54-b77c-4041-b7d9-4b606180b18b tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:54:46.257681 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-bcd1dd54-b77c-4041-b7d9-4b606180b18b tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:54:46.258110 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-bcd1dd54-b77c-4041-b7d9-4b606180b18b tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:54:46.357868 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-bcd1dd54-b77c-4041-b7d9-4b606180b18b tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "POST /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad/action" status: 200 len: 28155 microversion: 2.20 time: 0.113643 Nov 01 01:54:46.358542 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1548/3001] 10.222.0.47 () {62 vars in 1318 bytes} [Mon Nov 1 01:54:46 2021] POST /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad/action => generated 28155 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 01 01:54:47.369560 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-b01b55e9-5f6c-4c62-a1d1-8153970d61be tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:54:47.370655 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-b01b55e9-5f6c-4c62-a1d1-8153970d61be tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: 6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:54:47.377589 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b01b55e9-5f6c-4c62-a1d1-8153970d61be tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:54:47.379634 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b01b55e9-5f6c-4c62-a1d1-8153970d61be tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:54:47.379634 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b01b55e9-5f6c-4c62-a1d1-8153970d61be tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:54:47.379634 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b01b55e9-5f6c-4c62-a1d1-8153970d61be tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:54:47.461727 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-b01b55e9-5f6c-4c62-a1d1-8153970d61be tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "POST /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad/action" status: 200 len: 28155 microversion: 2.20 time: 0.096145 Nov 01 01:54:47.462360 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1454/3002] 10.222.0.47 () {62 vars in 1318 bytes} [Mon Nov 1 01:54:47 2021] POST /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad/action => generated 28155 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 01 01:54:48.473857 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-ca713d71-9573-43b5-9089-83ba0a69f4c1 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:54:48.474872 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-ca713d71-9573-43b5-9089-83ba0a69f4c1 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: 6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:54:48.481763 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ca713d71-9573-43b5-9089-83ba0a69f4c1 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:54:48.482199 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ca713d71-9573-43b5-9089-83ba0a69f4c1 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:54:48.482975 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ca713d71-9573-43b5-9089-83ba0a69f4c1 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:54:48.483399 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ca713d71-9573-43b5-9089-83ba0a69f4c1 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:54:48.566653 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-ca713d71-9573-43b5-9089-83ba0a69f4c1 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "POST /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad/action" status: 200 len: 28155 microversion: 2.20 time: 0.097213 Nov 01 01:54:48.567488 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1549/3003] 10.222.0.47 () {62 vars in 1318 bytes} [Mon Nov 1 01:54:48 2021] POST /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad/action => generated 28155 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 01 01:54:49.577894 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-0cd1fb30-4358-495b-98e9-da10fd765246 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:54:49.578784 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-0cd1fb30-4358-495b-98e9-da10fd765246 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: 6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:54:49.585751 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0cd1fb30-4358-495b-98e9-da10fd765246 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:54:49.586201 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0cd1fb30-4358-495b-98e9-da10fd765246 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:54:49.586990 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0cd1fb30-4358-495b-98e9-da10fd765246 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:54:49.587424 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0cd1fb30-4358-495b-98e9-da10fd765246 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:54:49.673812 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-0cd1fb30-4358-495b-98e9-da10fd765246 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "POST /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad/action" status: 200 len: 28155 microversion: 2.20 time: 0.100150 Nov 01 01:54:49.675528 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1455/3004] 10.222.0.47 () {62 vars in 1318 bytes} [Mon Nov 1 01:54:49 2021] POST /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad/action => generated 28155 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 01 01:54:50.686810 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-58f50770-9fc7-48a2-b6ca-c1bc7bbf9eef tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:54:50.687807 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-58f50770-9fc7-48a2-b6ca-c1bc7bbf9eef tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: 6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:54:50.695176 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-58f50770-9fc7-48a2-b6ca-c1bc7bbf9eef tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:54:50.695620 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-58f50770-9fc7-48a2-b6ca-c1bc7bbf9eef tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:54:50.696368 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-58f50770-9fc7-48a2-b6ca-c1bc7bbf9eef tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:54:50.696795 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-58f50770-9fc7-48a2-b6ca-c1bc7bbf9eef tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:54:50.780058 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-58f50770-9fc7-48a2-b6ca-c1bc7bbf9eef tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "POST /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad/action" status: 200 len: 28155 microversion: 2.20 time: 0.097221 Nov 01 01:54:50.780712 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1550/3005] 10.222.0.47 () {62 vars in 1318 bytes} [Mon Nov 1 01:54:50 2021] POST /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad/action => generated 28155 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 01 01:54:51.792306 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-84608655-b14f-4175-b82d-87a019660229 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:54:51.793293 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-84608655-b14f-4175-b82d-87a019660229 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: 6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:54:51.800722 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-84608655-b14f-4175-b82d-87a019660229 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:54:51.801165 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-84608655-b14f-4175-b82d-87a019660229 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:54:51.801911 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-84608655-b14f-4175-b82d-87a019660229 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:54:51.802337 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-84608655-b14f-4175-b82d-87a019660229 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:54:51.890519 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-84608655-b14f-4175-b82d-87a019660229 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "POST /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad/action" status: 200 len: 28155 microversion: 2.20 time: 0.102073 Nov 01 01:54:51.891506 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1456/3006] 10.222.0.47 () {62 vars in 1318 bytes} [Mon Nov 1 01:54:51 2021] POST /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad/action => generated 28155 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 01 01:54:52.902858 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-ef93b8ba-5f4e-4301-8560-d5f2318fb309 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:54:52.903864 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-ef93b8ba-5f4e-4301-8560-d5f2318fb309 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: 6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:54:52.910716 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ef93b8ba-5f4e-4301-8560-d5f2318fb309 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:54:52.911168 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ef93b8ba-5f4e-4301-8560-d5f2318fb309 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:54:52.911929 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ef93b8ba-5f4e-4301-8560-d5f2318fb309 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:54:52.912362 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ef93b8ba-5f4e-4301-8560-d5f2318fb309 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:54:53.028944 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-ef93b8ba-5f4e-4301-8560-d5f2318fb309 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "POST /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad/action" status: 200 len: 28280 microversion: 2.20 time: 0.129896 Nov 01 01:54:53.029517 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1551/3007] 10.222.0.47 () {62 vars in 1318 bytes} [Mon Nov 1 01:54:52 2021] POST /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad/action => generated 28280 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 01 01:54:54.044407 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-363c6f2d-58a5-4522-82a5-ddad17884cab tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:54:54.046293 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-363c6f2d-58a5-4522-82a5-ddad17884cab tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: 6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:54:54.058086 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-363c6f2d-58a5-4522-82a5-ddad17884cab tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:54:54.058839 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-363c6f2d-58a5-4522-82a5-ddad17884cab tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:54:54.059985 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-363c6f2d-58a5-4522-82a5-ddad17884cab tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:54:54.060702 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-363c6f2d-58a5-4522-82a5-ddad17884cab tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:54:54.166585 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-363c6f2d-58a5-4522-82a5-ddad17884cab tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "POST /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad/action" status: 200 len: 28446 microversion: 2.20 time: 0.129099 Nov 01 01:54:54.167226 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1457/3008] 10.222.0.47 () {62 vars in 1318 bytes} [Mon Nov 1 01:54:54 2021] POST /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad/action => generated 28446 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 01 01:54:55.178891 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-26aa921e-6714-40bb-b063-cdb99ba8f255 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:54:55.179885 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-26aa921e-6714-40bb-b063-cdb99ba8f255 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: 6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:54:55.186629 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-26aa921e-6714-40bb-b063-cdb99ba8f255 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:54:55.187008 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-26aa921e-6714-40bb-b063-cdb99ba8f255 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:54:55.187764 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-26aa921e-6714-40bb-b063-cdb99ba8f255 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:54:55.188190 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-26aa921e-6714-40bb-b063-cdb99ba8f255 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:54:55.283892 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-26aa921e-6714-40bb-b063-cdb99ba8f255 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "POST /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad/action" status: 200 len: 28614 microversion: 2.20 time: 0.109123 Nov 01 01:54:55.287877 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1552/3009] 10.222.0.47 () {62 vars in 1318 bytes} [Mon Nov 1 01:54:55 2021] POST /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad/action => generated 28614 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 01 01:54:56.295178 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-0f38096a-d997-4db3-8357-e6ca71d53f01 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:54:56.296160 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-0f38096a-d997-4db3-8357-e6ca71d53f01 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: 6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:54:56.303166 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0f38096a-d997-4db3-8357-e6ca71d53f01 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:54:56.303607 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0f38096a-d997-4db3-8357-e6ca71d53f01 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:54:56.304359 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0f38096a-d997-4db3-8357-e6ca71d53f01 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:54:56.304781 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0f38096a-d997-4db3-8357-e6ca71d53f01 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:54:56.385080 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-0f38096a-d997-4db3-8357-e6ca71d53f01 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "POST /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad/action" status: 200 len: 28614 microversion: 2.20 time: 0.093827 Nov 01 01:54:56.389288 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1458/3010] 10.222.0.47 () {62 vars in 1318 bytes} [Mon Nov 1 01:54:56 2021] POST /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad/action => generated 28614 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 01 01:54:57.397487 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-8fd33baa-011b-49f7-902f-d1da2ce9fa5a tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:54:57.398514 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-8fd33baa-011b-49f7-902f-d1da2ce9fa5a tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: 6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:54:57.405342 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8fd33baa-011b-49f7-902f-d1da2ce9fa5a tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:54:57.405790 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8fd33baa-011b-49f7-902f-d1da2ce9fa5a tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:54:57.406589 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8fd33baa-011b-49f7-902f-d1da2ce9fa5a tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:54:57.407019 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8fd33baa-011b-49f7-902f-d1da2ce9fa5a tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:54:57.490906 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-8fd33baa-011b-49f7-902f-d1da2ce9fa5a tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "POST /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad/action" status: 200 len: 28614 microversion: 2.20 time: 0.096637 Nov 01 01:54:57.491561 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1553/3011] 10.222.0.47 () {62 vars in 1318 bytes} [Mon Nov 1 01:54:57 2021] POST /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad/action => generated 28614 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 01 01:54:58.503343 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-f7a0644f-fd8b-496e-b48e-30d1d6cdfe39 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:54:58.504340 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-f7a0644f-fd8b-496e-b48e-30d1d6cdfe39 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: 6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:54:58.511170 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f7a0644f-fd8b-496e-b48e-30d1d6cdfe39 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:54:58.511612 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f7a0644f-fd8b-496e-b48e-30d1d6cdfe39 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:54:58.512368 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f7a0644f-fd8b-496e-b48e-30d1d6cdfe39 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:54:58.512799 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f7a0644f-fd8b-496e-b48e-30d1d6cdfe39 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:54:58.596757 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-f7a0644f-fd8b-496e-b48e-30d1d6cdfe39 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "POST /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad/action" status: 200 len: 28614 microversion: 2.20 time: 0.097377 Nov 01 01:54:58.597373 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1459/3012] 10.222.0.47 () {62 vars in 1318 bytes} [Mon Nov 1 01:54:58 2021] POST /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad/action => generated 28614 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 01 01:54:59.608768 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-5fefa45a-5110-416a-9f53-a4f482d49a63 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:54:59.609777 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-5fefa45a-5110-416a-9f53-a4f482d49a63 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: 6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:54:59.617207 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-5fefa45a-5110-416a-9f53-a4f482d49a63 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:54:59.617600 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-5fefa45a-5110-416a-9f53-a4f482d49a63 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:54:59.618355 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-5fefa45a-5110-416a-9f53-a4f482d49a63 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:54:59.618811 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-5fefa45a-5110-416a-9f53-a4f482d49a63 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:54:59.706745 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-5fefa45a-5110-416a-9f53-a4f482d49a63 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "POST /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad/action" status: 200 len: 28614 microversion: 2.20 time: 0.101856 Nov 01 01:54:59.707609 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1554/3013] 10.222.0.47 () {62 vars in 1318 bytes} [Mon Nov 1 01:54:59 2021] POST /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad/action => generated 28614 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 01 01:55:00.718796 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-e00729c2-dd38-4c82-a5aa-6f04a8bbff43 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:55:00.719803 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-e00729c2-dd38-4c82-a5aa-6f04a8bbff43 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: 6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:55:00.726625 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e00729c2-dd38-4c82-a5aa-6f04a8bbff43 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:55:00.727078 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e00729c2-dd38-4c82-a5aa-6f04a8bbff43 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:55:00.727833 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e00729c2-dd38-4c82-a5aa-6f04a8bbff43 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:55:00.728262 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e00729c2-dd38-4c82-a5aa-6f04a8bbff43 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:55:00.810579 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-e00729c2-dd38-4c82-a5aa-6f04a8bbff43 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "POST /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad/action" status: 200 len: 28614 microversion: 2.20 time: 0.095659 Nov 01 01:55:00.811223 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1460/3014] 10.222.0.47 () {62 vars in 1318 bytes} [Mon Nov 1 01:55:00 2021] POST /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad/action => generated 28614 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 01 01:55:01.822095 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-7b186401-f87b-4e67-9c68-c17512b35a82 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:55:01.823117 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-7b186401-f87b-4e67-9c68-c17512b35a82 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: 6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:55:01.829882 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-7b186401-f87b-4e67-9c68-c17512b35a82 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:55:01.830323 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-7b186401-f87b-4e67-9c68-c17512b35a82 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:55:01.831097 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-7b186401-f87b-4e67-9c68-c17512b35a82 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:55:01.831518 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-7b186401-f87b-4e67-9c68-c17512b35a82 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:55:01.922503 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-7b186401-f87b-4e67-9c68-c17512b35a82 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "POST /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad/action" status: 200 len: 28614 microversion: 2.20 time: 0.104471 Nov 01 01:55:01.923121 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1555/3015] 10.222.0.47 () {62 vars in 1318 bytes} [Mon Nov 1 01:55:01 2021] POST /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad/action => generated 28614 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 01 01:55:02.934451 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-5a36890b-1c30-415e-b667-e72f5887d99b tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:55:02.935512 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-5a36890b-1c30-415e-b667-e72f5887d99b tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: 6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:55:02.942519 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5a36890b-1c30-415e-b667-e72f5887d99b tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:55:02.942964 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5a36890b-1c30-415e-b667-e72f5887d99b tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:55:02.943711 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5a36890b-1c30-415e-b667-e72f5887d99b tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:55:02.944134 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5a36890b-1c30-415e-b667-e72f5887d99b tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:55:03.024300 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-5a36890b-1c30-415e-b667-e72f5887d99b tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "POST /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad/action" status: 200 len: 28614 microversion: 2.20 time: 0.093723 Nov 01 01:55:03.024860 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1461/3016] 10.222.0.47 () {62 vars in 1318 bytes} [Mon Nov 1 01:55:02 2021] POST /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad/action => generated 28614 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 01 01:55:04.036269 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-dccf83f7-a459-423b-b6f3-ab8c217372be tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:55:04.037268 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-dccf83f7-a459-423b-b6f3-ab8c217372be tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: 6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:55:04.044156 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-dccf83f7-a459-423b-b6f3-ab8c217372be tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:55:04.044596 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-dccf83f7-a459-423b-b6f3-ab8c217372be tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:55:04.045347 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-dccf83f7-a459-423b-b6f3-ab8c217372be tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:55:04.045772 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-dccf83f7-a459-423b-b6f3-ab8c217372be tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:55:04.142788 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-dccf83f7-a459-423b-b6f3-ab8c217372be tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "POST /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad/action" status: 200 len: 28614 microversion: 2.20 time: 0.110372 Nov 01 01:55:04.143671 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1556/3017] 10.222.0.47 () {62 vars in 1318 bytes} [Mon Nov 1 01:55:04 2021] POST /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad/action => generated 28614 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 01 01:55:05.154815 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-f881e575-7346-44a6-9bd1-209e2e8bc4ba tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:55:05.155812 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-f881e575-7346-44a6-9bd1-209e2e8bc4ba tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: 6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:55:05.163163 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f881e575-7346-44a6-9bd1-209e2e8bc4ba tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:55:05.163609 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f881e575-7346-44a6-9bd1-209e2e8bc4ba tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:55:05.164385 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f881e575-7346-44a6-9bd1-209e2e8bc4ba tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:55:05.164811 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f881e575-7346-44a6-9bd1-209e2e8bc4ba tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:55:05.249790 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-f881e575-7346-44a6-9bd1-209e2e8bc4ba tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "POST /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad/action" status: 200 len: 28614 microversion: 2.20 time: 0.098836 Nov 01 01:55:05.250560 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1462/3018] 10.222.0.47 () {62 vars in 1318 bytes} [Mon Nov 1 01:55:05 2021] POST /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad/action => generated 28614 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 01 01:55:06.261547 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-7b26c1dc-342f-40dd-88a8-051f906fd480 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:55:06.262563 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-7b26c1dc-342f-40dd-88a8-051f906fd480 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: 6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:55:06.269309 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-7b26c1dc-342f-40dd-88a8-051f906fd480 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:55:06.269745 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-7b26c1dc-342f-40dd-88a8-051f906fd480 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:55:06.270512 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-7b26c1dc-342f-40dd-88a8-051f906fd480 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:55:06.270938 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-7b26c1dc-342f-40dd-88a8-051f906fd480 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:55:06.364178 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-7b26c1dc-342f-40dd-88a8-051f906fd480 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "POST /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad/action" status: 200 len: 28614 microversion: 2.20 time: 0.106449 Nov 01 01:55:06.365573 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1557/3019] 10.222.0.47 () {62 vars in 1318 bytes} [Mon Nov 1 01:55:06 2021] POST /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad/action => generated 28614 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 01 01:55:07.376651 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-a1461f86-5f0b-4b61-a049-24db84eb5fe5 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:55:07.377667 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-a1461f86-5f0b-4b61-a049-24db84eb5fe5 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: 6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:55:07.384424 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a1461f86-5f0b-4b61-a049-24db84eb5fe5 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:55:07.384858 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a1461f86-5f0b-4b61-a049-24db84eb5fe5 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:55:07.385601 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a1461f86-5f0b-4b61-a049-24db84eb5fe5 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:55:07.386033 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a1461f86-5f0b-4b61-a049-24db84eb5fe5 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:55:07.466868 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-a1461f86-5f0b-4b61-a049-24db84eb5fe5 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "POST /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad/action" status: 200 len: 28614 microversion: 2.20 time: 0.094077 Nov 01 01:55:07.467718 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1463/3020] 10.222.0.47 () {62 vars in 1318 bytes} [Mon Nov 1 01:55:07 2021] POST /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad/action => generated 28614 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 01 01:55:08.478771 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-e8c8be38-9dea-477c-8c77-837291b10109 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:55:08.479770 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-e8c8be38-9dea-477c-8c77-837291b10109 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: 6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:55:08.486554 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e8c8be38-9dea-477c-8c77-837291b10109 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:55:08.487002 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e8c8be38-9dea-477c-8c77-837291b10109 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:55:08.487754 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e8c8be38-9dea-477c-8c77-837291b10109 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:55:08.488189 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e8c8be38-9dea-477c-8c77-837291b10109 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:55:08.570841 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-e8c8be38-9dea-477c-8c77-837291b10109 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "POST /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad/action" status: 200 len: 28614 microversion: 2.20 time: 0.095981 Nov 01 01:55:08.571774 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1558/3021] 10.222.0.47 () {62 vars in 1318 bytes} [Mon Nov 1 01:55:08 2021] POST /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad/action => generated 28614 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 01 01:55:09.582880 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-fb674d1c-1df2-476d-bec7-6e1cd9b350f8 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:55:09.584364 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-fb674d1c-1df2-476d-bec7-6e1cd9b350f8 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: 6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:55:09.591113 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-fb674d1c-1df2-476d-bec7-6e1cd9b350f8 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:55:09.591564 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-fb674d1c-1df2-476d-bec7-6e1cd9b350f8 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:55:09.592318 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-fb674d1c-1df2-476d-bec7-6e1cd9b350f8 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:55:09.592749 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-fb674d1c-1df2-476d-bec7-6e1cd9b350f8 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:55:09.674474 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-fb674d1c-1df2-476d-bec7-6e1cd9b350f8 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "POST /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad/action" status: 200 len: 28614 microversion: 2.20 time: 0.095518 Nov 01 01:55:09.675112 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1464/3022] 10.222.0.47 () {62 vars in 1318 bytes} [Mon Nov 1 01:55:09 2021] POST /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad/action => generated 28614 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 01 01:55:10.686590 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-f504de3e-67ae-43b4-af71-6783506b392d tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:55:10.687615 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-f504de3e-67ae-43b4-af71-6783506b392d tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: 6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:55:10.694404 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f504de3e-67ae-43b4-af71-6783506b392d tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:55:10.694867 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f504de3e-67ae-43b4-af71-6783506b392d tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:55:10.695615 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f504de3e-67ae-43b4-af71-6783506b392d tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:55:10.696040 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f504de3e-67ae-43b4-af71-6783506b392d tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:55:10.780237 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-f504de3e-67ae-43b4-af71-6783506b392d tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "POST /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad/action" status: 200 len: 28614 microversion: 2.20 time: 0.097382 Nov 01 01:55:10.780893 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1559/3023] 10.222.0.47 () {62 vars in 1318 bytes} [Mon Nov 1 01:55:10 2021] POST /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad/action => generated 28614 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 01 01:55:11.792840 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-a145d113-53cc-415c-98d8-88705b8a92dc tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:55:11.793758 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-a145d113-53cc-415c-98d8-88705b8a92dc tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: 6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:55:11.800522 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a145d113-53cc-415c-98d8-88705b8a92dc tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:55:11.800968 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a145d113-53cc-415c-98d8-88705b8a92dc tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:55:11.801752 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a145d113-53cc-415c-98d8-88705b8a92dc tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:55:11.803211 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a145d113-53cc-415c-98d8-88705b8a92dc tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:55:11.888041 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-a145d113-53cc-415c-98d8-88705b8a92dc tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "POST /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad/action" status: 200 len: 28614 microversion: 2.20 time: 0.099169 Nov 01 01:55:11.888672 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1465/3024] 10.222.0.47 () {62 vars in 1318 bytes} [Mon Nov 1 01:55:11 2021] POST /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad/action => generated 28614 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 01 01:55:12.900674 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-f0d60743-afa0-43df-8465-8e1cd1d73c14 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:55:12.901665 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-f0d60743-afa0-43df-8465-8e1cd1d73c14 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: 6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:55:12.908799 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f0d60743-afa0-43df-8465-8e1cd1d73c14 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:55:12.909247 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f0d60743-afa0-43df-8465-8e1cd1d73c14 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:55:12.909995 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f0d60743-afa0-43df-8465-8e1cd1d73c14 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:55:12.910500 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f0d60743-afa0-43df-8465-8e1cd1d73c14 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:55:12.998562 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-f0d60743-afa0-43df-8465-8e1cd1d73c14 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "POST /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad/action" status: 200 len: 28614 microversion: 2.20 time: 0.101725 Nov 01 01:55:12.999441 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1560/3025] 10.222.0.47 () {62 vars in 1318 bytes} [Mon Nov 1 01:55:12 2021] POST /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad/action => generated 28614 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 01 01:55:14.011199 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-c5ddb29e-18b4-46f3-afe1-9e9b5799d6ca tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:55:14.012205 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-c5ddb29e-18b4-46f3-afe1-9e9b5799d6ca tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: 6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:55:14.019057 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c5ddb29e-18b4-46f3-afe1-9e9b5799d6ca tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:55:14.019505 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c5ddb29e-18b4-46f3-afe1-9e9b5799d6ca tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:55:14.020268 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c5ddb29e-18b4-46f3-afe1-9e9b5799d6ca tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:55:14.021270 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c5ddb29e-18b4-46f3-afe1-9e9b5799d6ca tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:55:14.103005 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-c5ddb29e-18b4-46f3-afe1-9e9b5799d6ca tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "POST /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad/action" status: 200 len: 28614 microversion: 2.20 time: 0.095664 Nov 01 01:55:14.103641 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1466/3026] 10.222.0.47 () {62 vars in 1318 bytes} [Mon Nov 1 01:55:14 2021] POST /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad/action => generated 28614 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 01 01:55:15.115104 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-c813a727-aac3-47d8-9a47-9c45d60c1330 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:55:15.116368 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-c813a727-aac3-47d8-9a47-9c45d60c1330 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: 6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:55:15.123142 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c813a727-aac3-47d8-9a47-9c45d60c1330 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:55:15.123589 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c813a727-aac3-47d8-9a47-9c45d60c1330 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:55:15.124352 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c813a727-aac3-47d8-9a47-9c45d60c1330 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:55:15.124785 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c813a727-aac3-47d8-9a47-9c45d60c1330 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:55:15.210983 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-c813a727-aac3-47d8-9a47-9c45d60c1330 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "POST /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad/action" status: 200 len: 28614 microversion: 2.20 time: 0.099721 Nov 01 01:55:15.211597 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1561/3027] 10.222.0.47 () {62 vars in 1318 bytes} [Mon Nov 1 01:55:15 2021] POST /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad/action => generated 28614 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 01 01:55:16.223035 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-714d81bf-fb7b-4d79-b94a-42b9bb859754 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:55:16.224516 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-714d81bf-fb7b-4d79-b94a-42b9bb859754 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: 6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:55:16.231356 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-714d81bf-fb7b-4d79-b94a-42b9bb859754 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:55:16.231803 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-714d81bf-fb7b-4d79-b94a-42b9bb859754 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:55:16.232557 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-714d81bf-fb7b-4d79-b94a-42b9bb859754 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:55:16.233002 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-714d81bf-fb7b-4d79-b94a-42b9bb859754 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:55:16.315854 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-714d81bf-fb7b-4d79-b94a-42b9bb859754 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "POST /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad/action" status: 200 len: 28614 microversion: 2.20 time: 0.096804 Nov 01 01:55:16.316465 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1467/3028] 10.222.0.47 () {62 vars in 1318 bytes} [Mon Nov 1 01:55:16 2021] POST /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad/action => generated 28614 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 01 01:55:17.327890 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-e370f97a-742b-447f-ac10-48d1bb8bbf18 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:55:17.328918 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-e370f97a-742b-447f-ac10-48d1bb8bbf18 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: 6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:55:17.335720 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e370f97a-742b-447f-ac10-48d1bb8bbf18 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:55:17.336167 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e370f97a-742b-447f-ac10-48d1bb8bbf18 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:55:17.336919 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e370f97a-742b-447f-ac10-48d1bb8bbf18 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:55:17.337364 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e370f97a-742b-447f-ac10-48d1bb8bbf18 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:55:17.423370 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-e370f97a-742b-447f-ac10-48d1bb8bbf18 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "POST /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad/action" status: 200 len: 28614 microversion: 2.20 time: 0.099403 Nov 01 01:55:17.424006 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1562/3029] 10.222.0.47 () {62 vars in 1318 bytes} [Mon Nov 1 01:55:17 2021] POST /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad/action => generated 28614 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 01 01:55:18.436234 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-e1ed5ee7-9707-44e5-a032-60615819c18d tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:55:18.437220 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-e1ed5ee7-9707-44e5-a032-60615819c18d tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: 6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:55:18.444670 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e1ed5ee7-9707-44e5-a032-60615819c18d tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:55:18.445346 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e1ed5ee7-9707-44e5-a032-60615819c18d tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:55:18.446103 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e1ed5ee7-9707-44e5-a032-60615819c18d tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:55:18.446567 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e1ed5ee7-9707-44e5-a032-60615819c18d tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:55:18.531324 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-e1ed5ee7-9707-44e5-a032-60615819c18d tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "POST /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad/action" status: 200 len: 28614 microversion: 2.20 time: 0.098936 Nov 01 01:55:18.531970 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1468/3030] 10.222.0.47 () {62 vars in 1318 bytes} [Mon Nov 1 01:55:18 2021] POST /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad/action => generated 28614 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 01 01:55:19.546948 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-e404dadb-9c59-4f04-8158-06ceb67326ea tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:55:19.548461 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-e404dadb-9c59-4f04-8158-06ceb67326ea tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: 6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:55:19.558637 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e404dadb-9c59-4f04-8158-06ceb67326ea tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:55:19.559264 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e404dadb-9c59-4f04-8158-06ceb67326ea tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:55:19.560433 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e404dadb-9c59-4f04-8158-06ceb67326ea tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:55:19.561102 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e404dadb-9c59-4f04-8158-06ceb67326ea tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:55:19.644705 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-e404dadb-9c59-4f04-8158-06ceb67326ea tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "POST /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad/action" status: 200 len: 28614 microversion: 2.20 time: 0.104384 Nov 01 01:55:19.645844 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1563/3031] 10.222.0.47 () {62 vars in 1318 bytes} [Mon Nov 1 01:55:19 2021] POST /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad/action => generated 28614 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 01 01:55:20.657037 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-9ba29348-b54e-4af3-8736-e542abf4d0b5 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:55:20.657985 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-9ba29348-b54e-4af3-8736-e542abf4d0b5 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: 6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:55:20.665316 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9ba29348-b54e-4af3-8736-e542abf4d0b5 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:55:20.665765 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9ba29348-b54e-4af3-8736-e542abf4d0b5 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:55:20.666558 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9ba29348-b54e-4af3-8736-e542abf4d0b5 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:55:20.666987 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9ba29348-b54e-4af3-8736-e542abf4d0b5 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:55:20.748582 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-9ba29348-b54e-4af3-8736-e542abf4d0b5 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "POST /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad/action" status: 200 len: 28614 microversion: 2.20 time: 0.095579 Nov 01 01:55:20.749209 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1469/3032] 10.222.0.47 () {62 vars in 1318 bytes} [Mon Nov 1 01:55:20 2021] POST /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad/action => generated 28614 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 01 01:55:21.762479 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-9ad62d95-684b-4ec0-a5cb-2918afdb419b tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:55:21.763484 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-9ad62d95-684b-4ec0-a5cb-2918afdb419b tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: 6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:55:21.771006 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9ad62d95-684b-4ec0-a5cb-2918afdb419b tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:55:21.771457 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9ad62d95-684b-4ec0-a5cb-2918afdb419b tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:55:21.772214 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9ad62d95-684b-4ec0-a5cb-2918afdb419b tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:55:21.772645 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9ad62d95-684b-4ec0-a5cb-2918afdb419b tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:55:21.863126 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-9ad62d95-684b-4ec0-a5cb-2918afdb419b tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "POST /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad/action" status: 200 len: 29377 microversion: 2.20 time: 0.104493 Nov 01 01:55:21.863775 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1564/3033] 10.222.0.47 () {62 vars in 1318 bytes} [Mon Nov 1 01:55:21 2021] POST /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad/action => generated 29377 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 01 01:55:22.875793 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-9c876dea-7936-4a66-a5ee-5d896640e6e4 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:55:22.876825 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-9c876dea-7936-4a66-a5ee-5d896640e6e4 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: 6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:55:22.884185 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9c876dea-7936-4a66-a5ee-5d896640e6e4 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:55:22.884628 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9c876dea-7936-4a66-a5ee-5d896640e6e4 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:55:22.885382 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9c876dea-7936-4a66-a5ee-5d896640e6e4 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:55:22.885810 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9c876dea-7936-4a66-a5ee-5d896640e6e4 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:55:22.975274 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-9c876dea-7936-4a66-a5ee-5d896640e6e4 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "POST /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad/action" status: 200 len: 31686 microversion: 2.20 time: 0.103371 Nov 01 01:55:22.975898 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1470/3034] 10.222.0.47 () {62 vars in 1318 bytes} [Mon Nov 1 01:55:22 2021] POST /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad/action => generated 31686 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 01 01:55:23.987396 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-333047a3-6030-43ae-9591-48e37d7d65ce tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:55:23.988428 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-333047a3-6030-43ae-9591-48e37d7d65ce tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: 6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:55:23.995901 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-333047a3-6030-43ae-9591-48e37d7d65ce tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:55:23.996350 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-333047a3-6030-43ae-9591-48e37d7d65ce tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:55:23.997109 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-333047a3-6030-43ae-9591-48e37d7d65ce tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:55:23.997539 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-333047a3-6030-43ae-9591-48e37d7d65ce tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:55:24.104931 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-333047a3-6030-43ae-9591-48e37d7d65ce tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "POST /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad/action" status: 200 len: 33323 microversion: 2.20 time: 0.121422 Nov 01 01:55:24.105584 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1565/3035] 10.222.0.47 () {62 vars in 1318 bytes} [Mon Nov 1 01:55:23 2021] POST /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad/action => generated 33323 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 01 01:55:25.116850 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-61980675-4300-4a13-89ae-40fc13cfe11c tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:55:25.117862 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-61980675-4300-4a13-89ae-40fc13cfe11c tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: 6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:55:25.124186 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-61980675-4300-4a13-89ae-40fc13cfe11c tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:55:25.124632 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-61980675-4300-4a13-89ae-40fc13cfe11c tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:55:25.125403 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-61980675-4300-4a13-89ae-40fc13cfe11c tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:55:25.125803 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-61980675-4300-4a13-89ae-40fc13cfe11c tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:55:25.216374 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-61980675-4300-4a13-89ae-40fc13cfe11c tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "POST /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad/action" status: 200 len: 34406 microversion: 2.20 time: 0.103354 Nov 01 01:55:25.216913 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1471/3036] 10.222.0.47 () {62 vars in 1318 bytes} [Mon Nov 1 01:55:25 2021] POST /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad/action => generated 34406 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 01 01:55:26.229051 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-28ff4849-867a-44bc-96cc-618c2899795d tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:55:26.230057 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-28ff4849-867a-44bc-96cc-618c2899795d tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: 6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:55:26.236854 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-28ff4849-867a-44bc-96cc-618c2899795d tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:55:26.237300 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-28ff4849-867a-44bc-96cc-618c2899795d tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:55:26.238054 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-28ff4849-867a-44bc-96cc-618c2899795d tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:55:26.238511 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-28ff4849-867a-44bc-96cc-618c2899795d tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:55:26.337771 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-28ff4849-867a-44bc-96cc-618c2899795d tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "POST /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad/action" status: 200 len: 35630 microversion: 2.20 time: 0.112656 Nov 01 01:55:26.338406 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1566/3037] 10.222.0.47 () {62 vars in 1318 bytes} [Mon Nov 1 01:55:26 2021] POST /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad/action => generated 35630 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 01 01:55:27.350266 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-b27b6328-9314-4885-9867-169531ab4a03 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:55:27.351287 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-b27b6328-9314-4885-9867-169531ab4a03 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: 6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:55:27.358143 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b27b6328-9314-4885-9867-169531ab4a03 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:55:27.358626 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b27b6328-9314-4885-9867-169531ab4a03 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:55:27.359384 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b27b6328-9314-4885-9867-169531ab4a03 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:55:27.359812 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b27b6328-9314-4885-9867-169531ab4a03 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:55:27.447057 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-b27b6328-9314-4885-9867-169531ab4a03 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "POST /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad/action" status: 200 len: 37227 microversion: 2.20 time: 0.101336 Nov 01 01:55:27.447706 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1472/3038] 10.222.0.47 () {62 vars in 1318 bytes} [Mon Nov 1 01:55:27 2021] POST /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad/action => generated 37227 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 01 01:55:28.459472 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-e6b79162-5d15-48b2-a211-29947eff82a3 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:55:28.460470 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-e6b79162-5d15-48b2-a211-29947eff82a3 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: 6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:55:28.467268 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e6b79162-5d15-48b2-a211-29947eff82a3 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:55:28.467714 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e6b79162-5d15-48b2-a211-29947eff82a3 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:55:28.468479 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e6b79162-5d15-48b2-a211-29947eff82a3 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:55:28.468896 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e6b79162-5d15-48b2-a211-29947eff82a3 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:55:28.566159 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-e6b79162-5d15-48b2-a211-29947eff82a3 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "POST /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad/action" status: 200 len: 38173 microversion: 2.20 time: 0.110475 Nov 01 01:55:28.566750 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1567/3039] 10.222.0.47 () {62 vars in 1318 bytes} [Mon Nov 1 01:55:28 2021] POST /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad/action => generated 38173 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 01 01:55:29.578359 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-dddc9282-f00c-4875-8198-fc73ecd6c46d tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:55:29.579308 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-dddc9282-f00c-4875-8198-fc73ecd6c46d tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: 6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:55:29.586202 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-dddc9282-f00c-4875-8198-fc73ecd6c46d tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:55:29.586683 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-dddc9282-f00c-4875-8198-fc73ecd6c46d tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:55:29.587472 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-dddc9282-f00c-4875-8198-fc73ecd6c46d tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:55:29.587900 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-dddc9282-f00c-4875-8198-fc73ecd6c46d tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:55:29.668074 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-dddc9282-f00c-4875-8198-fc73ecd6c46d tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "POST /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad/action" status: 200 len: 38173 microversion: 2.20 time: 0.093761 Nov 01 01:55:29.668697 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1473/3040] 10.222.0.47 () {62 vars in 1318 bytes} [Mon Nov 1 01:55:29 2021] POST /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad/action => generated 38173 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 01 01:55:30.680638 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-6ecee7e0-1920-44a9-9a46-9462557c7dda tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:55:30.681643 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-6ecee7e0-1920-44a9-9a46-9462557c7dda tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: 6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:55:30.688471 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-6ecee7e0-1920-44a9-9a46-9462557c7dda tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:55:30.688924 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-6ecee7e0-1920-44a9-9a46-9462557c7dda tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:55:30.689677 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-6ecee7e0-1920-44a9-9a46-9462557c7dda tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:55:30.690113 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-6ecee7e0-1920-44a9-9a46-9462557c7dda tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:55:30.771559 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-6ecee7e0-1920-44a9-9a46-9462557c7dda tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "POST /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad/action" status: 200 len: 38173 microversion: 2.20 time: 0.095034 Nov 01 01:55:30.772209 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1568/3041] 10.222.0.47 () {62 vars in 1318 bytes} [Mon Nov 1 01:55:30 2021] POST /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad/action => generated 38173 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 01 01:55:31.783847 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-82f75f1c-fa68-47b1-b823-b3cbdf3300b2 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:55:31.784843 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-82f75f1c-fa68-47b1-b823-b3cbdf3300b2 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: 6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:55:31.792300 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-82f75f1c-fa68-47b1-b823-b3cbdf3300b2 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:55:31.792740 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-82f75f1c-fa68-47b1-b823-b3cbdf3300b2 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:55:31.793498 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-82f75f1c-fa68-47b1-b823-b3cbdf3300b2 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:55:31.793925 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-82f75f1c-fa68-47b1-b823-b3cbdf3300b2 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:55:31.882088 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-82f75f1c-fa68-47b1-b823-b3cbdf3300b2 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "POST /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad/action" status: 200 len: 38173 microversion: 2.20 time: 0.102146 Nov 01 01:55:31.882984 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1474/3042] 10.222.0.47 () {62 vars in 1318 bytes} [Mon Nov 1 01:55:31 2021] POST /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad/action => generated 38173 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 01 01:55:32.894488 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-48a658b9-27e6-49f3-af42-3a559f0f73bb tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:55:32.895572 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-48a658b9-27e6-49f3-af42-3a559f0f73bb tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: 6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:55:32.902340 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-48a658b9-27e6-49f3-af42-3a559f0f73bb tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:55:32.902816 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-48a658b9-27e6-49f3-af42-3a559f0f73bb tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:55:32.903575 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-48a658b9-27e6-49f3-af42-3a559f0f73bb tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:55:32.904003 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-48a658b9-27e6-49f3-af42-3a559f0f73bb tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:55:32.992134 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-48a658b9-27e6-49f3-af42-3a559f0f73bb tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "POST /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad/action" status: 200 len: 38316 microversion: 2.20 time: 0.101650 Nov 01 01:55:32.993094 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1569/3043] 10.222.0.47 () {62 vars in 1318 bytes} [Mon Nov 1 01:55:32 2021] POST /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad/action => generated 38316 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 01 01:55:33.002800 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-4c8fed59-a67a-46c7-bcac-d511f4d57e35 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:55:33.003378 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-4c8fed59-a67a-46c7-bcac-d511f4d57e35 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: 6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:55:33.010178 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4c8fed59-a67a-46c7-bcac-d511f4d57e35 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:55:33.010600 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4c8fed59-a67a-46c7-bcac-d511f4d57e35 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:55:33.011392 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4c8fed59-a67a-46c7-bcac-d511f4d57e35 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:55:33.011817 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4c8fed59-a67a-46c7-bcac-d511f4d57e35 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:55:33.034859 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-4c8fed59-a67a-46c7-bcac-d511f4d57e35 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "GET /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad/ips" status: 200 len: 152 microversion: 2.20 time: 0.036010 Nov 01 01:55:33.035421 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1475/3044] 10.222.0.47 () {60 vars in 1288 bytes} [Mon Nov 1 01:55:32 2021] GET /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad/ips => generated 152 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 01 01:55:35.483161 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-9c9261c2-c217-4ea2-b98a-e99389f72b71 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:55:35.483781 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-9c9261c2-c217-4ea2-b98a-e99389f72b71 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: 6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:55:35.490621 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9c9261c2-c217-4ea2-b98a-e99389f72b71 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:55:35.491065 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9c9261c2-c217-4ea2-b98a-e99389f72b71 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:55:35.491814 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9c9261c2-c217-4ea2-b98a-e99389f72b71 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:55:35.492243 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9c9261c2-c217-4ea2-b98a-e99389f72b71 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:55:35.514814 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.objects.instance [None req-9c9261c2-c217-4ea2-b98a-e99389f72b71 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lazy-loading 'flavor' on Instance uuid 6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad {{(pid=116267) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 01 01:55:36.021583 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-9c9261c2-c217-4ea2-b98a-e99389f72b71 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "POST /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad/action" status: 202 len: 0 microversion: 2.20 time: 0.542475 Nov 01 01:55:36.022293 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1570/3045] 10.222.0.47 () {62 vars in 1318 bytes} [Mon Nov 1 01:55:35 2021] POST /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad/action => generated 0 bytes in 544 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 01 01:55:36.030104 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-a127b12f-73f4-4b10-9452-f2ba3532ec72 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:55:36.030738 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-a127b12f-73f4-4b10-9452-f2ba3532ec72 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: 6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:55:36.037178 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a127b12f-73f4-4b10-9452-f2ba3532ec72 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:55:36.037619 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a127b12f-73f4-4b10-9452-f2ba3532ec72 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:55:36.038383 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a127b12f-73f4-4b10-9452-f2ba3532ec72 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:55:36.038842 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a127b12f-73f4-4b10-9452-f2ba3532ec72 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:55:36.158692 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-a127b12f-73f4-4b10-9452-f2ba3532ec72 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:55:36.166719 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-a127b12f-73f4-4b10-9452-f2ba3532ec72 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:55:36.168289 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-a127b12f-73f4-4b10-9452-f2ba3532ec72 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:55:36.169452 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-a127b12f-73f4-4b10-9452-f2ba3532ec72 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "GET /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad" status: 200 len: 1724 microversion: 2.20 time: 0.143089 Nov 01 01:55:36.170003 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1476/3046] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Nov 1 01:55:36 2021] GET /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad => generated 1724 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 01:55:37.189345 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-9771f91d-68cb-449d-bd62-72f4038e98b1 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:55:37.190040 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-9771f91d-68cb-449d-bd62-72f4038e98b1 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: 6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:55:37.197549 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9771f91d-68cb-449d-bd62-72f4038e98b1 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:55:37.197998 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9771f91d-68cb-449d-bd62-72f4038e98b1 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:55:37.198788 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9771f91d-68cb-449d-bd62-72f4038e98b1 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:55:37.199218 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9771f91d-68cb-449d-bd62-72f4038e98b1 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:55:37.322090 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-9771f91d-68cb-449d-bd62-72f4038e98b1 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:55:37.329739 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-9771f91d-68cb-449d-bd62-72f4038e98b1 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:55:37.331258 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-9771f91d-68cb-449d-bd62-72f4038e98b1 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:55:37.332448 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-9771f91d-68cb-449d-bd62-72f4038e98b1 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "GET /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad" status: 200 len: 1724 microversion: 2.20 time: 0.147665 Nov 01 01:55:37.333324 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1571/3047] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Nov 1 01:55:37 2021] GET /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad => generated 1724 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 01 01:55:38.352681 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-84a25ceb-6a4c-46b1-812d-dc30de2605e5 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:55:38.353254 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-84a25ceb-6a4c-46b1-812d-dc30de2605e5 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: 6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:55:38.359520 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-84a25ceb-6a4c-46b1-812d-dc30de2605e5 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:55:38.359964 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-84a25ceb-6a4c-46b1-812d-dc30de2605e5 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:55:38.360713 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-84a25ceb-6a4c-46b1-812d-dc30de2605e5 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:55:38.361142 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-84a25ceb-6a4c-46b1-812d-dc30de2605e5 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:55:38.478301 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-84a25ceb-6a4c-46b1-812d-dc30de2605e5 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:55:38.485858 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-84a25ceb-6a4c-46b1-812d-dc30de2605e5 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:55:38.487403 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-84a25ceb-6a4c-46b1-812d-dc30de2605e5 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:55:38.488540 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-84a25ceb-6a4c-46b1-812d-dc30de2605e5 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "GET /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad" status: 200 len: 1724 microversion: 2.20 time: 0.140190 Nov 01 01:55:38.489090 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1477/3048] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Nov 1 01:55:38 2021] GET /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad => generated 1724 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 01:55:39.506589 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-0f117c82-bd4f-4574-a9b1-fe5ef86f5f90 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:55:39.507192 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-0f117c82-bd4f-4574-a9b1-fe5ef86f5f90 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: 6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:55:39.513501 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0f117c82-bd4f-4574-a9b1-fe5ef86f5f90 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:55:39.513943 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0f117c82-bd4f-4574-a9b1-fe5ef86f5f90 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:55:39.514728 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0f117c82-bd4f-4574-a9b1-fe5ef86f5f90 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:55:39.515161 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0f117c82-bd4f-4574-a9b1-fe5ef86f5f90 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:55:39.632288 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-0f117c82-bd4f-4574-a9b1-fe5ef86f5f90 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:55:39.639903 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-0f117c82-bd4f-4574-a9b1-fe5ef86f5f90 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:55:39.641408 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-0f117c82-bd4f-4574-a9b1-fe5ef86f5f90 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:55:39.642589 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-0f117c82-bd4f-4574-a9b1-fe5ef86f5f90 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "GET /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad" status: 200 len: 1724 microversion: 2.20 time: 0.139793 Nov 01 01:55:39.643147 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1572/3049] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Nov 1 01:55:39 2021] GET /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad => generated 1724 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 01:55:40.660410 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-4aff70e8-6734-4191-9488-751a3ebf84cb tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:55:40.661030 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-4aff70e8-6734-4191-9488-751a3ebf84cb tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: 6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:55:40.667220 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4aff70e8-6734-4191-9488-751a3ebf84cb tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:55:40.667664 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4aff70e8-6734-4191-9488-751a3ebf84cb tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:55:40.668420 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4aff70e8-6734-4191-9488-751a3ebf84cb tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:55:40.668851 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4aff70e8-6734-4191-9488-751a3ebf84cb tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:55:40.789830 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-4aff70e8-6734-4191-9488-751a3ebf84cb tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:55:40.797475 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-4aff70e8-6734-4191-9488-751a3ebf84cb tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:55:40.799068 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-4aff70e8-6734-4191-9488-751a3ebf84cb tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:55:40.800248 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-4aff70e8-6734-4191-9488-751a3ebf84cb tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "GET /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad" status: 200 len: 1724 microversion: 2.20 time: 0.143673 Nov 01 01:55:40.800752 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1478/3050] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Nov 1 01:55:40 2021] GET /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad => generated 1724 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 01:55:41.819857 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-95a9c2cb-c27b-44f4-9e97-e8a3ce2d91f4 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:55:41.820394 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-95a9c2cb-c27b-44f4-9e97-e8a3ce2d91f4 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: 6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:55:41.826645 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-95a9c2cb-c27b-44f4-9e97-e8a3ce2d91f4 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:55:41.827088 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-95a9c2cb-c27b-44f4-9e97-e8a3ce2d91f4 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:55:41.827845 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-95a9c2cb-c27b-44f4-9e97-e8a3ce2d91f4 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:55:41.828269 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-95a9c2cb-c27b-44f4-9e97-e8a3ce2d91f4 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:55:41.947466 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-95a9c2cb-c27b-44f4-9e97-e8a3ce2d91f4 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:55:41.955954 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-95a9c2cb-c27b-44f4-9e97-e8a3ce2d91f4 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:55:41.957453 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-95a9c2cb-c27b-44f4-9e97-e8a3ce2d91f4 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:55:41.959223 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-95a9c2cb-c27b-44f4-9e97-e8a3ce2d91f4 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "GET /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad" status: 200 len: 1724 microversion: 2.20 time: 0.143620 Nov 01 01:55:41.959779 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1573/3051] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Nov 1 01:55:41 2021] GET /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad => generated 1724 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 01:55:42.977251 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-a51add77-85e5-4a94-a3ee-64c0f8ba96a5 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:55:42.977847 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-a51add77-85e5-4a94-a3ee-64c0f8ba96a5 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: 6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:55:42.983995 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a51add77-85e5-4a94-a3ee-64c0f8ba96a5 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:55:42.984431 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a51add77-85e5-4a94-a3ee-64c0f8ba96a5 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:55:42.985173 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a51add77-85e5-4a94-a3ee-64c0f8ba96a5 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:55:42.985594 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a51add77-85e5-4a94-a3ee-64c0f8ba96a5 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:55:43.104677 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-a51add77-85e5-4a94-a3ee-64c0f8ba96a5 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:55:43.112242 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-a51add77-85e5-4a94-a3ee-64c0f8ba96a5 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:55:43.113726 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-a51add77-85e5-4a94-a3ee-64c0f8ba96a5 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:55:43.114882 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-a51add77-85e5-4a94-a3ee-64c0f8ba96a5 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "GET /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad" status: 200 len: 1724 microversion: 2.20 time: 0.141921 Nov 01 01:55:43.115662 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1479/3052] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Nov 1 01:55:42 2021] GET /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad => generated 1724 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 01:55:44.132706 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-80e7447b-7d9c-47c5-a228-e40143f962a2 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:55:44.133359 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-80e7447b-7d9c-47c5-a228-e40143f962a2 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: 6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:55:44.139784 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-80e7447b-7d9c-47c5-a228-e40143f962a2 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:55:44.140229 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-80e7447b-7d9c-47c5-a228-e40143f962a2 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:55:44.140986 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-80e7447b-7d9c-47c5-a228-e40143f962a2 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:55:44.141415 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-80e7447b-7d9c-47c5-a228-e40143f962a2 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:55:44.268442 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-80e7447b-7d9c-47c5-a228-e40143f962a2 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:55:44.276619 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-80e7447b-7d9c-47c5-a228-e40143f962a2 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:55:44.278118 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-80e7447b-7d9c-47c5-a228-e40143f962a2 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:55:44.279311 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-80e7447b-7d9c-47c5-a228-e40143f962a2 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "GET /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad" status: 200 len: 1724 microversion: 2.20 time: 0.150356 Nov 01 01:55:44.279867 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1574/3053] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Nov 1 01:55:44 2021] GET /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 01:55:45.297024 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-5a418d41-1492-4ddd-8552-3743d7df1455 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:55:45.297572 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-5a418d41-1492-4ddd-8552-3743d7df1455 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: 6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:55:45.304589 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5a418d41-1492-4ddd-8552-3743d7df1455 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:55:45.305037 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5a418d41-1492-4ddd-8552-3743d7df1455 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:55:45.305801 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5a418d41-1492-4ddd-8552-3743d7df1455 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:55:45.306229 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5a418d41-1492-4ddd-8552-3743d7df1455 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:55:45.432046 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-5a418d41-1492-4ddd-8552-3743d7df1455 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:55:45.435866 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-5a418d41-1492-4ddd-8552-3743d7df1455 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:55:45.437346 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-5a418d41-1492-4ddd-8552-3743d7df1455 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:55:45.438517 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-5a418d41-1492-4ddd-8552-3743d7df1455 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "GET /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad" status: 200 len: 1724 microversion: 2.20 time: 0.145349 Nov 01 01:55:45.439068 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1480/3054] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Nov 1 01:55:45 2021] GET /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad => generated 1724 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 01:55:46.455584 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-ccf8e074-63b6-4103-87e8-d2b536062e7b tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:55:46.456226 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-ccf8e074-63b6-4103-87e8-d2b536062e7b tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: 6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:55:46.462437 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ccf8e074-63b6-4103-87e8-d2b536062e7b tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:55:46.462927 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ccf8e074-63b6-4103-87e8-d2b536062e7b tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:55:46.463685 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ccf8e074-63b6-4103-87e8-d2b536062e7b tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:55:46.464252 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ccf8e074-63b6-4103-87e8-d2b536062e7b tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:55:46.581826 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-ccf8e074-63b6-4103-87e8-d2b536062e7b tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:55:46.589957 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-ccf8e074-63b6-4103-87e8-d2b536062e7b tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:55:46.591487 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-ccf8e074-63b6-4103-87e8-d2b536062e7b tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:55:46.592627 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-ccf8e074-63b6-4103-87e8-d2b536062e7b tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "GET /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad" status: 200 len: 1724 microversion: 2.20 time: 0.140798 Nov 01 01:55:46.593188 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1575/3055] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Nov 1 01:55:46 2021] GET /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad => generated 1724 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 01:55:47.610850 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-8092837b-dc78-499a-ab8d-6356a48b3475 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:55:47.611446 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-8092837b-dc78-499a-ab8d-6356a48b3475 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: 6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:55:47.618127 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8092837b-dc78-499a-ab8d-6356a48b3475 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:55:47.618538 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8092837b-dc78-499a-ab8d-6356a48b3475 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:55:47.619280 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8092837b-dc78-499a-ab8d-6356a48b3475 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:55:47.619703 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8092837b-dc78-499a-ab8d-6356a48b3475 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:55:47.745183 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-8092837b-dc78-499a-ab8d-6356a48b3475 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:55:47.753839 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-8092837b-dc78-499a-ab8d-6356a48b3475 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:55:47.755386 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-8092837b-dc78-499a-ab8d-6356a48b3475 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:55:47.756541 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-8092837b-dc78-499a-ab8d-6356a48b3475 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "GET /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad" status: 200 len: 1724 microversion: 2.20 time: 0.149389 Nov 01 01:55:47.757103 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1481/3056] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Nov 1 01:55:47 2021] GET /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 01 01:55:48.775026 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-f6bad879-dc6c-413e-b521-06c99b9fb4e4 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:55:48.775631 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-f6bad879-dc6c-413e-b521-06c99b9fb4e4 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: 6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:55:48.781721 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f6bad879-dc6c-413e-b521-06c99b9fb4e4 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:55:48.782160 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f6bad879-dc6c-413e-b521-06c99b9fb4e4 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:55:48.782950 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f6bad879-dc6c-413e-b521-06c99b9fb4e4 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:55:48.783381 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f6bad879-dc6c-413e-b521-06c99b9fb4e4 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:55:48.900238 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-f6bad879-dc6c-413e-b521-06c99b9fb4e4 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:55:48.907779 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-f6bad879-dc6c-413e-b521-06c99b9fb4e4 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:55:48.909268 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-f6bad879-dc6c-413e-b521-06c99b9fb4e4 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:55:48.910409 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-f6bad879-dc6c-413e-b521-06c99b9fb4e4 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "GET /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad" status: 200 len: 1745 microversion: 2.20 time: 0.139123 Nov 01 01:55:48.911647 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1576/3057] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Nov 1 01:55:48 2021] GET /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad => generated 1745 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 01:55:49.930015 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-069859f7-299d-4e91-8f90-83cc20907d24 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:55:49.930642 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-069859f7-299d-4e91-8f90-83cc20907d24 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: 6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:55:49.937008 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-069859f7-299d-4e91-8f90-83cc20907d24 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:55:49.937447 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-069859f7-299d-4e91-8f90-83cc20907d24 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:55:49.938197 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-069859f7-299d-4e91-8f90-83cc20907d24 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:55:49.938656 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-069859f7-299d-4e91-8f90-83cc20907d24 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:55:50.059453 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-069859f7-299d-4e91-8f90-83cc20907d24 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:55:50.067459 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-069859f7-299d-4e91-8f90-83cc20907d24 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:55:50.069026 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-069859f7-299d-4e91-8f90-83cc20907d24 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:55:50.070175 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-069859f7-299d-4e91-8f90-83cc20907d24 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "GET /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad" status: 200 len: 1745 microversion: 2.20 time: 0.144666 Nov 01 01:55:50.070759 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1482/3058] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Nov 1 01:55:49 2021] GET /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad => generated 1745 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 01:55:50.336445 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [req-09e16024-ec7e-4b0a-b81f-5f16cf6c0f5a req-5480afae-885b-4ede-bd41-1e1d17f5b94c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad", "name": "network-vif-plugged", "status": "completed", "tag": "0d980dc6-46c5-489a-a08f-baa507ecfcdd"}]} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:55:50.338059 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 01 01:55:50.338059 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: warnings.warn(msg) Nov 01 01:55:50.345501 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [req-09e16024-ec7e-4b0a-b81f-5f16cf6c0f5a req-5480afae-885b-4ede-bd41-1e1d17f5b94c service nova] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:55:50.345948 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [req-09e16024-ec7e-4b0a-b81f-5f16cf6c0f5a req-5480afae-885b-4ede-bd41-1e1d17f5b94c service nova] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:55:50.357545 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.compute.server_external_events [req-09e16024-ec7e-4b0a-b81f-5f16cf6c0f5a req-5480afae-885b-4ede-bd41-1e1d17f5b94c service nova] Creating event network-vif-plugged:0d980dc6-46c5-489a-a08f-baa507ecfcdd for instance 6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad on hv-cinder-81561 Nov 01 01:55:50.362934 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [req-09e16024-ec7e-4b0a-b81f-5f16cf6c0f5a req-5480afae-885b-4ede-bd41-1e1d17f5b94c service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030513 Nov 01 01:55:50.364868 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1577/3059] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Nov 1 01:55:50 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:55:51.087307 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-9f87621a-8fb1-4ce0-8d63-e2dc96edc33c tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:55:51.087905 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-9f87621a-8fb1-4ce0-8d63-e2dc96edc33c tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: 6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:55:51.094098 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9f87621a-8fb1-4ce0-8d63-e2dc96edc33c tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:55:51.094597 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9f87621a-8fb1-4ce0-8d63-e2dc96edc33c tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:55:51.095347 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9f87621a-8fb1-4ce0-8d63-e2dc96edc33c tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:55:51.095768 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9f87621a-8fb1-4ce0-8d63-e2dc96edc33c tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:55:51.215734 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-9f87621a-8fb1-4ce0-8d63-e2dc96edc33c tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:55:51.223334 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-9f87621a-8fb1-4ce0-8d63-e2dc96edc33c tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:55:51.224834 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-9f87621a-8fb1-4ce0-8d63-e2dc96edc33c tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:55:51.225974 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-9f87621a-8fb1-4ce0-8d63-e2dc96edc33c tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "GET /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad" status: 200 len: 1745 microversion: 2.20 time: 0.142357 Nov 01 01:55:51.226621 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1483/3060] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Nov 1 01:55:51 2021] GET /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad => generated 1745 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 01 01:55:52.244955 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-87e65a60-84c3-4732-97e8-8b81b5f41ad7 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:55:52.245754 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-87e65a60-84c3-4732-97e8-8b81b5f41ad7 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: 6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:55:52.251741 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-87e65a60-84c3-4732-97e8-8b81b5f41ad7 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:55:52.252177 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-87e65a60-84c3-4732-97e8-8b81b5f41ad7 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:55:52.252924 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-87e65a60-84c3-4732-97e8-8b81b5f41ad7 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:55:52.253349 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-87e65a60-84c3-4732-97e8-8b81b5f41ad7 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:55:52.386589 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-87e65a60-84c3-4732-97e8-8b81b5f41ad7 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:55:52.394216 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-87e65a60-84c3-4732-97e8-8b81b5f41ad7 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:55:52.395826 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-87e65a60-84c3-4732-97e8-8b81b5f41ad7 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:55:52.396969 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-87e65a60-84c3-4732-97e8-8b81b5f41ad7 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "GET /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad" status: 200 len: 1745 microversion: 2.20 time: 0.156530 Nov 01 01:55:52.398178 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1578/3061] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Nov 1 01:55:52 2021] GET /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad => generated 1745 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 01:55:53.416016 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-fd8bbd40-a120-48c6-9afc-410213595142 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:55:53.416724 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-fd8bbd40-a120-48c6-9afc-410213595142 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: 6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:55:53.423047 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-fd8bbd40-a120-48c6-9afc-410213595142 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:55:53.423508 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-fd8bbd40-a120-48c6-9afc-410213595142 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:55:53.424298 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-fd8bbd40-a120-48c6-9afc-410213595142 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:55:53.424727 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-fd8bbd40-a120-48c6-9afc-410213595142 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:55:53.548649 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-fd8bbd40-a120-48c6-9afc-410213595142 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:55:53.557250 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-fd8bbd40-a120-48c6-9afc-410213595142 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:55:53.558801 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-fd8bbd40-a120-48c6-9afc-410213595142 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:55:53.559987 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-fd8bbd40-a120-48c6-9afc-410213595142 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "GET /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad" status: 200 len: 1740 microversion: 2.20 time: 0.147757 Nov 01 01:55:53.560768 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1484/3062] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Nov 1 01:55:53 2021] GET /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad => generated 1740 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 01 01:55:54.579289 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-66a2c405-6734-4dc6-8f11-2e48f07b7224 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:55:54.580793 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-66a2c405-6734-4dc6-8f11-2e48f07b7224 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: 6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:55:54.588539 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-66a2c405-6734-4dc6-8f11-2e48f07b7224 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:55:54.589293 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-66a2c405-6734-4dc6-8f11-2e48f07b7224 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:55:54.590464 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-66a2c405-6734-4dc6-8f11-2e48f07b7224 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:55:54.591299 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-66a2c405-6734-4dc6-8f11-2e48f07b7224 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:55:54.739434 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-66a2c405-6734-4dc6-8f11-2e48f07b7224 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:55:54.748349 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-66a2c405-6734-4dc6-8f11-2e48f07b7224 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:55:54.750251 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-66a2c405-6734-4dc6-8f11-2e48f07b7224 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:55:54.751482 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-66a2c405-6734-4dc6-8f11-2e48f07b7224 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "GET /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad" status: 200 len: 1740 microversion: 2.20 time: 0.176264 Nov 01 01:55:54.752037 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1579/3063] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Nov 1 01:55:54 2021] GET /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad => generated 1740 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 01:55:55.770104 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-64a9e17e-1284-4ebf-9e81-f7a1f4d69f1a tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:55:55.770734 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-64a9e17e-1284-4ebf-9e81-f7a1f4d69f1a tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: 6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:55:55.777564 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-64a9e17e-1284-4ebf-9e81-f7a1f4d69f1a tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:55:55.778274 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-64a9e17e-1284-4ebf-9e81-f7a1f4d69f1a tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:55:55.779082 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-64a9e17e-1284-4ebf-9e81-f7a1f4d69f1a tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:55:55.779737 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-64a9e17e-1284-4ebf-9e81-f7a1f4d69f1a tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:55:55.905088 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-64a9e17e-1284-4ebf-9e81-f7a1f4d69f1a tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:55:55.912949 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-64a9e17e-1284-4ebf-9e81-f7a1f4d69f1a tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:55:55.914681 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-64a9e17e-1284-4ebf-9e81-f7a1f4d69f1a tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:55:55.916159 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-64a9e17e-1284-4ebf-9e81-f7a1f4d69f1a tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "GET /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad" status: 200 len: 1740 microversion: 2.20 time: 0.149726 Nov 01 01:55:55.916790 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1485/3064] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Nov 1 01:55:55 2021] GET /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad => generated 1740 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 01:55:56.934729 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-3b053c4f-6c1d-4057-a7b0-5d47222b0997 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:55:56.935359 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-3b053c4f-6c1d-4057-a7b0-5d47222b0997 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: 6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:55:56.941609 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3b053c4f-6c1d-4057-a7b0-5d47222b0997 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:55:56.942053 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3b053c4f-6c1d-4057-a7b0-5d47222b0997 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:55:56.942840 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3b053c4f-6c1d-4057-a7b0-5d47222b0997 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:55:56.943265 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3b053c4f-6c1d-4057-a7b0-5d47222b0997 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:55:57.066234 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-3b053c4f-6c1d-4057-a7b0-5d47222b0997 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:55:57.073971 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-3b053c4f-6c1d-4057-a7b0-5d47222b0997 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:55:57.075512 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-3b053c4f-6c1d-4057-a7b0-5d47222b0997 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:55:57.076720 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-3b053c4f-6c1d-4057-a7b0-5d47222b0997 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "GET /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad" status: 200 len: 1740 microversion: 2.20 time: 0.145731 Nov 01 01:55:57.077279 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1580/3065] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Nov 1 01:55:56 2021] GET /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad => generated 1740 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 01:55:58.096337 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-26768567-039f-4c33-89f6-fd4fb5de6271 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:55:58.097179 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-26768567-039f-4c33-89f6-fd4fb5de6271 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: 6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:55:58.104077 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-26768567-039f-4c33-89f6-fd4fb5de6271 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:55:58.106503 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-26768567-039f-4c33-89f6-fd4fb5de6271 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:55:58.107524 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-26768567-039f-4c33-89f6-fd4fb5de6271 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:55:58.108130 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-26768567-039f-4c33-89f6-fd4fb5de6271 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:55:58.240268 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-26768567-039f-4c33-89f6-fd4fb5de6271 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:55:58.248425 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-26768567-039f-4c33-89f6-fd4fb5de6271 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:55:58.250122 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-26768567-039f-4c33-89f6-fd4fb5de6271 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:55:58.251384 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-26768567-039f-4c33-89f6-fd4fb5de6271 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "GET /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad" status: 200 len: 1740 microversion: 2.20 time: 0.159754 Nov 01 01:55:58.252012 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1486/3066] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Nov 1 01:55:58 2021] GET /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad => generated 1740 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 01 01:55:59.270217 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-c79153a7-5d40-40ad-bf16-273a966ec40a tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:55:59.270777 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-c79153a7-5d40-40ad-bf16-273a966ec40a tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: 6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:55:59.280265 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c79153a7-5d40-40ad-bf16-273a966ec40a tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:55:59.280814 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c79153a7-5d40-40ad-bf16-273a966ec40a tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:55:59.281588 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c79153a7-5d40-40ad-bf16-273a966ec40a tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:55:59.282020 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c79153a7-5d40-40ad-bf16-273a966ec40a tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:55:59.416622 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-c79153a7-5d40-40ad-bf16-273a966ec40a tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:55:59.429305 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-c79153a7-5d40-40ad-bf16-273a966ec40a tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:55:59.431023 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-c79153a7-5d40-40ad-bf16-273a966ec40a tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:55:59.432256 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-c79153a7-5d40-40ad-bf16-273a966ec40a tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "GET /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad" status: 200 len: 1740 microversion: 2.20 time: 0.165868 Nov 01 01:55:59.434975 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1581/3067] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Nov 1 01:55:59 2021] GET /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad => generated 1740 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 01:56:00.454744 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-66ab27de-52f6-4d28-b6ac-847e50871e9f tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:56:00.455521 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-66ab27de-52f6-4d28-b6ac-847e50871e9f tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: 6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:56:00.462736 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-66ab27de-52f6-4d28-b6ac-847e50871e9f tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:56:00.463499 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-66ab27de-52f6-4d28-b6ac-847e50871e9f tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:56:00.464509 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-66ab27de-52f6-4d28-b6ac-847e50871e9f tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:56:00.464942 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-66ab27de-52f6-4d28-b6ac-847e50871e9f tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:56:00.601204 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-66ab27de-52f6-4d28-b6ac-847e50871e9f tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:56:00.609795 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-66ab27de-52f6-4d28-b6ac-847e50871e9f tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:56:00.611707 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-66ab27de-52f6-4d28-b6ac-847e50871e9f tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:56:00.613125 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-66ab27de-52f6-4d28-b6ac-847e50871e9f tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "GET /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad" status: 200 len: 1740 microversion: 2.20 time: 0.162195 Nov 01 01:56:00.613680 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1487/3068] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Nov 1 01:56:00 2021] GET /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad => generated 1740 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 01:56:01.631397 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-6bb4ff51-b328-45fe-a46b-ce0c5df35843 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:56:01.632012 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-6bb4ff51-b328-45fe-a46b-ce0c5df35843 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: 6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:56:01.638474 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-6bb4ff51-b328-45fe-a46b-ce0c5df35843 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:56:01.639378 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-6bb4ff51-b328-45fe-a46b-ce0c5df35843 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:56:01.639677 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-6bb4ff51-b328-45fe-a46b-ce0c5df35843 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:56:01.640106 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-6bb4ff51-b328-45fe-a46b-ce0c5df35843 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:56:01.790148 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-6bb4ff51-b328-45fe-a46b-ce0c5df35843 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:56:01.799361 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-6bb4ff51-b328-45fe-a46b-ce0c5df35843 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:56:01.801258 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-6bb4ff51-b328-45fe-a46b-ce0c5df35843 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:56:01.802958 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-6bb4ff51-b328-45fe-a46b-ce0c5df35843 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "GET /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad" status: 200 len: 1740 microversion: 2.20 time: 0.175273 Nov 01 01:56:01.813905 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1582/3069] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Nov 1 01:56:01 2021] GET /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad => generated 1740 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 01:56:02.822651 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-beba56ff-4ccb-424d-8133-7b44a1e99f91 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:56:02.823261 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-beba56ff-4ccb-424d-8133-7b44a1e99f91 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: 6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:56:02.832516 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-beba56ff-4ccb-424d-8133-7b44a1e99f91 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:56:02.832516 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-beba56ff-4ccb-424d-8133-7b44a1e99f91 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:56:02.832516 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-beba56ff-4ccb-424d-8133-7b44a1e99f91 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:56:02.832516 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-beba56ff-4ccb-424d-8133-7b44a1e99f91 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:56:02.967457 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-beba56ff-4ccb-424d-8133-7b44a1e99f91 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:56:02.975428 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-beba56ff-4ccb-424d-8133-7b44a1e99f91 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:56:02.976992 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-beba56ff-4ccb-424d-8133-7b44a1e99f91 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:56:02.978159 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-beba56ff-4ccb-424d-8133-7b44a1e99f91 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "GET /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad" status: 200 len: 1740 microversion: 2.20 time: 0.160895 Nov 01 01:56:02.978754 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1488/3070] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Nov 1 01:56:02 2021] GET /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad => generated 1740 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 01:56:03.997747 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-61b6caba-f6ff-4b94-ba06-17d6c61afb2a tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:56:03.998395 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-61b6caba-f6ff-4b94-ba06-17d6c61afb2a tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: 6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:56:04.005893 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-61b6caba-f6ff-4b94-ba06-17d6c61afb2a tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:56:04.006441 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-61b6caba-f6ff-4b94-ba06-17d6c61afb2a tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:56:04.007330 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-61b6caba-f6ff-4b94-ba06-17d6c61afb2a tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:56:04.009481 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-61b6caba-f6ff-4b94-ba06-17d6c61afb2a tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:56:04.132443 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-61b6caba-f6ff-4b94-ba06-17d6c61afb2a tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:56:04.140453 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-61b6caba-f6ff-4b94-ba06-17d6c61afb2a tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:56:04.141986 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-61b6caba-f6ff-4b94-ba06-17d6c61afb2a tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:56:04.143193 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-61b6caba-f6ff-4b94-ba06-17d6c61afb2a tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "GET /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad" status: 200 len: 1740 microversion: 2.20 time: 0.149821 Nov 01 01:56:04.143764 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1583/3071] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Nov 1 01:56:03 2021] GET /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad => generated 1740 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 01:56:05.161006 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-8b04c433-51dc-42e0-b43f-94d88596d073 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:56:05.161548 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-8b04c433-51dc-42e0-b43f-94d88596d073 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: 6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:56:05.168013 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8b04c433-51dc-42e0-b43f-94d88596d073 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:56:05.168455 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8b04c433-51dc-42e0-b43f-94d88596d073 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:56:05.169208 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8b04c433-51dc-42e0-b43f-94d88596d073 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:56:05.169632 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8b04c433-51dc-42e0-b43f-94d88596d073 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:56:05.295230 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-8b04c433-51dc-42e0-b43f-94d88596d073 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:56:05.303122 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-8b04c433-51dc-42e0-b43f-94d88596d073 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:56:05.305098 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-8b04c433-51dc-42e0-b43f-94d88596d073 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:56:05.306239 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-8b04c433-51dc-42e0-b43f-94d88596d073 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "GET /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad" status: 200 len: 1740 microversion: 2.20 time: 0.149080 Nov 01 01:56:05.306890 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1489/3072] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Nov 1 01:56:05 2021] GET /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad => generated 1740 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 01:56:06.324365 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-9b0ceda3-6d55-4ba6-a7fd-14cb26c2aeb8 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:56:06.324980 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-9b0ceda3-6d55-4ba6-a7fd-14cb26c2aeb8 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: 6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:56:06.331246 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9b0ceda3-6d55-4ba6-a7fd-14cb26c2aeb8 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:56:06.331700 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9b0ceda3-6d55-4ba6-a7fd-14cb26c2aeb8 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:56:06.332466 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9b0ceda3-6d55-4ba6-a7fd-14cb26c2aeb8 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:56:06.332906 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9b0ceda3-6d55-4ba6-a7fd-14cb26c2aeb8 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:56:06.454303 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-9b0ceda3-6d55-4ba6-a7fd-14cb26c2aeb8 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:56:06.462085 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-9b0ceda3-6d55-4ba6-a7fd-14cb26c2aeb8 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:56:06.463661 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-9b0ceda3-6d55-4ba6-a7fd-14cb26c2aeb8 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:56:06.464799 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-9b0ceda3-6d55-4ba6-a7fd-14cb26c2aeb8 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "GET /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad" status: 200 len: 1722 microversion: 2.20 time: 0.144186 Nov 01 01:56:06.465346 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1584/3073] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Nov 1 01:56:06 2021] GET /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad => generated 1722 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 01:56:07.482895 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-a31a26c2-9e9c-46eb-9c75-9fdb7567bb17 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:56:07.483495 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-a31a26c2-9e9c-46eb-9c75-9fdb7567bb17 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: 6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:56:07.490292 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a31a26c2-9e9c-46eb-9c75-9fdb7567bb17 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:56:07.490827 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a31a26c2-9e9c-46eb-9c75-9fdb7567bb17 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:56:07.495839 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a31a26c2-9e9c-46eb-9c75-9fdb7567bb17 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:56:07.496301 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a31a26c2-9e9c-46eb-9c75-9fdb7567bb17 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:56:07.618479 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-a31a26c2-9e9c-46eb-9c75-9fdb7567bb17 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:56:07.626287 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-a31a26c2-9e9c-46eb-9c75-9fdb7567bb17 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:56:07.627800 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-a31a26c2-9e9c-46eb-9c75-9fdb7567bb17 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:56:07.628938 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-a31a26c2-9e9c-46eb-9c75-9fdb7567bb17 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "GET /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad" status: 200 len: 1722 microversion: 2.20 time: 0.149739 Nov 01 01:56:07.629487 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1490/3074] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Nov 1 01:56:07 2021] GET /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 01:56:08.647653 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-8adfe9f3-00c3-4fb7-95d8-ac2869c6e9b5 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:56:08.648834 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-8adfe9f3-00c3-4fb7-95d8-ac2869c6e9b5 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: 6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:56:08.655075 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8adfe9f3-00c3-4fb7-95d8-ac2869c6e9b5 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:56:08.655514 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8adfe9f3-00c3-4fb7-95d8-ac2869c6e9b5 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:56:08.656259 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8adfe9f3-00c3-4fb7-95d8-ac2869c6e9b5 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:56:08.656680 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8adfe9f3-00c3-4fb7-95d8-ac2869c6e9b5 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:56:08.775375 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-8adfe9f3-00c3-4fb7-95d8-ac2869c6e9b5 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:56:08.782958 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-8adfe9f3-00c3-4fb7-95d8-ac2869c6e9b5 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:56:08.784445 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-8adfe9f3-00c3-4fb7-95d8-ac2869c6e9b5 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:56:08.785587 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-8adfe9f3-00c3-4fb7-95d8-ac2869c6e9b5 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "GET /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad" status: 200 len: 1665 microversion: 2.20 time: 0.141712 Nov 01 01:56:08.786139 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1585/3075] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Nov 1 01:56:08 2021] GET /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad => generated 1665 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 01:56:08.803686 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-126ca5be-4cee-440c-a664-26cf01eee782 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "407816f4-1adb-4587-91d3-3c8f99790bbd"}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:56:08.805369 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-126ca5be-4cee-440c-a664-26cf01eee782 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: 6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:56:08.811498 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-126ca5be-4cee-440c-a664-26cf01eee782 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:56:08.811942 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-126ca5be-4cee-440c-a664-26cf01eee782 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:56:08.812690 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-126ca5be-4cee-440c-a664-26cf01eee782 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:56:08.813116 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-126ca5be-4cee-440c-a664-26cf01eee782 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:56:09.923661 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-126ca5be-4cee-440c-a664-26cf01eee782 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "POST /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.123870 Nov 01 01:56:09.924257 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1491/3076] 10.222.0.47 () {62 vars in 1363 bytes} [Mon Nov 1 01:56:08 2021] POST /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad/os-volume_attachments => generated 188 bytes in 1125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 01 01:56:10.028685 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-ba240c35-1f65-4eeb-805d-dab51c1a0fb2 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:56:10.030087 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-ba240c35-1f65-4eeb-805d-dab51c1a0fb2 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: 6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:56:10.035400 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ba240c35-1f65-4eeb-805d-dab51c1a0fb2 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:56:10.035842 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ba240c35-1f65-4eeb-805d-dab51c1a0fb2 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:56:10.036593 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ba240c35-1f65-4eeb-805d-dab51c1a0fb2 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:56:10.037018 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ba240c35-1f65-4eeb-805d-dab51c1a0fb2 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:56:10.326907 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-ba240c35-1f65-4eeb-805d-dab51c1a0fb2 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "POST /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad/action" status: 202 len: 0 microversion: 2.20 time: 0.301763 Nov 01 01:56:10.327561 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1586/3077] 10.222.0.47 () {62 vars in 1318 bytes} [Mon Nov 1 01:56:10 2021] POST /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad/action => generated 0 bytes in 303 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 01 01:56:10.335438 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-32676e49-0437-492b-b394-4196c8edfed6 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:56:10.336655 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-32676e49-0437-492b-b394-4196c8edfed6 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: 6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:56:10.343279 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-32676e49-0437-492b-b394-4196c8edfed6 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:56:10.343733 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-32676e49-0437-492b-b394-4196c8edfed6 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:56:10.344505 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-32676e49-0437-492b-b394-4196c8edfed6 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:56:10.344936 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-32676e49-0437-492b-b394-4196c8edfed6 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:56:10.376762 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [req-fcab8809-23d4-42c0-8dea-d73a11399ca4 req-5d595137-e45c-44c4-b82b-90b838810ecd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad", "name": "network-vif-unplugged", "status": "completed", "tag": "0d980dc6-46c5-489a-a08f-baa507ecfcdd"}]} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:56:10.378338 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 01 01:56:10.378338 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: warnings.warn(msg) Nov 01 01:56:10.386031 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [req-fcab8809-23d4-42c0-8dea-d73a11399ca4 req-5d595137-e45c-44c4-b82b-90b838810ecd service nova] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:56:10.392730 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [req-fcab8809-23d4-42c0-8dea-d73a11399ca4 req-5d595137-e45c-44c4-b82b-90b838810ecd service nova] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:56:10.397652 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.compute.server_external_events [req-fcab8809-23d4-42c0-8dea-d73a11399ca4 req-5d595137-e45c-44c4-b82b-90b838810ecd service nova] Unable to find a host for instance 6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad. Dropping event network-vif-unplugged {{(pid=116267) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Nov 01 01:56:10.399210 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [req-fcab8809-23d4-42c0-8dea-d73a11399ca4 req-5d595137-e45c-44c4-b82b-90b838810ecd service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.025745 Nov 01 01:56:10.399965 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1587/3078] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Nov 1 01:56:10 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 28 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Nov 01 01:56:10.473870 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-32676e49-0437-492b-b394-4196c8edfed6 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:56:10.482164 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-32676e49-0437-492b-b394-4196c8edfed6 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:56:10.484676 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-32676e49-0437-492b-b394-4196c8edfed6 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:56:10.485947 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-32676e49-0437-492b-b394-4196c8edfed6 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "GET /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad" status: 200 len: 1751 microversion: 2.20 time: 0.154310 Nov 01 01:56:10.487953 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1492/3079] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Nov 1 01:56:10 2021] GET /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad => generated 1751 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 01 01:56:11.504896 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-3463a19c-962c-4d00-b0a9-fc3bbc6bfd98 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:56:11.505475 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-3463a19c-962c-4d00-b0a9-fc3bbc6bfd98 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: 6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:56:11.511739 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3463a19c-962c-4d00-b0a9-fc3bbc6bfd98 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:56:11.512187 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3463a19c-962c-4d00-b0a9-fc3bbc6bfd98 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:56:11.512941 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3463a19c-962c-4d00-b0a9-fc3bbc6bfd98 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:56:11.513377 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3463a19c-962c-4d00-b0a9-fc3bbc6bfd98 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:56:11.631374 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-3463a19c-962c-4d00-b0a9-fc3bbc6bfd98 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:56:11.640030 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-3463a19c-962c-4d00-b0a9-fc3bbc6bfd98 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:56:11.641573 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-3463a19c-962c-4d00-b0a9-fc3bbc6bfd98 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:56:11.642753 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-3463a19c-962c-4d00-b0a9-fc3bbc6bfd98 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "GET /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad" status: 200 len: 1751 microversion: 2.20 time: 0.141617 Nov 01 01:56:11.643313 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1588/3080] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Nov 1 01:56:11 2021] GET /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad => generated 1751 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 01:56:12.661766 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-040d1b57-15d3-4478-9a17-511055a94c5d tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:56:12.662322 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-040d1b57-15d3-4478-9a17-511055a94c5d tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: 6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:56:12.669089 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-040d1b57-15d3-4478-9a17-511055a94c5d tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:56:12.669560 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-040d1b57-15d3-4478-9a17-511055a94c5d tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:56:12.670301 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-040d1b57-15d3-4478-9a17-511055a94c5d tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:56:12.670750 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-040d1b57-15d3-4478-9a17-511055a94c5d tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:56:12.799225 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-040d1b57-15d3-4478-9a17-511055a94c5d tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:56:12.807800 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-040d1b57-15d3-4478-9a17-511055a94c5d tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:56:12.812068 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-040d1b57-15d3-4478-9a17-511055a94c5d tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:56:12.812068 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-040d1b57-15d3-4478-9a17-511055a94c5d tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "GET /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad" status: 200 len: 1753 microversion: 2.20 time: 0.152663 Nov 01 01:56:12.812068 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1493/3081] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Nov 1 01:56:12 2021] GET /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad => generated 1753 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 01:56:13.828763 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-9ae4fdc2-5a59-4d84-887b-4237bb9143d0 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:56:13.829476 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-9ae4fdc2-5a59-4d84-887b-4237bb9143d0 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: 6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:56:13.836628 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9ae4fdc2-5a59-4d84-887b-4237bb9143d0 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:56:13.837083 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9ae4fdc2-5a59-4d84-887b-4237bb9143d0 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:56:13.837846 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9ae4fdc2-5a59-4d84-887b-4237bb9143d0 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:56:13.838277 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9ae4fdc2-5a59-4d84-887b-4237bb9143d0 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:56:13.957954 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-9ae4fdc2-5a59-4d84-887b-4237bb9143d0 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:56:13.966824 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-9ae4fdc2-5a59-4d84-887b-4237bb9143d0 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:56:13.968273 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-9ae4fdc2-5a59-4d84-887b-4237bb9143d0 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:56:13.969424 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-9ae4fdc2-5a59-4d84-887b-4237bb9143d0 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "GET /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad" status: 200 len: 1809 microversion: 2.20 time: 0.144432 Nov 01 01:56:13.969979 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1589/3082] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Nov 1 01:56:13 2021] GET /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad => generated 1809 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 01:56:14.987452 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-4aa5169d-ad2e-4df7-8924-9126b266c22c tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:56:14.988703 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-4aa5169d-ad2e-4df7-8924-9126b266c22c tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: 6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:56:14.996077 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4aa5169d-ad2e-4df7-8924-9126b266c22c tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:56:14.996869 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4aa5169d-ad2e-4df7-8924-9126b266c22c tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:56:14.997878 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4aa5169d-ad2e-4df7-8924-9126b266c22c tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:56:14.998551 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4aa5169d-ad2e-4df7-8924-9126b266c22c tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:56:15.303340 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-4aa5169d-ad2e-4df7-8924-9126b266c22c tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:56:15.313245 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-4aa5169d-ad2e-4df7-8924-9126b266c22c tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:56:15.314822 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-4aa5169d-ad2e-4df7-8924-9126b266c22c tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:56:15.315994 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-4aa5169d-ad2e-4df7-8924-9126b266c22c tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "GET /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad" status: 200 len: 1809 microversion: 2.20 time: 0.332246 Nov 01 01:56:15.325699 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1494/3083] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Nov 1 01:56:14 2021] GET /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad => generated 1809 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 01:56:16.333876 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-f87a6aa5-325a-4aad-98b0-1d1f5f40baaf tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:56:16.334494 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-f87a6aa5-325a-4aad-98b0-1d1f5f40baaf tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: 6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:56:16.341187 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f87a6aa5-325a-4aad-98b0-1d1f5f40baaf tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:56:16.348987 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f87a6aa5-325a-4aad-98b0-1d1f5f40baaf tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:56:16.349834 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f87a6aa5-325a-4aad-98b0-1d1f5f40baaf tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:56:16.350265 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f87a6aa5-325a-4aad-98b0-1d1f5f40baaf tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:56:16.482892 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-f87a6aa5-325a-4aad-98b0-1d1f5f40baaf tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:56:16.491580 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-f87a6aa5-325a-4aad-98b0-1d1f5f40baaf tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:56:16.503687 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-f87a6aa5-325a-4aad-98b0-1d1f5f40baaf tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:56:16.505203 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-f87a6aa5-325a-4aad-98b0-1d1f5f40baaf tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "GET /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad" status: 200 len: 1809 microversion: 2.20 time: 0.175062 Nov 01 01:56:16.505955 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1590/3084] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Nov 1 01:56:16 2021] GET /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad => generated 1809 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 01:56:17.524050 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-9bb88c33-5326-4831-aaa9-ffaf5af0dbee tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:56:17.524637 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-9bb88c33-5326-4831-aaa9-ffaf5af0dbee tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: 6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:56:17.530825 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9bb88c33-5326-4831-aaa9-ffaf5af0dbee tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:56:17.531357 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9bb88c33-5326-4831-aaa9-ffaf5af0dbee tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:56:17.532035 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9bb88c33-5326-4831-aaa9-ffaf5af0dbee tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:56:17.532466 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-9bb88c33-5326-4831-aaa9-ffaf5af0dbee tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:56:17.669526 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-9bb88c33-5326-4831-aaa9-ffaf5af0dbee tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:56:17.677846 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-9bb88c33-5326-4831-aaa9-ffaf5af0dbee tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:56:17.679365 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-9bb88c33-5326-4831-aaa9-ffaf5af0dbee tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:56:17.680496 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-9bb88c33-5326-4831-aaa9-ffaf5af0dbee tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "GET /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad" status: 200 len: 1809 microversion: 2.20 time: 0.160615 Nov 01 01:56:17.681027 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1495/3085] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Nov 1 01:56:17 2021] GET /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad => generated 1809 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 01:56:18.307740 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 01 01:56:18.308039 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: Mon Nov 1 01:56:18 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 01 01:56:18.699118 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-ec056160-53d3-4597-95ee-799a3d8e9067 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:56:18.699725 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-ec056160-53d3-4597-95ee-799a3d8e9067 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: 6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:56:18.705921 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ec056160-53d3-4597-95ee-799a3d8e9067 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:56:18.706364 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ec056160-53d3-4597-95ee-799a3d8e9067 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:56:18.707151 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ec056160-53d3-4597-95ee-799a3d8e9067 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:56:18.707583 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ec056160-53d3-4597-95ee-799a3d8e9067 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:56:18.834594 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-ec056160-53d3-4597-95ee-799a3d8e9067 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:56:18.843382 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-ec056160-53d3-4597-95ee-799a3d8e9067 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:56:18.844875 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-ec056160-53d3-4597-95ee-799a3d8e9067 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:56:18.846038 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-ec056160-53d3-4597-95ee-799a3d8e9067 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "GET /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad" status: 200 len: 1809 microversion: 2.20 time: 0.151249 Nov 01 01:56:18.846624 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1591/3086] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Nov 1 01:56:18 2021] GET /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad => generated 1809 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 01:56:19.864366 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-ea3e816d-4176-487e-ad2f-d6899f9effb8 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:56:19.865243 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-ea3e816d-4176-487e-ad2f-d6899f9effb8 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: 6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:56:19.872283 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ea3e816d-4176-487e-ad2f-d6899f9effb8 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:56:19.872754 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ea3e816d-4176-487e-ad2f-d6899f9effb8 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:56:19.873523 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ea3e816d-4176-487e-ad2f-d6899f9effb8 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:56:19.873954 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ea3e816d-4176-487e-ad2f-d6899f9effb8 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:56:19.998704 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-ea3e816d-4176-487e-ad2f-d6899f9effb8 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:56:20.006821 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-ea3e816d-4176-487e-ad2f-d6899f9effb8 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:56:20.008868 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-ea3e816d-4176-487e-ad2f-d6899f9effb8 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:56:20.010014 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-ea3e816d-4176-487e-ad2f-d6899f9effb8 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "GET /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad" status: 200 len: 1809 microversion: 2.20 time: 0.150003 Nov 01 01:56:20.010590 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1496/3087] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Nov 1 01:56:19 2021] GET /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad => generated 1809 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 01:56:21.028210 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-675988a0-4a8f-46d9-bf15-537d19d15a15 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:56:21.035831 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-675988a0-4a8f-46d9-bf15-537d19d15a15 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: 6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:56:21.035831 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-675988a0-4a8f-46d9-bf15-537d19d15a15 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:56:21.036223 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-675988a0-4a8f-46d9-bf15-537d19d15a15 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:56:21.036928 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-675988a0-4a8f-46d9-bf15-537d19d15a15 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:56:21.037412 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-675988a0-4a8f-46d9-bf15-537d19d15a15 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:56:21.176676 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-675988a0-4a8f-46d9-bf15-537d19d15a15 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:56:21.185629 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-675988a0-4a8f-46d9-bf15-537d19d15a15 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:56:21.187171 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-675988a0-4a8f-46d9-bf15-537d19d15a15 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:56:21.188448 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-675988a0-4a8f-46d9-bf15-537d19d15a15 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "GET /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad" status: 200 len: 1809 microversion: 2.20 time: 0.163926 Nov 01 01:56:21.189057 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1592/3088] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Nov 1 01:56:21 2021] GET /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad => generated 1809 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 01:56:22.210215 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-93ee15b5-3938-4b01-8f56-9163bd13343f tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:56:22.212825 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-93ee15b5-3938-4b01-8f56-9163bd13343f tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: 6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:56:22.221968 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-93ee15b5-3938-4b01-8f56-9163bd13343f tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:56:22.222921 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-93ee15b5-3938-4b01-8f56-9163bd13343f tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:56:22.225020 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-93ee15b5-3938-4b01-8f56-9163bd13343f tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:56:22.225904 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-93ee15b5-3938-4b01-8f56-9163bd13343f tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:56:22.352922 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-93ee15b5-3938-4b01-8f56-9163bd13343f tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:56:22.366778 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-93ee15b5-3938-4b01-8f56-9163bd13343f tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:56:22.368801 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-93ee15b5-3938-4b01-8f56-9163bd13343f tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:56:22.370312 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-93ee15b5-3938-4b01-8f56-9163bd13343f tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "GET /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad" status: 200 len: 1809 microversion: 2.20 time: 0.165315 Nov 01 01:56:22.371224 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1497/3089] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Nov 1 01:56:22 2021] GET /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad => generated 1809 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 01:56:23.391104 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-3e07ff25-7dbb-421f-9f3c-fcfb423fcde7 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:56:23.391804 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-3e07ff25-7dbb-421f-9f3c-fcfb423fcde7 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: 6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:56:23.399301 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3e07ff25-7dbb-421f-9f3c-fcfb423fcde7 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:56:23.400155 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3e07ff25-7dbb-421f-9f3c-fcfb423fcde7 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:56:23.401050 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3e07ff25-7dbb-421f-9f3c-fcfb423fcde7 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:56:23.401570 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3e07ff25-7dbb-421f-9f3c-fcfb423fcde7 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:56:23.554995 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-3e07ff25-7dbb-421f-9f3c-fcfb423fcde7 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:56:23.563827 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-3e07ff25-7dbb-421f-9f3c-fcfb423fcde7 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:56:23.565570 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-3e07ff25-7dbb-421f-9f3c-fcfb423fcde7 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:56:23.566781 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-3e07ff25-7dbb-421f-9f3c-fcfb423fcde7 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "GET /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad" status: 200 len: 1809 microversion: 2.20 time: 0.179749 Nov 01 01:56:23.567347 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1593/3090] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Nov 1 01:56:23 2021] GET /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad => generated 1809 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 01:56:24.585439 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-74a388e5-f655-47c7-a6ed-7182936e0b97 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:56:24.586684 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-74a388e5-f655-47c7-a6ed-7182936e0b97 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: 6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:56:24.593218 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-74a388e5-f655-47c7-a6ed-7182936e0b97 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:56:24.593757 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-74a388e5-f655-47c7-a6ed-7182936e0b97 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:56:24.595675 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-74a388e5-f655-47c7-a6ed-7182936e0b97 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:56:24.596117 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-74a388e5-f655-47c7-a6ed-7182936e0b97 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:56:24.724881 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-74a388e5-f655-47c7-a6ed-7182936e0b97 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:56:24.733713 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-74a388e5-f655-47c7-a6ed-7182936e0b97 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:56:24.735246 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-74a388e5-f655-47c7-a6ed-7182936e0b97 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:56:24.736387 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-74a388e5-f655-47c7-a6ed-7182936e0b97 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "GET /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad" status: 200 len: 1809 microversion: 2.20 time: 0.155067 Nov 01 01:56:24.737019 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1498/3091] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Nov 1 01:56:24 2021] GET /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad => generated 1809 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 01:56:25.754663 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-a207fbf6-3949-48fb-b066-4924f91f9387 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:56:25.755307 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-a207fbf6-3949-48fb-b066-4924f91f9387 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: 6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:56:25.761710 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a207fbf6-3949-48fb-b066-4924f91f9387 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:56:25.762151 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a207fbf6-3949-48fb-b066-4924f91f9387 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:56:25.762934 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a207fbf6-3949-48fb-b066-4924f91f9387 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:56:25.763364 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a207fbf6-3949-48fb-b066-4924f91f9387 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:56:25.879440 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-a207fbf6-3949-48fb-b066-4924f91f9387 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:56:25.888427 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-a207fbf6-3949-48fb-b066-4924f91f9387 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:56:25.889989 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-a207fbf6-3949-48fb-b066-4924f91f9387 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:56:25.891270 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-a207fbf6-3949-48fb-b066-4924f91f9387 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "GET /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad" status: 200 len: 1809 microversion: 2.20 time: 0.140424 Nov 01 01:56:25.891829 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1594/3092] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Nov 1 01:56:25 2021] GET /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad => generated 1809 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 01:56:26.909686 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-0db10ee6-4472-4516-a0f0-a91ff57840d1 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:56:26.910290 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-0db10ee6-4472-4516-a0f0-a91ff57840d1 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: 6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:56:26.916324 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0db10ee6-4472-4516-a0f0-a91ff57840d1 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:56:26.916767 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0db10ee6-4472-4516-a0f0-a91ff57840d1 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:56:26.917518 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0db10ee6-4472-4516-a0f0-a91ff57840d1 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:56:26.917945 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0db10ee6-4472-4516-a0f0-a91ff57840d1 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:56:27.037284 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-0db10ee6-4472-4516-a0f0-a91ff57840d1 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:56:27.045508 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-0db10ee6-4472-4516-a0f0-a91ff57840d1 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:56:27.047029 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-0db10ee6-4472-4516-a0f0-a91ff57840d1 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:56:27.048171 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-0db10ee6-4472-4516-a0f0-a91ff57840d1 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "GET /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad" status: 200 len: 1809 microversion: 2.20 time: 0.142167 Nov 01 01:56:27.048709 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1499/3093] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Nov 1 01:56:26 2021] GET /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad => generated 1809 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 01:56:28.066822 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-1d10676a-7649-4e3d-87ce-8493b63f1ea1 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:56:28.067434 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-1d10676a-7649-4e3d-87ce-8493b63f1ea1 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: 6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:56:28.074346 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-1d10676a-7649-4e3d-87ce-8493b63f1ea1 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:56:28.074841 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-1d10676a-7649-4e3d-87ce-8493b63f1ea1 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:56:28.075598 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-1d10676a-7649-4e3d-87ce-8493b63f1ea1 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:56:28.076065 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-1d10676a-7649-4e3d-87ce-8493b63f1ea1 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:56:28.201938 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-1d10676a-7649-4e3d-87ce-8493b63f1ea1 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:56:28.209983 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-1d10676a-7649-4e3d-87ce-8493b63f1ea1 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:56:28.211534 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-1d10676a-7649-4e3d-87ce-8493b63f1ea1 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:56:28.213317 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-1d10676a-7649-4e3d-87ce-8493b63f1ea1 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "GET /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad" status: 200 len: 1809 microversion: 2.20 time: 0.150555 Nov 01 01:56:28.213969 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1595/3094] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Nov 1 01:56:28 2021] GET /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad => generated 1809 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 01:56:29.231905 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-dff3cd81-3a4a-4c04-9636-9e4e255b4b7e tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:56:29.232483 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-dff3cd81-3a4a-4c04-9636-9e4e255b4b7e tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: 6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:56:29.238751 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-dff3cd81-3a4a-4c04-9636-9e4e255b4b7e tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:56:29.239198 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-dff3cd81-3a4a-4c04-9636-9e4e255b4b7e tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:56:29.239960 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-dff3cd81-3a4a-4c04-9636-9e4e255b4b7e tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:56:29.240393 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-dff3cd81-3a4a-4c04-9636-9e4e255b4b7e tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:56:29.370639 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-dff3cd81-3a4a-4c04-9636-9e4e255b4b7e tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:56:29.378701 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-dff3cd81-3a4a-4c04-9636-9e4e255b4b7e tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:56:29.380195 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-dff3cd81-3a4a-4c04-9636-9e4e255b4b7e tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:56:29.381331 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-dff3cd81-3a4a-4c04-9636-9e4e255b4b7e tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "GET /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad" status: 200 len: 1809 microversion: 2.20 time: 0.153792 Nov 01 01:56:29.381876 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1500/3095] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Nov 1 01:56:29 2021] GET /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad => generated 1809 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 01 01:56:30.399392 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-99f65226-8fd4-4b1e-ae7f-755b68f21305 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:56:30.400010 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-99f65226-8fd4-4b1e-ae7f-755b68f21305 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: 6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:56:30.406554 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-99f65226-8fd4-4b1e-ae7f-755b68f21305 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:56:30.406997 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-99f65226-8fd4-4b1e-ae7f-755b68f21305 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:56:30.407745 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-99f65226-8fd4-4b1e-ae7f-755b68f21305 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:56:30.408169 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-99f65226-8fd4-4b1e-ae7f-755b68f21305 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:56:30.580721 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-99f65226-8fd4-4b1e-ae7f-755b68f21305 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:56:30.588757 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-99f65226-8fd4-4b1e-ae7f-755b68f21305 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:56:30.590243 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-99f65226-8fd4-4b1e-ae7f-755b68f21305 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:56:30.591423 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-99f65226-8fd4-4b1e-ae7f-755b68f21305 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "GET /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad" status: 200 len: 1809 microversion: 2.20 time: 0.195781 Nov 01 01:56:30.591973 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1596/3096] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Nov 1 01:56:30 2021] GET /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad => generated 1809 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 01:56:31.609393 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-ead46ced-085d-437a-9a29-2863f43ace8f tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:56:31.609993 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-ead46ced-085d-437a-9a29-2863f43ace8f tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: 6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:56:31.616166 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ead46ced-085d-437a-9a29-2863f43ace8f tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:56:31.616689 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ead46ced-085d-437a-9a29-2863f43ace8f tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:56:31.617383 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ead46ced-085d-437a-9a29-2863f43ace8f tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:56:31.617804 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ead46ced-085d-437a-9a29-2863f43ace8f tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:56:31.735995 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-ead46ced-085d-437a-9a29-2863f43ace8f tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:56:31.744157 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-ead46ced-085d-437a-9a29-2863f43ace8f tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:56:31.745654 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-ead46ced-085d-437a-9a29-2863f43ace8f tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:56:31.746838 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-ead46ced-085d-437a-9a29-2863f43ace8f tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "GET /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad" status: 200 len: 1809 microversion: 2.20 time: 0.141079 Nov 01 01:56:31.747392 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1501/3097] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Nov 1 01:56:31 2021] GET /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad => generated 1809 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 01 01:56:32.765477 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-9ff3067c-c6a8-44bc-9a12-da462ca9687c tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:56:32.766078 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-9ff3067c-c6a8-44bc-9a12-da462ca9687c tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: 6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:56:32.772303 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9ff3067c-c6a8-44bc-9a12-da462ca9687c tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:56:32.772751 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9ff3067c-c6a8-44bc-9a12-da462ca9687c tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:56:32.773498 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9ff3067c-c6a8-44bc-9a12-da462ca9687c tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:56:32.773923 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9ff3067c-c6a8-44bc-9a12-da462ca9687c tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:56:32.891722 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-9ff3067c-c6a8-44bc-9a12-da462ca9687c tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:56:32.899829 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-9ff3067c-c6a8-44bc-9a12-da462ca9687c tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:56:32.901317 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-9ff3067c-c6a8-44bc-9a12-da462ca9687c tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:56:32.902473 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-9ff3067c-c6a8-44bc-9a12-da462ca9687c tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "GET /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad" status: 200 len: 1809 microversion: 2.20 time: 0.140709 Nov 01 01:56:32.903157 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1597/3098] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Nov 1 01:56:32 2021] GET /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad => generated 1809 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 01 01:56:33.920727 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-5eba017c-1245-46cb-82a6-3e9b9999455d tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:56:33.921336 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-5eba017c-1245-46cb-82a6-3e9b9999455d tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: 6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:56:33.928304 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5eba017c-1245-46cb-82a6-3e9b9999455d tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:56:33.928750 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5eba017c-1245-46cb-82a6-3e9b9999455d tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:56:33.929508 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5eba017c-1245-46cb-82a6-3e9b9999455d tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:56:33.929938 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5eba017c-1245-46cb-82a6-3e9b9999455d tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:56:34.052258 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-5eba017c-1245-46cb-82a6-3e9b9999455d tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:56:34.061018 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-5eba017c-1245-46cb-82a6-3e9b9999455d tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:56:34.064209 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-5eba017c-1245-46cb-82a6-3e9b9999455d tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:56:34.064209 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-5eba017c-1245-46cb-82a6-3e9b9999455d tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "GET /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad" status: 200 len: 1809 microversion: 2.20 time: 0.147091 Nov 01 01:56:34.064623 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1502/3099] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Nov 1 01:56:33 2021] GET /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad => generated 1809 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 01:56:35.082385 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-fa2a6332-e47d-4228-8f88-d29e401ebf86 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:56:35.083059 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-fa2a6332-e47d-4228-8f88-d29e401ebf86 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: 6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:56:35.089941 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-fa2a6332-e47d-4228-8f88-d29e401ebf86 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:56:35.090380 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-fa2a6332-e47d-4228-8f88-d29e401ebf86 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:56:35.091153 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-fa2a6332-e47d-4228-8f88-d29e401ebf86 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:56:35.091623 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-fa2a6332-e47d-4228-8f88-d29e401ebf86 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:56:35.210369 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-fa2a6332-e47d-4228-8f88-d29e401ebf86 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:56:35.218584 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-fa2a6332-e47d-4228-8f88-d29e401ebf86 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:56:35.220105 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-fa2a6332-e47d-4228-8f88-d29e401ebf86 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:56:35.221266 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-fa2a6332-e47d-4228-8f88-d29e401ebf86 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "GET /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad" status: 200 len: 1809 microversion: 2.20 time: 0.142596 Nov 01 01:56:35.221829 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1598/3100] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Nov 1 01:56:35 2021] GET /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad => generated 1809 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 01:56:36.239174 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-13c3af09-d4a6-4da7-8b7d-3516c8129d0a tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:56:36.239804 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-13c3af09-d4a6-4da7-8b7d-3516c8129d0a tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: 6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:56:36.245879 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-13c3af09-d4a6-4da7-8b7d-3516c8129d0a tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:56:36.246318 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-13c3af09-d4a6-4da7-8b7d-3516c8129d0a tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:56:36.247090 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-13c3af09-d4a6-4da7-8b7d-3516c8129d0a tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:56:36.247518 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-13c3af09-d4a6-4da7-8b7d-3516c8129d0a tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:56:36.367637 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-13c3af09-d4a6-4da7-8b7d-3516c8129d0a tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:56:36.375953 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-13c3af09-d4a6-4da7-8b7d-3516c8129d0a tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:56:36.377447 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-13c3af09-d4a6-4da7-8b7d-3516c8129d0a tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:56:36.378615 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-13c3af09-d4a6-4da7-8b7d-3516c8129d0a tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "GET /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad" status: 200 len: 1809 microversion: 2.20 time: 0.143082 Nov 01 01:56:36.379148 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1503/3101] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Nov 1 01:56:36 2021] GET /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad => generated 1809 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 01:56:37.396602 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-a2a069c4-b0a1-4dab-b85a-0adaa80ed585 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:56:37.397205 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-a2a069c4-b0a1-4dab-b85a-0adaa80ed585 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: 6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:56:37.403828 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a2a069c4-b0a1-4dab-b85a-0adaa80ed585 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:56:37.404275 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a2a069c4-b0a1-4dab-b85a-0adaa80ed585 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:56:37.405028 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a2a069c4-b0a1-4dab-b85a-0adaa80ed585 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:56:37.405460 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a2a069c4-b0a1-4dab-b85a-0adaa80ed585 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:56:37.527020 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-a2a069c4-b0a1-4dab-b85a-0adaa80ed585 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:56:37.535141 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-a2a069c4-b0a1-4dab-b85a-0adaa80ed585 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:56:37.536628 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-a2a069c4-b0a1-4dab-b85a-0adaa80ed585 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:56:37.537770 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-a2a069c4-b0a1-4dab-b85a-0adaa80ed585 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "GET /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad" status: 200 len: 1809 microversion: 2.20 time: 0.144846 Nov 01 01:56:37.538316 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1599/3102] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Nov 1 01:56:37 2021] GET /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad => generated 1809 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 01:56:38.556612 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-ada9a319-1b60-4d1a-9efc-d11df9214ec0 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:56:38.557207 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-ada9a319-1b60-4d1a-9efc-d11df9214ec0 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: 6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:56:38.563368 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ada9a319-1b60-4d1a-9efc-d11df9214ec0 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:56:38.563811 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ada9a319-1b60-4d1a-9efc-d11df9214ec0 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:56:38.564563 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ada9a319-1b60-4d1a-9efc-d11df9214ec0 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:56:38.564990 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ada9a319-1b60-4d1a-9efc-d11df9214ec0 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:56:38.681291 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-ada9a319-1b60-4d1a-9efc-d11df9214ec0 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:56:38.692444 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-ada9a319-1b60-4d1a-9efc-d11df9214ec0 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:56:38.694701 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-ada9a319-1b60-4d1a-9efc-d11df9214ec0 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:56:38.695855 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-ada9a319-1b60-4d1a-9efc-d11df9214ec0 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "GET /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad" status: 200 len: 1809 microversion: 2.20 time: 0.142952 Nov 01 01:56:38.696400 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1504/3103] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Nov 1 01:56:38 2021] GET /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad => generated 1809 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 01:56:39.714480 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-afb3cbcd-ae0d-44ae-9993-542b896984f3 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:56:39.715091 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-afb3cbcd-ae0d-44ae-9993-542b896984f3 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: 6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:56:39.721262 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-afb3cbcd-ae0d-44ae-9993-542b896984f3 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:56:39.721705 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-afb3cbcd-ae0d-44ae-9993-542b896984f3 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:56:39.722481 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-afb3cbcd-ae0d-44ae-9993-542b896984f3 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:56:39.722912 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-afb3cbcd-ae0d-44ae-9993-542b896984f3 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:56:39.839404 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-afb3cbcd-ae0d-44ae-9993-542b896984f3 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:56:39.847469 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-afb3cbcd-ae0d-44ae-9993-542b896984f3 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:56:39.848967 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-afb3cbcd-ae0d-44ae-9993-542b896984f3 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:56:39.850124 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-afb3cbcd-ae0d-44ae-9993-542b896984f3 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "GET /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad" status: 200 len: 1809 microversion: 2.20 time: 0.139431 Nov 01 01:56:39.850727 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1600/3104] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Nov 1 01:56:39 2021] GET /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad => generated 1809 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 01:56:40.868042 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-ca3c6b1f-5cec-492f-93f8-a192a6dfd3a4 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:56:40.868680 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-ca3c6b1f-5cec-492f-93f8-a192a6dfd3a4 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: 6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:56:40.874825 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ca3c6b1f-5cec-492f-93f8-a192a6dfd3a4 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:56:40.875267 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ca3c6b1f-5cec-492f-93f8-a192a6dfd3a4 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:56:40.876021 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ca3c6b1f-5cec-492f-93f8-a192a6dfd3a4 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:56:40.876446 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ca3c6b1f-5cec-492f-93f8-a192a6dfd3a4 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:56:40.995708 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-ca3c6b1f-5cec-492f-93f8-a192a6dfd3a4 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:56:41.003797 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-ca3c6b1f-5cec-492f-93f8-a192a6dfd3a4 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:56:41.005286 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-ca3c6b1f-5cec-492f-93f8-a192a6dfd3a4 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:56:41.006446 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-ca3c6b1f-5cec-492f-93f8-a192a6dfd3a4 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "GET /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad" status: 200 len: 1809 microversion: 2.20 time: 0.142058 Nov 01 01:56:41.007047 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1505/3105] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Nov 1 01:56:40 2021] GET /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad => generated 1809 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 01:56:42.025406 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-e9ee22c7-7d52-4dc0-b624-573d1d1ed30d tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:56:42.026003 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-e9ee22c7-7d52-4dc0-b624-573d1d1ed30d tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: 6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:56:42.032603 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e9ee22c7-7d52-4dc0-b624-573d1d1ed30d tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:56:42.044794 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e9ee22c7-7d52-4dc0-b624-573d1d1ed30d tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:56:42.044794 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e9ee22c7-7d52-4dc0-b624-573d1d1ed30d tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:56:42.044794 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e9ee22c7-7d52-4dc0-b624-573d1d1ed30d tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:56:42.151532 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-e9ee22c7-7d52-4dc0-b624-573d1d1ed30d tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:56:42.159585 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-e9ee22c7-7d52-4dc0-b624-573d1d1ed30d tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:56:42.161085 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-e9ee22c7-7d52-4dc0-b624-573d1d1ed30d tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:56:42.162237 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-e9ee22c7-7d52-4dc0-b624-573d1d1ed30d tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "GET /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad" status: 200 len: 1809 microversion: 2.20 time: 0.141046 Nov 01 01:56:42.162832 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1601/3106] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Nov 1 01:56:42 2021] GET /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad => generated 1809 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 01:56:43.182240 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-6faa51b2-6cbf-4d6f-be16-fcdc5a0cdbaa tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:56:43.183067 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-6faa51b2-6cbf-4d6f-be16-fcdc5a0cdbaa tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: 6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:56:43.189168 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6faa51b2-6cbf-4d6f-be16-fcdc5a0cdbaa tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:56:43.189605 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6faa51b2-6cbf-4d6f-be16-fcdc5a0cdbaa tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:56:43.190363 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6faa51b2-6cbf-4d6f-be16-fcdc5a0cdbaa tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:56:43.190808 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-6faa51b2-6cbf-4d6f-be16-fcdc5a0cdbaa tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:56:43.308276 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-6faa51b2-6cbf-4d6f-be16-fcdc5a0cdbaa tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:56:43.316250 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-6faa51b2-6cbf-4d6f-be16-fcdc5a0cdbaa tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:56:43.317740 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-6faa51b2-6cbf-4d6f-be16-fcdc5a0cdbaa tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:56:43.318903 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-6faa51b2-6cbf-4d6f-be16-fcdc5a0cdbaa tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "GET /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad" status: 200 len: 1809 microversion: 2.20 time: 0.140999 Nov 01 01:56:43.319449 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1506/3107] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Nov 1 01:56:43 2021] GET /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad => generated 1809 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 01:56:44.336920 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-90e0d5ec-bbc9-4aa5-b2f8-7a94467115d3 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:56:44.337579 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-90e0d5ec-bbc9-4aa5-b2f8-7a94467115d3 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: 6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:56:44.343892 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-90e0d5ec-bbc9-4aa5-b2f8-7a94467115d3 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:56:44.344328 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-90e0d5ec-bbc9-4aa5-b2f8-7a94467115d3 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:56:44.345085 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-90e0d5ec-bbc9-4aa5-b2f8-7a94467115d3 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:56:44.345506 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-90e0d5ec-bbc9-4aa5-b2f8-7a94467115d3 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:56:44.469335 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-90e0d5ec-bbc9-4aa5-b2f8-7a94467115d3 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:56:44.478910 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-90e0d5ec-bbc9-4aa5-b2f8-7a94467115d3 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:56:44.480414 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-90e0d5ec-bbc9-4aa5-b2f8-7a94467115d3 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:56:44.481673 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-90e0d5ec-bbc9-4aa5-b2f8-7a94467115d3 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "GET /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad" status: 200 len: 1809 microversion: 2.20 time: 0.148461 Nov 01 01:56:44.482232 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1602/3108] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Nov 1 01:56:44 2021] GET /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad => generated 1809 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 01:56:44.552440 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [req-0702d377-522f-471b-b661-1c2aa1db49a8 req-77c3a3cf-1ae8-4f35-a85d-590150d44409 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad", "name": "network-vif-plugged", "status": "completed", "tag": "0d980dc6-46c5-489a-a08f-baa507ecfcdd"}]} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:56:44.557363 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 01 01:56:44.557363 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: warnings.warn(msg) Nov 01 01:56:44.561909 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [req-0702d377-522f-471b-b661-1c2aa1db49a8 req-77c3a3cf-1ae8-4f35-a85d-590150d44409 service nova] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:56:44.562337 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [req-0702d377-522f-471b-b661-1c2aa1db49a8 req-77c3a3cf-1ae8-4f35-a85d-590150d44409 service nova] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:56:44.572897 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.compute.server_external_events [req-0702d377-522f-471b-b661-1c2aa1db49a8 req-77c3a3cf-1ae8-4f35-a85d-590150d44409 service nova] Creating event network-vif-plugged:0d980dc6-46c5-489a-a08f-baa507ecfcdd for instance 6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad on hv-cinder-81561 Nov 01 01:56:44.577974 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [req-0702d377-522f-471b-b661-1c2aa1db49a8 req-77c3a3cf-1ae8-4f35-a85d-590150d44409 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029504 Nov 01 01:56:44.578672 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1507/3109] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Nov 1 01:56:44 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 01 01:56:45.499727 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-7829ba81-1561-4731-a716-f32a27521907 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:56:45.500330 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-7829ba81-1561-4731-a716-f32a27521907 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: 6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:56:45.506608 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-7829ba81-1561-4731-a716-f32a27521907 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:56:45.507053 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-7829ba81-1561-4731-a716-f32a27521907 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:56:45.507805 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-7829ba81-1561-4731-a716-f32a27521907 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:56:45.508232 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-7829ba81-1561-4731-a716-f32a27521907 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:56:45.626311 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-7829ba81-1561-4731-a716-f32a27521907 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:56:45.634946 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-7829ba81-1561-4731-a716-f32a27521907 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:56:45.636437 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-7829ba81-1561-4731-a716-f32a27521907 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:56:45.637576 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-7829ba81-1561-4731-a716-f32a27521907 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "GET /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad" status: 200 len: 1809 microversion: 2.20 time: 0.141602 Nov 01 01:56:45.638128 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1603/3110] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Nov 1 01:56:45 2021] GET /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad => generated 1809 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 01 01:56:46.657053 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-eb308216-cff9-43e2-bd97-e6f1f347ec4e tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:56:46.657669 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-eb308216-cff9-43e2-bd97-e6f1f347ec4e tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: 6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:56:46.663695 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-eb308216-cff9-43e2-bd97-e6f1f347ec4e tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:56:46.664139 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-eb308216-cff9-43e2-bd97-e6f1f347ec4e tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:56:46.664896 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-eb308216-cff9-43e2-bd97-e6f1f347ec4e tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:56:46.665391 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-eb308216-cff9-43e2-bd97-e6f1f347ec4e tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:56:46.789936 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-eb308216-cff9-43e2-bd97-e6f1f347ec4e tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:56:46.798756 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-eb308216-cff9-43e2-bd97-e6f1f347ec4e tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:56:46.800289 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-eb308216-cff9-43e2-bd97-e6f1f347ec4e tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:56:46.801751 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-eb308216-cff9-43e2-bd97-e6f1f347ec4e tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "GET /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad" status: 200 len: 1809 microversion: 2.20 time: 0.149335 Nov 01 01:56:46.802298 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1508/3111] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Nov 1 01:56:46 2021] GET /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad => generated 1809 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 01:56:47.820274 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-e0d41241-a9ac-4fe3-bcf0-b350e2f2dcc2 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:56:47.820878 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-e0d41241-a9ac-4fe3-bcf0-b350e2f2dcc2 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: 6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:56:47.827789 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e0d41241-a9ac-4fe3-bcf0-b350e2f2dcc2 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:56:47.828234 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e0d41241-a9ac-4fe3-bcf0-b350e2f2dcc2 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:56:47.828985 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e0d41241-a9ac-4fe3-bcf0-b350e2f2dcc2 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:56:47.829417 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e0d41241-a9ac-4fe3-bcf0-b350e2f2dcc2 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:56:47.952560 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-e0d41241-a9ac-4fe3-bcf0-b350e2f2dcc2 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:56:47.960721 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-e0d41241-a9ac-4fe3-bcf0-b350e2f2dcc2 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:56:47.962254 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-e0d41241-a9ac-4fe3-bcf0-b350e2f2dcc2 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:56:47.963945 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-e0d41241-a9ac-4fe3-bcf0-b350e2f2dcc2 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "GET /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad" status: 200 len: 1809 microversion: 2.20 time: 0.147400 Nov 01 01:56:47.964508 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1604/3112] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Nov 1 01:56:47 2021] GET /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad => generated 1809 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 01 01:56:48.982354 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-06c6adc9-72bc-4a74-bbe8-27cd9412d7d0 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:56:48.983015 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-06c6adc9-72bc-4a74-bbe8-27cd9412d7d0 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: 6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:56:48.989246 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-06c6adc9-72bc-4a74-bbe8-27cd9412d7d0 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:56:48.989693 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-06c6adc9-72bc-4a74-bbe8-27cd9412d7d0 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:56:48.990985 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-06c6adc9-72bc-4a74-bbe8-27cd9412d7d0 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:56:48.990985 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-06c6adc9-72bc-4a74-bbe8-27cd9412d7d0 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:56:49.108195 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-06c6adc9-72bc-4a74-bbe8-27cd9412d7d0 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:56:49.116315 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-06c6adc9-72bc-4a74-bbe8-27cd9412d7d0 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:56:49.117827 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-06c6adc9-72bc-4a74-bbe8-27cd9412d7d0 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:56:49.119011 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-06c6adc9-72bc-4a74-bbe8-27cd9412d7d0 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "GET /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad" status: 200 len: 1796 microversion: 2.20 time: 0.140919 Nov 01 01:56:49.120186 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1509/3113] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Nov 1 01:56:48 2021] GET /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad => generated 1796 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 01:57:14.359524 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 01 01:57:14.360104 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: Mon Nov 1 01:57:14 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 01 01:57:27.591732 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-6266d573-ca13-4ada-adb5-c3b1472700b2 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:57:27.592335 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-6266d573-ca13-4ada-adb5-c3b1472700b2 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:57:27.598115 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-6266d573-ca13-4ada-adb5-c3b1472700b2 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:57:27.598601 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-6266d573-ca13-4ada-adb5-c3b1472700b2 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:57:27.599355 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-6266d573-ca13-4ada-adb5-c3b1472700b2 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:57:27.599784 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-6266d573-ca13-4ada-adb5-c3b1472700b2 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:57:27.612938 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.wsgi [None req-6266d573-ca13-4ada-adb5-c3b1472700b2 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] HTTP exception thrown: Instance a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 could not be found. Nov 01 01:57:27.613509 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-6266d573-ca13-4ada-adb5-c3b1472700b2 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Returning 404 to user: Instance a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 could not be found. {{(pid=116267) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 01 01:57:27.614301 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-6266d573-ca13-4ada-adb5-c3b1472700b2 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "DELETE /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 404 len: 111 microversion: 2.1 time: 0.026431 Nov 01 01:57:27.614871 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1605/3114] 10.222.0.47 () {58 vars in 1238 bytes} [Mon Nov 1 01:57:27 2021] DELETE /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 01:57:27.622912 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-5e93744b-5428-4a80-a81c-31b3070ebd86 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:57:27.623456 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-5e93744b-5428-4a80-a81c-31b3070ebd86 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] [instance: a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:57:27.629321 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5e93744b-5428-4a80-a81c-31b3070ebd86 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:57:27.629758 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5e93744b-5428-4a80-a81c-31b3070ebd86 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:57:27.630530 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5e93744b-5428-4a80-a81c-31b3070ebd86 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:57:27.630955 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5e93744b-5428-4a80-a81c-31b3070ebd86 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:57:27.644035 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.wsgi [None req-5e93744b-5428-4a80-a81c-31b3070ebd86 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] HTTP exception thrown: Instance a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 could not be found. Nov 01 01:57:27.644603 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-5e93744b-5428-4a80-a81c-31b3070ebd86 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] Returning 404 to user: Instance a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 could not be found. {{(pid=116266) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 01 01:57:27.645395 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-5e93744b-5428-4a80-a81c-31b3070ebd86 tempest-AttachVolumeTestJSON-1120476753 tempest-AttachVolumeTestJSON-1120476753-project] 10.222.0.47 "GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8" status: 404 len: 111 microversion: 2.1 time: 0.026679 Nov 01 01:57:27.645890 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1510/3115] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 01:57:27 2021] GET /compute/v2.1/servers/a8a3fbee-c821-4fd3-b8ae-b2c8f5bbcbb8 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 01:57:33.237250 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-631874e2-a286-4bfe-93f6-6087135df080 tempest-VolumesNegativeTest-997918195 tempest-VolumesNegativeTest-997918195-project] Action: 'create', calling method: .version_select at 0x7fccf634b820>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1392671764", "metadata": {"Type": "work"}}} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:57:33.238723 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-631874e2-a286-4bfe-93f6-6087135df080 tempest-VolumesNegativeTest-997918195 tempest-VolumesNegativeTest-997918195-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=116267) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 01 01:57:33.239515 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-631874e2-a286-4bfe-93f6-6087135df080 tempest-VolumesNegativeTest-997918195 tempest-VolumesNegativeTest-997918195-project] 10.222.0.47 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.111269 Nov 01 01:57:33.240021 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1606/3116] 10.222.0.47 () {60 vars in 1155 bytes} [Mon Nov 1 01:57:33 2021] POST /compute/v2.1/os-volumes => generated 127 bytes in 112 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 01 01:57:33.248989 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-d52b3915-1e91-448b-8572-aa959f470a88 tempest-VolumesNegativeTest-997918195 tempest-VolumesNegativeTest-997918195-project] Action: 'create', calling method: .version_select at 0x7fccf6e1b430>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-811056679", "metadata": {"Type": "work"}}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:57:33.250438 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-d52b3915-1e91-448b-8572-aa959f470a88 tempest-VolumesNegativeTest-997918195 tempest-VolumesNegativeTest-997918195-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=116266) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 01 01:57:33.251225 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-d52b3915-1e91-448b-8572-aa959f470a88 tempest-VolumesNegativeTest-997918195 tempest-VolumesNegativeTest-997918195-project] 10.222.0.47 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.005953 Nov 01 01:57:33.251746 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1511/3117] 10.222.0.47 () {60 vars in 1155 bytes} [Mon Nov 1 01:57:33 2021] POST /compute/v2.1/os-volumes => generated 125 bytes in 7 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 01 01:57:33.260056 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-a5174aca-34c6-49ac-804e-d016df363b4b tempest-VolumesNegativeTest-997918195 tempest-VolumesNegativeTest-997918195-project] Action: 'create', calling method: .version_select at 0x7fccf6062820>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-637978478", "metadata": {"Type": "work"}}} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:57:33.262148 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-a5174aca-34c6-49ac-804e-d016df363b4b tempest-VolumesNegativeTest-997918195 tempest-VolumesNegativeTest-997918195-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=116267) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 01 01:57:33.262985 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-a5174aca-34c6-49ac-804e-d016df363b4b tempest-VolumesNegativeTest-997918195 tempest-VolumesNegativeTest-997918195-project] 10.222.0.47 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.006737 Nov 01 01:57:33.264220 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1607/3118] 10.222.0.47 () {60 vars in 1155 bytes} [Mon Nov 1 01:57:33 2021] POST /compute/v2.1/os-volumes => generated 121 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Nov 01 01:57:33.277817 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-2a259182-11a8-475f-8a99-3bcf68dc1cc9 tempest-VolumesNegativeTest-997918195 tempest-VolumesNegativeTest-997918195-project] Calling method '.version_select at 0x7fccf69a1280>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:57:33.399853 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.wsgi [None req-2a259182-11a8-475f-8a99-3bcf68dc1cc9 tempest-VolumesNegativeTest-997918195 tempest-VolumesNegativeTest-997918195-project] HTTP exception thrown: Volume tempest-invalid-1003626371 could not be found. Nov 01 01:57:33.400442 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-2a259182-11a8-475f-8a99-3bcf68dc1cc9 tempest-VolumesNegativeTest-997918195 tempest-VolumesNegativeTest-997918195-project] Returning 404 to user: Volume tempest-invalid-1003626371 could not be found. {{(pid=116266) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 01 01:57:33.401246 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-2a259182-11a8-475f-8a99-3bcf68dc1cc9 tempest-VolumesNegativeTest-997918195 tempest-VolumesNegativeTest-997918195-project] 10.222.0.47 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1003626371" status: 404 len: 99 microversion: 2.1 time: 0.130052 Nov 01 01:57:33.401813 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1512/3119] 10.222.0.47 () {58 vars in 1217 bytes} [Mon Nov 1 01:57:33 2021] DELETE /compute/v2.1/os-volumes/tempest-invalid-1003626371 => generated 99 bytes in 133 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 01 01:57:33.411192 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-73b2a6c5-b84d-40e0-ad6e-dc6ae7de7d74 tempest-VolumesNegativeTest-997918195 tempest-VolumesNegativeTest-997918195-project] 10.222.0.47 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003507 Nov 01 01:57:33.411686 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1608/3120] 10.222.0.47 () {58 vars in 1139 bytes} [Mon Nov 1 01:57:33 2021] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Nov 01 01:57:33.419442 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-95f22a2f-1195-402f-b2a5-fdbc5ae36a3f tempest-VolumesNegativeTest-997918195 tempest-VolumesNegativeTest-997918195-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003371 Nov 01 01:57:33.419916 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1513/3121] 10.222.0.47 () {58 vars in 1136 bytes} [Mon Nov 1 01:57:33 2021] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 4 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Nov 01 01:57:33.427949 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-8c3a68ad-efef-462d-962a-b56ae8e99ae0 tempest-VolumesNegativeTest-997918195 tempest-VolumesNegativeTest-997918195-project] Calling method '.version_select at 0x7fccf634b1f0>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:57:33.454395 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.wsgi [None req-8c3a68ad-efef-462d-962a-b56ae8e99ae0 tempest-VolumesNegativeTest-997918195 tempest-VolumesNegativeTest-997918195-project] HTTP exception thrown: Volume e1464404-5866-476a-bb81-5e425410f8b1 could not be found. Nov 01 01:57:33.455004 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-8c3a68ad-efef-462d-962a-b56ae8e99ae0 tempest-VolumesNegativeTest-997918195 tempest-VolumesNegativeTest-997918195-project] Returning 404 to user: Volume e1464404-5866-476a-bb81-5e425410f8b1 could not be found. {{(pid=116267) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 01 01:57:33.455811 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-8c3a68ad-efef-462d-962a-b56ae8e99ae0 tempest-VolumesNegativeTest-997918195 tempest-VolumesNegativeTest-997918195-project] 10.222.0.47 "DELETE /compute/v2.1/os-volumes/e1464404-5866-476a-bb81-5e425410f8b1" status: 404 len: 109 microversion: 2.1 time: 0.031390 Nov 01 01:57:33.456329 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1609/3122] 10.222.0.47 () {58 vars in 1247 bytes} [Mon Nov 1 01:57:33 2021] DELETE /compute/v2.1/os-volumes/e1464404-5866-476a-bb81-5e425410f8b1 => generated 109 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 01:57:33.464830 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-6eb0b23d-64cb-47ef-9bcb-6be19afc327f tempest-VolumesNegativeTest-997918195 tempest-VolumesNegativeTest-997918195-project] Calling method '.version_select at 0x7fccfb0ce0d0>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:57:33.490190 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.wsgi [None req-6eb0b23d-64cb-47ef-9bcb-6be19afc327f tempest-VolumesNegativeTest-997918195 tempest-VolumesNegativeTest-997918195-project] HTTP exception thrown: Volume f83c7ee9-8104-496a-b7e5-4d38845c7964 could not be found. Nov 01 01:57:33.490784 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-6eb0b23d-64cb-47ef-9bcb-6be19afc327f tempest-VolumesNegativeTest-997918195 tempest-VolumesNegativeTest-997918195-project] Returning 404 to user: Volume f83c7ee9-8104-496a-b7e5-4d38845c7964 could not be found. {{(pid=116266) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 01 01:57:33.491577 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-6eb0b23d-64cb-47ef-9bcb-6be19afc327f tempest-VolumesNegativeTest-997918195 tempest-VolumesNegativeTest-997918195-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/f83c7ee9-8104-496a-b7e5-4d38845c7964" status: 404 len: 109 microversion: 2.1 time: 0.030350 Nov 01 01:57:33.492074 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1514/3123] 10.222.0.47 () {58 vars in 1244 bytes} [Mon Nov 1 01:57:33 2021] GET /compute/v2.1/os-volumes/f83c7ee9-8104-496a-b7e5-4d38845c7964 => generated 109 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 01:57:44.250389 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-e5389750-35c3-4e4c-a4a9-bd3a132c6d72 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:57:44.252185 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-e5389750-35c3-4e4c-a4a9-bd3a132c6d72 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: 6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:57:44.258093 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e5389750-35c3-4e4c-a4a9-bd3a132c6d72 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:57:44.258650 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e5389750-35c3-4e4c-a4a9-bd3a132c6d72 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:57:44.259522 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e5389750-35c3-4e4c-a4a9-bd3a132c6d72 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:57:44.260002 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e5389750-35c3-4e4c-a4a9-bd3a132c6d72 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:57:44.288557 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-e5389750-35c3-4e4c-a4a9-bd3a132c6d72 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "GET /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad/os-volume_attachments/407816f4-1adb-4587-91d3-3c8f99790bbd" status: 200 len: 194 microversion: 2.20 time: 0.042521 Nov 01 01:57:44.289134 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1610/3124] 10.222.0.47 () {60 vars in 1453 bytes} [Mon Nov 1 01:57:44 2021] GET /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad/os-volume_attachments/407816f4-1adb-4587-91d3-3c8f99790bbd => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 01 01:57:44.348534 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-3ee5e438-66ac-42f7-a43e-9e15e6d04b18 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:57:44.349919 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-3ee5e438-66ac-42f7-a43e-9e15e6d04b18 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: 6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:57:44.354991 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3ee5e438-66ac-42f7-a43e-9e15e6d04b18 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:57:44.355438 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3ee5e438-66ac-42f7-a43e-9e15e6d04b18 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:57:44.356221 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3ee5e438-66ac-42f7-a43e-9e15e6d04b18 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:57:44.356653 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3ee5e438-66ac-42f7-a43e-9e15e6d04b18 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:57:44.435565 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.objects.instance [None req-3ee5e438-66ac-42f7-a43e-9e15e6d04b18 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lazy-loading 'services' on Instance uuid 6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad {{(pid=116266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 01 01:57:44.700048 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-3ee5e438-66ac-42f7-a43e-9e15e6d04b18 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "DELETE /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad/os-volume_attachments/407816f4-1adb-4587-91d3-3c8f99790bbd" status: 202 len: 0 microversion: 2.20 time: 0.356414 Nov 01 01:57:44.700671 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1515/3125] 10.222.0.47 () {60 vars in 1456 bytes} [Mon Nov 1 01:57:44 2021] DELETE /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad/os-volume_attachments/407816f4-1adb-4587-91d3-3c8f99790bbd => generated 0 bytes in 358 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 01 01:57:44.709826 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-687e6ab5-af0b-4525-b6df-8106695cd70b tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:57:44.710886 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-687e6ab5-af0b-4525-b6df-8106695cd70b tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: 6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:57:44.716786 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-687e6ab5-af0b-4525-b6df-8106695cd70b tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:57:44.717233 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-687e6ab5-af0b-4525-b6df-8106695cd70b tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:57:44.717991 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-687e6ab5-af0b-4525-b6df-8106695cd70b tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:57:44.718436 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-687e6ab5-af0b-4525-b6df-8106695cd70b tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:57:44.747793 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-687e6ab5-af0b-4525-b6df-8106695cd70b tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "GET /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042514 Nov 01 01:57:44.748339 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1611/3126] 10.222.0.47 () {60 vars in 1342 bytes} [Mon Nov 1 01:57:44 2021] GET /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 01 01:57:45.760217 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-f0234720-65f1-40c6-960e-d280eb96a6ab tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:57:45.761244 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-f0234720-65f1-40c6-960e-d280eb96a6ab tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: 6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:57:45.767257 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f0234720-65f1-40c6-960e-d280eb96a6ab tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:57:45.767695 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f0234720-65f1-40c6-960e-d280eb96a6ab tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:57:45.768440 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f0234720-65f1-40c6-960e-d280eb96a6ab tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:57:45.768864 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f0234720-65f1-40c6-960e-d280eb96a6ab tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:57:45.796022 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-f0234720-65f1-40c6-960e-d280eb96a6ab tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "GET /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040283 Nov 01 01:57:45.796503 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1516/3127] 10.222.0.47 () {60 vars in 1342 bytes} [Mon Nov 1 01:57:45 2021] GET /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 01 01:57:46.808265 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-5d851a33-6471-4bf8-a4bb-40206a284960 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:57:46.809176 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-5d851a33-6471-4bf8-a4bb-40206a284960 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: 6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:57:46.815447 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-5d851a33-6471-4bf8-a4bb-40206a284960 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:57:46.815900 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-5d851a33-6471-4bf8-a4bb-40206a284960 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:57:46.816638 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-5d851a33-6471-4bf8-a4bb-40206a284960 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:57:46.817070 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-5d851a33-6471-4bf8-a4bb-40206a284960 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:57:46.845776 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-5d851a33-6471-4bf8-a4bb-40206a284960 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "GET /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.040737 Nov 01 01:57:46.846324 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1612/3128] 10.222.0.47 () {60 vars in 1342 bytes} [Mon Nov 1 01:57:46 2021] GET /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:57:46.903048 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-3618bb10-48aa-4651-93a4-be638d68efd3 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:57:46.903544 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-3618bb10-48aa-4651-93a4-be638d68efd3 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: 6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:57:46.909670 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3618bb10-48aa-4651-93a4-be638d68efd3 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:57:46.910116 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3618bb10-48aa-4651-93a4-be638d68efd3 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:57:46.912726 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3618bb10-48aa-4651-93a4-be638d68efd3 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:57:46.913162 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-3618bb10-48aa-4651-93a4-be638d68efd3 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:57:46.941801 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-3618bb10-48aa-4651-93a4-be638d68efd3 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: 6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad] Going to try to terminate instance {{(pid=116266) delete /opt/stack/nova/nova/compute/api.py:2612}} Nov 01 01:57:47.303412 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-3618bb10-48aa-4651-93a4-be638d68efd3 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "DELETE /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad" status: 204 len: 0 microversion: 2.20 time: 0.403674 Nov 01 01:57:47.304015 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1517/3129] 10.222.0.47 () {60 vars in 1279 bytes} [Mon Nov 1 01:57:46 2021] DELETE /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad => generated 0 bytes in 405 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 01 01:57:47.311905 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-30d69bd3-82f3-430b-a018-3105ecb83548 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:57:47.312558 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-30d69bd3-82f3-430b-a018-3105ecb83548 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: 6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:57:47.321164 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-30d69bd3-82f3-430b-a018-3105ecb83548 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:57:47.321918 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-30d69bd3-82f3-430b-a018-3105ecb83548 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:57:47.322739 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-30d69bd3-82f3-430b-a018-3105ecb83548 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:57:47.323179 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-30d69bd3-82f3-430b-a018-3105ecb83548 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:57:47.446373 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-30d69bd3-82f3-430b-a018-3105ecb83548 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:57:47.454180 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-30d69bd3-82f3-430b-a018-3105ecb83548 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:57:47.456207 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-30d69bd3-82f3-430b-a018-3105ecb83548 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:57:47.457340 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-30d69bd3-82f3-430b-a018-3105ecb83548 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "GET /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad" status: 200 len: 1724 microversion: 2.20 time: 0.149091 Nov 01 01:57:47.457897 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1613/3130] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Nov 1 01:57:47 2021] GET /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad => generated 1724 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 01:57:48.477289 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-a36ed95d-8d13-4f80-b00f-8e4b6118812c tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:57:48.477984 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-a36ed95d-8d13-4f80-b00f-8e4b6118812c tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: 6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:57:48.484240 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a36ed95d-8d13-4f80-b00f-8e4b6118812c tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:57:48.484684 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a36ed95d-8d13-4f80-b00f-8e4b6118812c tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:57:48.485445 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a36ed95d-8d13-4f80-b00f-8e4b6118812c tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:57:48.486479 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a36ed95d-8d13-4f80-b00f-8e4b6118812c tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:57:48.613892 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-a36ed95d-8d13-4f80-b00f-8e4b6118812c tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:57:48.621829 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-a36ed95d-8d13-4f80-b00f-8e4b6118812c tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:57:48.623285 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-a36ed95d-8d13-4f80-b00f-8e4b6118812c tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:57:48.624430 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-a36ed95d-8d13-4f80-b00f-8e4b6118812c tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "GET /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad" status: 200 len: 1724 microversion: 2.20 time: 0.151323 Nov 01 01:57:48.624983 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1518/3131] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Nov 1 01:57:48 2021] GET /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 01:57:49.642298 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-c09cb068-380a-49bf-9f7d-e9d695fc6897 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:57:49.646513 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-c09cb068-380a-49bf-9f7d-e9d695fc6897 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: 6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:57:49.649911 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c09cb068-380a-49bf-9f7d-e9d695fc6897 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:57:49.650449 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c09cb068-380a-49bf-9f7d-e9d695fc6897 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:57:49.651256 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c09cb068-380a-49bf-9f7d-e9d695fc6897 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:57:49.651741 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c09cb068-380a-49bf-9f7d-e9d695fc6897 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:57:49.778726 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-c09cb068-380a-49bf-9f7d-e9d695fc6897 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:57:49.786865 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-c09cb068-380a-49bf-9f7d-e9d695fc6897 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:57:49.788384 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-c09cb068-380a-49bf-9f7d-e9d695fc6897 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:57:49.789580 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-c09cb068-380a-49bf-9f7d-e9d695fc6897 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "GET /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad" status: 200 len: 1724 microversion: 2.20 time: 0.151229 Nov 01 01:57:49.790150 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1614/3132] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Nov 1 01:57:49 2021] GET /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 01:57:50.547845 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [req-74cb1040-2e1d-4bba-9ae7-333379851115 req-8b28ce69-9e7b-4ed8-a42d-e08701308d2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad", "name": "network-vif-deleted", "tag": "0d980dc6-46c5-489a-a08f-baa507ecfcdd"}]} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:57:50.550644 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 01 01:57:50.550644 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: warnings.warn(msg) Nov 01 01:57:50.558878 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [req-74cb1040-2e1d-4bba-9ae7-333379851115 req-8b28ce69-9e7b-4ed8-a42d-e08701308d2b service nova] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:57:50.560381 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [req-74cb1040-2e1d-4bba-9ae7-333379851115 req-8b28ce69-9e7b-4ed8-a42d-e08701308d2b service nova] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:57:50.571616 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.compute.server_external_events [req-74cb1040-2e1d-4bba-9ae7-333379851115 req-8b28ce69-9e7b-4ed8-a42d-e08701308d2b service nova] Creating event network-vif-deleted:0d980dc6-46c5-489a-a08f-baa507ecfcdd for instance 6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad on hv-cinder-81561 Nov 01 01:57:50.577230 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [req-74cb1040-2e1d-4bba-9ae7-333379851115 req-8b28ce69-9e7b-4ed8-a42d-e08701308d2b service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.165347 Nov 01 01:57:50.578033 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1519/3133] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Nov 1 01:57:50 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 01 01:57:50.808800 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-aaa3a2b3-d9ae-4761-ab03-f5f632fb8466 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:57:50.809418 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-aaa3a2b3-d9ae-4761-ab03-f5f632fb8466 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: 6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:57:50.816595 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-aaa3a2b3-d9ae-4761-ab03-f5f632fb8466 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:57:50.817047 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-aaa3a2b3-d9ae-4761-ab03-f5f632fb8466 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:57:50.818021 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-aaa3a2b3-d9ae-4761-ab03-f5f632fb8466 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:57:50.818482 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-aaa3a2b3-d9ae-4761-ab03-f5f632fb8466 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:57:50.849858 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-aaa3a2b3-d9ae-4761-ab03-f5f632fb8466 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:57:50.850304 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-aaa3a2b3-d9ae-4761-ab03-f5f632fb8466 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:57:50.850774 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.objects.instance [None req-aaa3a2b3-d9ae-4761-ab03-f5f632fb8466 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lazy-loading 'fault' on Instance uuid 6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad {{(pid=116267) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 01 01:57:50.894451 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-aaa3a2b3-d9ae-4761-ab03-f5f632fb8466 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:57:50.902120 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-aaa3a2b3-d9ae-4761-ab03-f5f632fb8466 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:57:50.903666 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-aaa3a2b3-d9ae-4761-ab03-f5f632fb8466 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:57:50.904815 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-aaa3a2b3-d9ae-4761-ab03-f5f632fb8466 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "GET /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad" status: 200 len: 1371 microversion: 2.20 time: 0.099905 Nov 01 01:57:50.905376 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1615/3134] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Nov 1 01:57:50 2021] GET /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad => generated 1371 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 01:57:51.925088 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-5967d5e0-8edc-4ef6-bbb8-0d5f16c0f25c tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:57:51.925777 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-5967d5e0-8edc-4ef6-bbb8-0d5f16c0f25c tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: 6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:57:51.931836 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5967d5e0-8edc-4ef6-bbb8-0d5f16c0f25c tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:57:51.932281 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5967d5e0-8edc-4ef6-bbb8-0d5f16c0f25c tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:57:51.933038 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5967d5e0-8edc-4ef6-bbb8-0d5f16c0f25c tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:57:51.933471 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5967d5e0-8edc-4ef6-bbb8-0d5f16c0f25c tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:57:51.946690 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.wsgi [None req-5967d5e0-8edc-4ef6-bbb8-0d5f16c0f25c tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] HTTP exception thrown: Instance 6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad could not be found. Nov 01 01:57:51.947267 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-5967d5e0-8edc-4ef6-bbb8-0d5f16c0f25c tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Returning 404 to user: Instance 6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad could not be found. {{(pid=116266) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 01 01:57:51.948066 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-5967d5e0-8edc-4ef6-bbb8-0d5f16c0f25c tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "GET /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad" status: 404 len: 111 microversion: 2.20 time: 0.028301 Nov 01 01:57:51.948579 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1520/3135] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Nov 1 01:57:51 2021] GET /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 01 01:57:51.957077 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-5d7c4581-c39d-48c8-8cbe-379f7210a46f tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Calling method '.version_select at 0x7fccf64bce50>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:57:52.081961 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-5d7c4581-c39d-48c8-8cbe-379f7210a46f tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-363146548" status: 204 len: 0 microversion: 2.20 time: 0.128435 Nov 01 01:57:52.082569 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1616/3136] 10.222.0.47 () {60 vars in 1258 bytes} [Mon Nov 1 01:57:51 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-363146548 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 01 01:57:53.207251 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-8b652332-e484-47a7-b97a-be6e5065ee01 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Action: 'create', calling method: .version_select at 0x7fccf69a1dc0>, body: {"keypair": {"name": "tempest-keypair-2030943824"}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:57:53.225591 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.quota [None req-8b652332-e484-47a7-b97a-be6e5065ee01 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Getting quotas for project 561a6514bbe449b2b35c20f16ffaddda. Resources: {'key_pairs'} {{(pid=116266) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 01 01:57:53.229379 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.quota [None req-8b652332-e484-47a7-b97a-be6e5065ee01 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Getting quotas for user 1828ba5acba040a38cbeb610db7952c2 and project 561a6514bbe449b2b35c20f16ffaddda. Resources: {'key_pairs'} {{(pid=116266) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 01 01:57:53.453488 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.quota [None req-8b652332-e484-47a7-b97a-be6e5065ee01 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Getting quotas for project 561a6514bbe449b2b35c20f16ffaddda. Resources: {'key_pairs'} {{(pid=116266) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 01 01:57:53.457111 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.quota [None req-8b652332-e484-47a7-b97a-be6e5065ee01 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Getting quotas for user 1828ba5acba040a38cbeb610db7952c2 and project 561a6514bbe449b2b35c20f16ffaddda. Resources: {'key_pairs'} {{(pid=116266) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 01 01:57:53.469461 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-8b652332-e484-47a7-b97a-be6e5065ee01 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 201 len: 2320 microversion: 2.20 time: 0.266530 Nov 01 01:57:53.470079 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1521/3137] 10.222.0.47 () {62 vars in 1198 bytes} [Mon Nov 1 01:57:53 2021] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 268 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Nov 01 01:57:55.954154 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-2cc570b9-6eeb-43f5-8a30-fe4314529c60 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1790533160", "imageRef": "b9068d8d-b02d-4043-9f0c-3d774cb372b3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "85b31de6-bb92-45e7-936a-0c2a3c2bb592"}], "security_groups": [{"name": "tempest-securitygroup--810902816"}], "key_name": "tempest-keypair-2030943824", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:57:56.046468 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.network.neutron [None req-2cc570b9-6eeb-43f5-8a30-fe4314529c60 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] validate_networks() for [('85b31de6-bb92-45e7-936a-0c2a3c2bb592', None, None, None, None, None)] {{(pid=116267) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Nov 01 01:57:56.406988 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.virt.hardware [None req-2cc570b9-6eeb-43f5-8a30-fe4314529c60 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Flavor limits 0:0:0 {{(pid=116267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 01 01:57:56.407440 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.virt.hardware [None req-2cc570b9-6eeb-43f5-8a30-fe4314529c60 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Image limits 0:0:0 {{(pid=116267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 01 01:57:56.408041 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.virt.hardware [None req-2cc570b9-6eeb-43f5-8a30-fe4314529c60 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Flavor pref 0:0:0 {{(pid=116267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 01 01:57:56.408363 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.virt.hardware [None req-2cc570b9-6eeb-43f5-8a30-fe4314529c60 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Image pref 0:0:0 {{(pid=116267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 01 01:57:56.408774 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.virt.hardware [None req-2cc570b9-6eeb-43f5-8a30-fe4314529c60 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 01 01:57:56.421101 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-2cc570b9-6eeb-43f5-8a30-fe4314529c60 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:57:56.421549 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-2cc570b9-6eeb-43f5-8a30-fe4314529c60 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:57:56.422347 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-2cc570b9-6eeb-43f5-8a30-fe4314529c60 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:57:56.422813 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-2cc570b9-6eeb-43f5-8a30-fe4314529c60 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:57:56.440139 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.quota [None req-2cc570b9-6eeb-43f5-8a30-fe4314529c60 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Getting quotas for project 561a6514bbe449b2b35c20f16ffaddda. Resources: {'instances', 'cores', 'ram'} {{(pid=116267) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 01 01:57:56.444164 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.quota [None req-2cc570b9-6eeb-43f5-8a30-fe4314529c60 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Getting quotas for user 1828ba5acba040a38cbeb610db7952c2 and project 561a6514bbe449b2b35c20f16ffaddda. Resources: {'instances', 'cores', 'ram'} {{(pid=116267) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 01 01:57:56.454881 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-2cc570b9-6eeb-43f5-8a30-fe4314529c60 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Going to run 1 instances... {{(pid=116267) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 01 01:57:56.457170 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-2cc570b9-6eeb-43f5-8a30-fe4314529c60 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: ba8a1bd2-a708-4b49-a89b-8c9b61ab418f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b9068d8d-b02d-4043-9f0c-3d774cb372b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116267) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 01 01:57:56.839241 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-2cc570b9-6eeb-43f5-8a30-fe4314529c60 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.889729 Nov 01 01:57:56.839885 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1617/3138] 10.222.0.47 () {62 vars in 1187 bytes} [Mon Nov 1 01:57:55 2021] POST /compute/v2.1/servers => generated 401 bytes in 891 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 01 01:57:56.850672 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-da174ca9-335f-4eb3-bf02-2248b250bcbf tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:57:56.851278 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-da174ca9-335f-4eb3-bf02-2248b250bcbf tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: ba8a1bd2-a708-4b49-a89b-8c9b61ab418f] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:57:56.902759 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-da174ca9-335f-4eb3-bf02-2248b250bcbf tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:57:56.910269 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-da174ca9-335f-4eb3-bf02-2248b250bcbf tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:57:56.911801 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-da174ca9-335f-4eb3-bf02-2248b250bcbf tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:57:56.912923 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-da174ca9-335f-4eb3-bf02-2248b250bcbf tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "GET /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f" status: 200 len: 1282 microversion: 2.20 time: 0.066536 Nov 01 01:57:56.913468 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1522/3139] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Nov 1 01:57:56 2021] GET /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f => generated 1282 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 01:57:57.931686 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-258986d7-f159-4e64-8989-339590c537be tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:57:57.932287 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-258986d7-f159-4e64-8989-339590c537be tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: ba8a1bd2-a708-4b49-a89b-8c9b61ab418f] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:57:57.986367 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-258986d7-f159-4e64-8989-339590c537be tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:57:57.994028 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-258986d7-f159-4e64-8989-339590c537be tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:57:57.995558 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-258986d7-f159-4e64-8989-339590c537be tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:57:57.996628 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-258986d7-f159-4e64-8989-339590c537be tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "GET /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f" status: 200 len: 1282 microversion: 2.20 time: 0.069103 Nov 01 01:57:57.997162 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1618/3140] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Nov 1 01:57:57 2021] GET /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f => generated 1282 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 01:57:59.014207 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-a7643848-8bcf-4c4f-8d42-127172cde3c0 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:57:59.017719 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-a7643848-8bcf-4c4f-8d42-127172cde3c0 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: ba8a1bd2-a708-4b49-a89b-8c9b61ab418f] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:57:59.067850 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-a7643848-8bcf-4c4f-8d42-127172cde3c0 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:57:59.074918 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-a7643848-8bcf-4c4f-8d42-127172cde3c0 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:57:59.076423 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-a7643848-8bcf-4c4f-8d42-127172cde3c0 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:57:59.077507 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-a7643848-8bcf-4c4f-8d42-127172cde3c0 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "GET /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f" status: 200 len: 1282 microversion: 2.20 time: 0.067031 Nov 01 01:57:59.078055 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1523/3141] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Nov 1 01:57:59 2021] GET /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f => generated 1282 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 01:58:00.095196 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-1f96aafe-76c4-4238-af69-02e46ca078eb tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:58:00.095804 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-1f96aafe-76c4-4238-af69-02e46ca078eb tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: ba8a1bd2-a708-4b49-a89b-8c9b61ab418f] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:58:00.147379 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-1f96aafe-76c4-4238-af69-02e46ca078eb tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:58:00.158493 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-1f96aafe-76c4-4238-af69-02e46ca078eb tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:58:00.158493 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-1f96aafe-76c4-4238-af69-02e46ca078eb tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:58:00.158493 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-1f96aafe-76c4-4238-af69-02e46ca078eb tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "GET /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f" status: 200 len: 1282 microversion: 2.20 time: 0.065511 Nov 01 01:58:00.158885 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1619/3142] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Nov 1 01:58:00 2021] GET /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f => generated 1282 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 01:58:01.175339 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-e73b358f-7cda-4fae-8496-23118b739f25 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:58:01.175934 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-e73b358f-7cda-4fae-8496-23118b739f25 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: ba8a1bd2-a708-4b49-a89b-8c9b61ab418f] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:58:01.182694 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e73b358f-7cda-4fae-8496-23118b739f25 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:58:01.183135 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e73b358f-7cda-4fae-8496-23118b739f25 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:58:01.183887 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e73b358f-7cda-4fae-8496-23118b739f25 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:58:01.184387 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e73b358f-7cda-4fae-8496-23118b739f25 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:58:01.242738 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-e73b358f-7cda-4fae-8496-23118b739f25 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:58:01.250390 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-e73b358f-7cda-4fae-8496-23118b739f25 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:58:01.251895 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-e73b358f-7cda-4fae-8496-23118b739f25 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:58:01.253555 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-e73b358f-7cda-4fae-8496-23118b739f25 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "GET /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f" status: 200 len: 1286 microversion: 2.20 time: 0.082136 Nov 01 01:58:01.254143 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1524/3143] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Nov 1 01:58:01 2021] GET /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f => generated 1286 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 01:58:02.271204 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-c74e90df-7cee-4331-b748-45e9aaa5b41d tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:58:02.271798 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-c74e90df-7cee-4331-b748-45e9aaa5b41d tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: ba8a1bd2-a708-4b49-a89b-8c9b61ab418f] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:58:02.278531 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c74e90df-7cee-4331-b748-45e9aaa5b41d tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:58:02.279839 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c74e90df-7cee-4331-b748-45e9aaa5b41d tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:58:02.279839 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c74e90df-7cee-4331-b748-45e9aaa5b41d tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:58:02.280138 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c74e90df-7cee-4331-b748-45e9aaa5b41d tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:58:02.337980 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-c74e90df-7cee-4331-b748-45e9aaa5b41d tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:58:02.346718 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-c74e90df-7cee-4331-b748-45e9aaa5b41d tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:58:02.348275 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-c74e90df-7cee-4331-b748-45e9aaa5b41d tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:58:02.349415 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-c74e90df-7cee-4331-b748-45e9aaa5b41d tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "GET /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f" status: 200 len: 1278 microversion: 2.20 time: 0.082583 Nov 01 01:58:02.349998 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1620/3144] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Nov 1 01:58:02 2021] GET /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f => generated 1278 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 01:58:03.372034 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-84ade0a6-2f4d-4512-9c22-866cdeae6ce2 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:58:03.372034 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-84ade0a6-2f4d-4512-9c22-866cdeae6ce2 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: ba8a1bd2-a708-4b49-a89b-8c9b61ab418f] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:58:03.374954 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-84ade0a6-2f4d-4512-9c22-866cdeae6ce2 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:58:03.375403 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-84ade0a6-2f4d-4512-9c22-866cdeae6ce2 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:58:03.376174 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-84ade0a6-2f4d-4512-9c22-866cdeae6ce2 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:58:03.376602 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-84ade0a6-2f4d-4512-9c22-866cdeae6ce2 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:58:03.436493 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-84ade0a6-2f4d-4512-9c22-866cdeae6ce2 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:58:03.444060 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-84ade0a6-2f4d-4512-9c22-866cdeae6ce2 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:58:03.445533 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-84ade0a6-2f4d-4512-9c22-866cdeae6ce2 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:58:03.446640 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-84ade0a6-2f4d-4512-9c22-866cdeae6ce2 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "GET /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f" status: 200 len: 1340 microversion: 2.20 time: 0.082425 Nov 01 01:58:03.447442 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1525/3145] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Nov 1 01:58:03 2021] GET /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f => generated 1340 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 01:58:04.464979 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-db1b9f42-9bb2-44e3-a297-7430a9e2eb26 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:58:04.465730 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-db1b9f42-9bb2-44e3-a297-7430a9e2eb26 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: ba8a1bd2-a708-4b49-a89b-8c9b61ab418f] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:58:04.472569 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-db1b9f42-9bb2-44e3-a297-7430a9e2eb26 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:58:04.473107 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-db1b9f42-9bb2-44e3-a297-7430a9e2eb26 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:58:04.474147 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-db1b9f42-9bb2-44e3-a297-7430a9e2eb26 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:58:04.474978 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-db1b9f42-9bb2-44e3-a297-7430a9e2eb26 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:58:04.605993 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-db1b9f42-9bb2-44e3-a297-7430a9e2eb26 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:58:04.614285 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-db1b9f42-9bb2-44e3-a297-7430a9e2eb26 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:58:04.619942 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-db1b9f42-9bb2-44e3-a297-7430a9e2eb26 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:58:04.619942 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-db1b9f42-9bb2-44e3-a297-7430a9e2eb26 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "GET /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f" status: 200 len: 1407 microversion: 2.20 time: 0.155679 Nov 01 01:58:04.619942 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1621/3146] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Nov 1 01:58:04 2021] GET /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f => generated 1407 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 01:58:04.730323 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [req-a49c1b39-92c0-4e52-861e-b9c2acd145d4 req-bc56fb7b-e27a-4bd3-8e9e-5a4744997490 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba8a1bd2-a708-4b49-a89b-8c9b61ab418f", "tag": "639f2165-b424-447e-8ca4-13353eb4416d"}]} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:58:04.735741 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 01 01:58:04.735741 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: warnings.warn(msg) Nov 01 01:58:04.748073 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [req-a49c1b39-92c0-4e52-861e-b9c2acd145d4 req-bc56fb7b-e27a-4bd3-8e9e-5a4744997490 service nova] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:58:04.749403 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [req-a49c1b39-92c0-4e52-861e-b9c2acd145d4 req-bc56fb7b-e27a-4bd3-8e9e-5a4744997490 service nova] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:58:04.770242 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.compute.server_external_events [req-a49c1b39-92c0-4e52-861e-b9c2acd145d4 req-bc56fb7b-e27a-4bd3-8e9e-5a4744997490 service nova] Creating event network-changed:639f2165-b424-447e-8ca4-13353eb4416d for instance ba8a1bd2-a708-4b49-a89b-8c9b61ab418f on hv-cinder-81561 Nov 01 01:58:04.775806 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [req-a49c1b39-92c0-4e52-861e-b9c2acd145d4 req-bc56fb7b-e27a-4bd3-8e9e-5a4744997490 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051575 Nov 01 01:58:04.777880 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1526/3147] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Nov 1 01:58:04 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 01 01:58:05.634959 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-a8cc01af-99e8-4eab-aaff-260f484e099e tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:58:05.635504 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-a8cc01af-99e8-4eab-aaff-260f484e099e tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: ba8a1bd2-a708-4b49-a89b-8c9b61ab418f] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:58:05.641612 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a8cc01af-99e8-4eab-aaff-260f484e099e tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:58:05.642053 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a8cc01af-99e8-4eab-aaff-260f484e099e tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:58:05.642884 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a8cc01af-99e8-4eab-aaff-260f484e099e tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:58:05.643313 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a8cc01af-99e8-4eab-aaff-260f484e099e tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:58:05.760593 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-a8cc01af-99e8-4eab-aaff-260f484e099e tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:58:05.768193 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-a8cc01af-99e8-4eab-aaff-260f484e099e tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:58:05.769697 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-a8cc01af-99e8-4eab-aaff-260f484e099e tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:58:05.770792 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-a8cc01af-99e8-4eab-aaff-260f484e099e tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "GET /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f" status: 200 len: 1407 microversion: 2.20 time: 0.139581 Nov 01 01:58:05.771376 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1622/3148] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Nov 1 01:58:05 2021] GET /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f => generated 1407 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 01:58:06.789120 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-cda4e969-b706-4948-9315-2c0beb4b24b1 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:58:06.789818 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-cda4e969-b706-4948-9315-2c0beb4b24b1 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: ba8a1bd2-a708-4b49-a89b-8c9b61ab418f] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:58:06.796320 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-cda4e969-b706-4948-9315-2c0beb4b24b1 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:58:06.796771 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-cda4e969-b706-4948-9315-2c0beb4b24b1 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:58:06.797534 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-cda4e969-b706-4948-9315-2c0beb4b24b1 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:58:06.797964 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-cda4e969-b706-4948-9315-2c0beb4b24b1 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:58:06.927323 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-cda4e969-b706-4948-9315-2c0beb4b24b1 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:58:06.935189 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-cda4e969-b706-4948-9315-2c0beb4b24b1 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:58:06.936704 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-cda4e969-b706-4948-9315-2c0beb4b24b1 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:58:06.937821 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-cda4e969-b706-4948-9315-2c0beb4b24b1 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "GET /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f" status: 200 len: 1407 microversion: 2.20 time: 0.152821 Nov 01 01:58:06.938372 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1527/3149] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Nov 1 01:58:06 2021] GET /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f => generated 1407 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 01:58:07.956763 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-35c4fde5-e7b7-4893-8f27-f1d3bbf3314f tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:58:07.957360 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-35c4fde5-e7b7-4893-8f27-f1d3bbf3314f tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: ba8a1bd2-a708-4b49-a89b-8c9b61ab418f] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:58:07.963646 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-35c4fde5-e7b7-4893-8f27-f1d3bbf3314f tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:58:07.964085 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-35c4fde5-e7b7-4893-8f27-f1d3bbf3314f tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:58:07.964832 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-35c4fde5-e7b7-4893-8f27-f1d3bbf3314f tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:58:07.965253 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-35c4fde5-e7b7-4893-8f27-f1d3bbf3314f tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:58:08.086350 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-35c4fde5-e7b7-4893-8f27-f1d3bbf3314f tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:58:08.094065 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-35c4fde5-e7b7-4893-8f27-f1d3bbf3314f tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:58:08.095591 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-35c4fde5-e7b7-4893-8f27-f1d3bbf3314f tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:58:08.096687 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-35c4fde5-e7b7-4893-8f27-f1d3bbf3314f tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "GET /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f" status: 200 len: 1407 microversion: 2.20 time: 0.144208 Nov 01 01:58:08.097240 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1623/3150] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Nov 1 01:58:07 2021] GET /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f => generated 1407 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 01:58:09.114463 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-117589c3-4989-4065-9ebf-7c6ec84884bc tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:58:09.115071 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-117589c3-4989-4065-9ebf-7c6ec84884bc tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: ba8a1bd2-a708-4b49-a89b-8c9b61ab418f] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:58:09.121298 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-117589c3-4989-4065-9ebf-7c6ec84884bc tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:58:09.121737 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-117589c3-4989-4065-9ebf-7c6ec84884bc tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:58:09.122511 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-117589c3-4989-4065-9ebf-7c6ec84884bc tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:58:09.122940 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-117589c3-4989-4065-9ebf-7c6ec84884bc tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:58:09.240057 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-117589c3-4989-4065-9ebf-7c6ec84884bc tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:58:09.247691 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-117589c3-4989-4065-9ebf-7c6ec84884bc tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:58:09.249168 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-117589c3-4989-4065-9ebf-7c6ec84884bc tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:58:09.250252 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-117589c3-4989-4065-9ebf-7c6ec84884bc tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "GET /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f" status: 200 len: 1407 microversion: 2.20 time: 0.139509 Nov 01 01:58:09.250824 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1528/3151] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Nov 1 01:58:09 2021] GET /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f => generated 1407 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 01:58:10.268331 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-2f06a823-3d6d-4acc-965b-ac73b67f9730 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:58:10.268909 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-2f06a823-3d6d-4acc-965b-ac73b67f9730 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: ba8a1bd2-a708-4b49-a89b-8c9b61ab418f] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:58:10.275158 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-2f06a823-3d6d-4acc-965b-ac73b67f9730 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:58:10.275597 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-2f06a823-3d6d-4acc-965b-ac73b67f9730 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:58:10.276340 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-2f06a823-3d6d-4acc-965b-ac73b67f9730 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:58:10.276759 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-2f06a823-3d6d-4acc-965b-ac73b67f9730 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:58:10.393715 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-2f06a823-3d6d-4acc-965b-ac73b67f9730 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:58:10.401375 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-2f06a823-3d6d-4acc-965b-ac73b67f9730 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:58:10.403654 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-2f06a823-3d6d-4acc-965b-ac73b67f9730 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:58:10.403942 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-2f06a823-3d6d-4acc-965b-ac73b67f9730 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "GET /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f" status: 200 len: 1407 microversion: 2.20 time: 0.139396 Nov 01 01:58:10.404496 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1624/3152] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Nov 1 01:58:10 2021] GET /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f => generated 1407 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 01:58:11.421511 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-7bbc4d6a-b024-41e7-8676-2bae11468cf1 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:58:11.422145 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-7bbc4d6a-b024-41e7-8676-2bae11468cf1 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: ba8a1bd2-a708-4b49-a89b-8c9b61ab418f] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:58:11.428878 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7bbc4d6a-b024-41e7-8676-2bae11468cf1 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:58:11.429326 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7bbc4d6a-b024-41e7-8676-2bae11468cf1 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:58:11.430081 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7bbc4d6a-b024-41e7-8676-2bae11468cf1 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:58:11.430542 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7bbc4d6a-b024-41e7-8676-2bae11468cf1 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:58:11.553128 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-7bbc4d6a-b024-41e7-8676-2bae11468cf1 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:58:11.560852 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-7bbc4d6a-b024-41e7-8676-2bae11468cf1 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:58:11.562611 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-7bbc4d6a-b024-41e7-8676-2bae11468cf1 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:58:11.563705 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-7bbc4d6a-b024-41e7-8676-2bae11468cf1 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "GET /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f" status: 200 len: 1407 microversion: 2.20 time: 0.145975 Nov 01 01:58:11.574825 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1529/3153] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Nov 1 01:58:11 2021] GET /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f => generated 1407 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 01:58:12.582600 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-c1f5b8ce-fe85-453d-8abc-b50176817f03 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:58:12.583202 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-c1f5b8ce-fe85-453d-8abc-b50176817f03 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: ba8a1bd2-a708-4b49-a89b-8c9b61ab418f] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:58:12.589314 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c1f5b8ce-fe85-453d-8abc-b50176817f03 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:58:12.589751 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c1f5b8ce-fe85-453d-8abc-b50176817f03 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:58:12.590519 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c1f5b8ce-fe85-453d-8abc-b50176817f03 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:58:12.590942 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c1f5b8ce-fe85-453d-8abc-b50176817f03 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:58:12.717001 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-c1f5b8ce-fe85-453d-8abc-b50176817f03 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:58:12.724868 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-c1f5b8ce-fe85-453d-8abc-b50176817f03 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:58:12.726371 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-c1f5b8ce-fe85-453d-8abc-b50176817f03 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:58:12.727577 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-c1f5b8ce-fe85-453d-8abc-b50176817f03 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "GET /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f" status: 200 len: 1407 microversion: 2.20 time: 0.149212 Nov 01 01:58:12.728145 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1625/3154] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Nov 1 01:58:12 2021] GET /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f => generated 1407 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 01:58:12.987349 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [req-3d03b242-7765-4381-b6d6-4abdfa99ca93 req-e23eaf8c-fef8-40c6-8864-f1439ba0b1b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba8a1bd2-a708-4b49-a89b-8c9b61ab418f", "name": "network-vif-plugged", "status": "completed", "tag": "639f2165-b424-447e-8ca4-13353eb4416d"}]} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:58:12.989376 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 01 01:58:12.989376 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: warnings.warn(msg) Nov 01 01:58:12.996716 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [req-3d03b242-7765-4381-b6d6-4abdfa99ca93 req-e23eaf8c-fef8-40c6-8864-f1439ba0b1b0 service nova] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:58:13.001315 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [req-3d03b242-7765-4381-b6d6-4abdfa99ca93 req-e23eaf8c-fef8-40c6-8864-f1439ba0b1b0 service nova] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:58:13.008066 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.compute.server_external_events [req-3d03b242-7765-4381-b6d6-4abdfa99ca93 req-e23eaf8c-fef8-40c6-8864-f1439ba0b1b0 service nova] Creating event network-vif-plugged:639f2165-b424-447e-8ca4-13353eb4416d for instance ba8a1bd2-a708-4b49-a89b-8c9b61ab418f on hv-cinder-81561 Nov 01 01:58:13.012883 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [req-3d03b242-7765-4381-b6d6-4abdfa99ca93 req-e23eaf8c-fef8-40c6-8864-f1439ba0b1b0 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029431 Nov 01 01:58:13.013447 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1530/3155] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Nov 1 01:58:12 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:58:13.746153 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-37fe54f1-4c72-45d8-811c-93112ea66f71 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:58:13.746770 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-37fe54f1-4c72-45d8-811c-93112ea66f71 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: ba8a1bd2-a708-4b49-a89b-8c9b61ab418f] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:58:13.753168 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-37fe54f1-4c72-45d8-811c-93112ea66f71 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:58:13.753679 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-37fe54f1-4c72-45d8-811c-93112ea66f71 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:58:13.754452 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-37fe54f1-4c72-45d8-811c-93112ea66f71 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:58:13.754885 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-37fe54f1-4c72-45d8-811c-93112ea66f71 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:58:13.876492 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-37fe54f1-4c72-45d8-811c-93112ea66f71 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:58:13.884763 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-37fe54f1-4c72-45d8-811c-93112ea66f71 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:58:13.886267 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-37fe54f1-4c72-45d8-811c-93112ea66f71 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:58:13.887394 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-37fe54f1-4c72-45d8-811c-93112ea66f71 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "GET /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f" status: 200 len: 1407 microversion: 2.20 time: 0.144971 Nov 01 01:58:13.887961 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1626/3156] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Nov 1 01:58:13 2021] GET /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f => generated 1407 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 01:58:14.906014 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-cea9baaa-bac1-41cb-a3bf-7d6a74c3eecc tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:58:14.906733 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-cea9baaa-bac1-41cb-a3bf-7d6a74c3eecc tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: ba8a1bd2-a708-4b49-a89b-8c9b61ab418f] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:58:14.913380 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-cea9baaa-bac1-41cb-a3bf-7d6a74c3eecc tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:58:14.913821 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-cea9baaa-bac1-41cb-a3bf-7d6a74c3eecc tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:58:14.914618 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-cea9baaa-bac1-41cb-a3bf-7d6a74c3eecc tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:58:14.915046 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-cea9baaa-bac1-41cb-a3bf-7d6a74c3eecc tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:58:15.038408 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-cea9baaa-bac1-41cb-a3bf-7d6a74c3eecc tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:58:15.045975 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-cea9baaa-bac1-41cb-a3bf-7d6a74c3eecc tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:58:15.047483 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-cea9baaa-bac1-41cb-a3bf-7d6a74c3eecc tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:58:15.048569 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-cea9baaa-bac1-41cb-a3bf-7d6a74c3eecc tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "GET /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f" status: 200 len: 1407 microversion: 2.20 time: 0.146973 Nov 01 01:58:15.049379 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1531/3157] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Nov 1 01:58:14 2021] GET /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f => generated 1407 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 01 01:58:16.066498 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-88ebe71b-aa23-427d-88c9-033cff56cbe5 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:58:16.067100 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-88ebe71b-aa23-427d-88c9-033cff56cbe5 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: ba8a1bd2-a708-4b49-a89b-8c9b61ab418f] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:58:16.073265 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-88ebe71b-aa23-427d-88c9-033cff56cbe5 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:58:16.073702 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-88ebe71b-aa23-427d-88c9-033cff56cbe5 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:58:16.074464 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-88ebe71b-aa23-427d-88c9-033cff56cbe5 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:58:16.074891 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-88ebe71b-aa23-427d-88c9-033cff56cbe5 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:58:16.196913 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-88ebe71b-aa23-427d-88c9-033cff56cbe5 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:58:16.204648 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-88ebe71b-aa23-427d-88c9-033cff56cbe5 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:58:16.206162 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-88ebe71b-aa23-427d-88c9-033cff56cbe5 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:58:16.207322 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-88ebe71b-aa23-427d-88c9-033cff56cbe5 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "GET /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f" status: 200 len: 1599 microversion: 2.20 time: 0.144515 Nov 01 01:58:16.207870 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1627/3158] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Nov 1 01:58:16 2021] GET /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f => generated 1599 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 01:58:16.224879 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-32837739-cd55-488d-8dcf-53fd350bafd8 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:58:16.225401 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-32837739-cd55-488d-8dcf-53fd350bafd8 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: ba8a1bd2-a708-4b49-a89b-8c9b61ab418f] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:58:16.231632 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-32837739-cd55-488d-8dcf-53fd350bafd8 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:58:16.232064 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-32837739-cd55-488d-8dcf-53fd350bafd8 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:58:16.232823 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-32837739-cd55-488d-8dcf-53fd350bafd8 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:58:16.233251 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-32837739-cd55-488d-8dcf-53fd350bafd8 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:58:16.311779 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-32837739-cd55-488d-8dcf-53fd350bafd8 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "GET /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.091062 Nov 01 01:58:16.312361 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1532/3159] 10.222.0.47 () {60 vars in 1315 bytes} [Mon Nov 1 01:58:16 2021] GET /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f/os-interface => generated 285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 01 01:58:17.645535 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [req-aea19360-82a5-4a04-9703-b5656baf05cd req-bd13f138-b7a0-4cff-a8ea-5759089df487 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba8a1bd2-a708-4b49-a89b-8c9b61ab418f", "tag": "639f2165-b424-447e-8ca4-13353eb4416d"}]} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:58:17.648196 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-b4ba0528-92ce-435b-9e82-ccc08282e6bc tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:58:17.649236 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-b4ba0528-92ce-435b-9e82-ccc08282e6bc tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: ba8a1bd2-a708-4b49-a89b-8c9b61ab418f] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:58:17.650255 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 01 01:58:17.650255 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: warnings.warn(msg) Nov 01 01:58:17.660753 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b4ba0528-92ce-435b-9e82-ccc08282e6bc tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:58:17.665283 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [req-aea19360-82a5-4a04-9703-b5656baf05cd req-bd13f138-b7a0-4cff-a8ea-5759089df487 service nova] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:58:17.665846 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b4ba0528-92ce-435b-9e82-ccc08282e6bc tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:58:17.666666 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b4ba0528-92ce-435b-9e82-ccc08282e6bc tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:58:17.667318 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b4ba0528-92ce-435b-9e82-ccc08282e6bc tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:58:17.669674 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [req-aea19360-82a5-4a04-9703-b5656baf05cd req-bd13f138-b7a0-4cff-a8ea-5759089df487 service nova] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:58:17.682690 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.compute.server_external_events [req-aea19360-82a5-4a04-9703-b5656baf05cd req-bd13f138-b7a0-4cff-a8ea-5759089df487 service nova] Creating event network-changed:639f2165-b424-447e-8ca4-13353eb4416d for instance ba8a1bd2-a708-4b49-a89b-8c9b61ab418f on hv-cinder-81561 Nov 01 01:58:17.688533 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [req-aea19360-82a5-4a04-9703-b5656baf05cd req-bd13f138-b7a0-4cff-a8ea-5759089df487 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046533 Nov 01 01:58:17.691561 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1533/3160] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Nov 1 01:58:17 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:58:17.765803 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-b4ba0528-92ce-435b-9e82-ccc08282e6bc tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "POST /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f/action" status: 200 len: 14 microversion: 2.20 time: 0.127654 Nov 01 01:58:17.770171 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1628/3161] 10.222.0.47 () {62 vars in 1318 bytes} [Mon Nov 1 01:58:17 2021] POST /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f/action => generated 14 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:58:18.779180 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-722d877f-4bdc-4bf3-a21a-509dd0c9b997 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:58:18.780342 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-722d877f-4bdc-4bf3-a21a-509dd0c9b997 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: ba8a1bd2-a708-4b49-a89b-8c9b61ab418f] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:58:18.787782 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-722d877f-4bdc-4bf3-a21a-509dd0c9b997 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:58:18.788854 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-722d877f-4bdc-4bf3-a21a-509dd0c9b997 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:58:18.789632 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-722d877f-4bdc-4bf3-a21a-509dd0c9b997 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:58:18.790059 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-722d877f-4bdc-4bf3-a21a-509dd0c9b997 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:58:18.867972 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-722d877f-4bdc-4bf3-a21a-509dd0c9b997 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "POST /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f/action" status: 200 len: 14 microversion: 2.20 time: 0.093563 Nov 01 01:58:18.868739 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1534/3162] 10.222.0.47 () {62 vars in 1318 bytes} [Mon Nov 1 01:58:18 2021] POST /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f/action => generated 14 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:58:19.879377 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-a6fa9ce1-24e7-4bfb-b66d-f6805eeaa144 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:58:19.880877 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-a6fa9ce1-24e7-4bfb-b66d-f6805eeaa144 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: ba8a1bd2-a708-4b49-a89b-8c9b61ab418f] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:58:19.887778 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a6fa9ce1-24e7-4bfb-b66d-f6805eeaa144 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:58:19.888163 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a6fa9ce1-24e7-4bfb-b66d-f6805eeaa144 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:58:19.888919 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a6fa9ce1-24e7-4bfb-b66d-f6805eeaa144 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:58:19.889343 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a6fa9ce1-24e7-4bfb-b66d-f6805eeaa144 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:58:19.971856 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-a6fa9ce1-24e7-4bfb-b66d-f6805eeaa144 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "POST /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f/action" status: 200 len: 14 microversion: 2.20 time: 0.096472 Nov 01 01:58:19.972619 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1629/3163] 10.222.0.47 () {62 vars in 1318 bytes} [Mon Nov 1 01:58:19 2021] POST /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f/action => generated 14 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:58:20.983172 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-d4c3752b-ef46-4620-8468-1b00696762da tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:58:20.984245 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-d4c3752b-ef46-4620-8468-1b00696762da tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: ba8a1bd2-a708-4b49-a89b-8c9b61ab418f] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:58:20.991155 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d4c3752b-ef46-4620-8468-1b00696762da tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:58:20.991595 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d4c3752b-ef46-4620-8468-1b00696762da tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:58:20.992343 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d4c3752b-ef46-4620-8468-1b00696762da tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:58:20.992768 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d4c3752b-ef46-4620-8468-1b00696762da tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:58:21.076175 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-d4c3752b-ef46-4620-8468-1b00696762da tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "POST /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f/action" status: 200 len: 14 microversion: 2.20 time: 0.096884 Nov 01 01:58:21.076957 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1535/3164] 10.222.0.47 () {62 vars in 1318 bytes} [Mon Nov 1 01:58:20 2021] POST /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f/action => generated 14 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:58:22.089027 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-9b982e8c-3db7-40d8-84f8-99649d3932c8 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:58:22.090360 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-9b982e8c-3db7-40d8-84f8-99649d3932c8 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: ba8a1bd2-a708-4b49-a89b-8c9b61ab418f] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:58:22.098084 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9b982e8c-3db7-40d8-84f8-99649d3932c8 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:58:22.099281 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9b982e8c-3db7-40d8-84f8-99649d3932c8 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:58:22.100802 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9b982e8c-3db7-40d8-84f8-99649d3932c8 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:58:22.101354 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9b982e8c-3db7-40d8-84f8-99649d3932c8 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:58:22.185606 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-9b982e8c-3db7-40d8-84f8-99649d3932c8 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "POST /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f/action" status: 200 len: 14 microversion: 2.20 time: 0.102010 Nov 01 01:58:22.186247 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1630/3165] 10.222.0.47 () {62 vars in 1318 bytes} [Mon Nov 1 01:58:22 2021] POST /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f/action => generated 14 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:58:23.198943 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-f64b9eea-7ba9-4b8c-b76e-451d4bb446af tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:58:23.199947 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-f64b9eea-7ba9-4b8c-b76e-451d4bb446af tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: ba8a1bd2-a708-4b49-a89b-8c9b61ab418f] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:58:23.206747 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f64b9eea-7ba9-4b8c-b76e-451d4bb446af tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:58:23.207204 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f64b9eea-7ba9-4b8c-b76e-451d4bb446af tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:58:23.208546 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f64b9eea-7ba9-4b8c-b76e-451d4bb446af tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:58:23.208968 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f64b9eea-7ba9-4b8c-b76e-451d4bb446af tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:58:23.287012 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-f64b9eea-7ba9-4b8c-b76e-451d4bb446af tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "POST /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f/action" status: 200 len: 14 microversion: 2.20 time: 0.093140 Nov 01 01:58:23.287530 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1536/3166] 10.222.0.47 () {62 vars in 1318 bytes} [Mon Nov 1 01:58:23 2021] POST /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f/action => generated 14 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:58:24.297968 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-f18ccc73-ad6e-493e-9b8d-9ed937747779 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:58:24.299197 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-f18ccc73-ad6e-493e-9b8d-9ed937747779 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: ba8a1bd2-a708-4b49-a89b-8c9b61ab418f] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:58:24.306592 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f18ccc73-ad6e-493e-9b8d-9ed937747779 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:58:24.307040 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f18ccc73-ad6e-493e-9b8d-9ed937747779 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:58:24.307788 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f18ccc73-ad6e-493e-9b8d-9ed937747779 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:58:24.308210 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f18ccc73-ad6e-493e-9b8d-9ed937747779 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:58:24.388684 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-f18ccc73-ad6e-493e-9b8d-9ed937747779 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "POST /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f/action" status: 200 len: 14 microversion: 2.20 time: 0.094619 Nov 01 01:58:24.389318 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1631/3167] 10.222.0.47 () {62 vars in 1318 bytes} [Mon Nov 1 01:58:24 2021] POST /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f/action => generated 14 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:58:25.400498 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-c94fdd70-b27b-41a4-851a-76ea486414fe tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:58:25.401513 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-c94fdd70-b27b-41a4-851a-76ea486414fe tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: ba8a1bd2-a708-4b49-a89b-8c9b61ab418f] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:58:25.408343 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c94fdd70-b27b-41a4-851a-76ea486414fe tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:58:25.408796 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c94fdd70-b27b-41a4-851a-76ea486414fe tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:58:25.409561 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c94fdd70-b27b-41a4-851a-76ea486414fe tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:58:25.409995 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c94fdd70-b27b-41a4-851a-76ea486414fe tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:58:28.551992 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-c94fdd70-b27b-41a4-851a-76ea486414fe tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "POST /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f/action" status: 200 len: 14 microversion: 2.20 time: 3.155396 Nov 01 01:58:28.553138 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1537/3168] 10.222.0.47 () {62 vars in 1318 bytes} [Mon Nov 1 01:58:25 2021] POST /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f/action => generated 14 bytes in 3158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:58:29.563918 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-adc9af3b-c906-4cf3-af0d-bf9ac4604945 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:58:29.564913 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-adc9af3b-c906-4cf3-af0d-bf9ac4604945 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: ba8a1bd2-a708-4b49-a89b-8c9b61ab418f] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:58:29.572240 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-adc9af3b-c906-4cf3-af0d-bf9ac4604945 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:58:29.572677 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-adc9af3b-c906-4cf3-af0d-bf9ac4604945 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:58:29.573415 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-adc9af3b-c906-4cf3-af0d-bf9ac4604945 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:58:29.573835 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-adc9af3b-c906-4cf3-af0d-bf9ac4604945 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:58:29.655753 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-adc9af3b-c906-4cf3-af0d-bf9ac4604945 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "POST /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f/action" status: 200 len: 14 microversion: 2.20 time: 0.095725 Nov 01 01:58:29.656284 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1632/3169] 10.222.0.47 () {62 vars in 1318 bytes} [Mon Nov 1 01:58:29 2021] POST /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f/action => generated 14 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 01:58:30.666974 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-85187fef-2521-4eea-ad13-ba4be61aac86 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:58:30.667902 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-85187fef-2521-4eea-ad13-ba4be61aac86 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: ba8a1bd2-a708-4b49-a89b-8c9b61ab418f] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:58:30.675529 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-85187fef-2521-4eea-ad13-ba4be61aac86 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:58:30.675972 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-85187fef-2521-4eea-ad13-ba4be61aac86 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:58:30.676803 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-85187fef-2521-4eea-ad13-ba4be61aac86 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:58:30.677226 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-85187fef-2521-4eea-ad13-ba4be61aac86 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:58:30.772737 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-85187fef-2521-4eea-ad13-ba4be61aac86 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "POST /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f/action" status: 200 len: 6656 microversion: 2.20 time: 0.109810 Nov 01 01:58:30.774265 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1538/3170] 10.222.0.47 () {62 vars in 1318 bytes} [Mon Nov 1 01:58:30 2021] POST /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f/action => generated 6656 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 01:58:31.784430 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-ef214d93-5e82-483a-a056-2b8cde460c44 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:58:31.785429 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-ef214d93-5e82-483a-a056-2b8cde460c44 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: ba8a1bd2-a708-4b49-a89b-8c9b61ab418f] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:58:31.792305 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ef214d93-5e82-483a-a056-2b8cde460c44 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:58:31.792753 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ef214d93-5e82-483a-a056-2b8cde460c44 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:58:31.793508 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ef214d93-5e82-483a-a056-2b8cde460c44 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:58:31.793938 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ef214d93-5e82-483a-a056-2b8cde460c44 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:58:31.884319 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-ef214d93-5e82-483a-a056-2b8cde460c44 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "POST /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f/action" status: 200 len: 15025 microversion: 2.20 time: 0.101139 Nov 01 01:58:31.884319 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1633/3171] 10.222.0.47 () {62 vars in 1318 bytes} [Mon Nov 1 01:58:31 2021] POST /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f/action => generated 15025 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 01 01:58:32.893661 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-46afd03d-54b1-47f2-99f0-cbc14bd79c6f tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:58:32.894718 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-46afd03d-54b1-47f2-99f0-cbc14bd79c6f tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: ba8a1bd2-a708-4b49-a89b-8c9b61ab418f] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:58:32.902113 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-46afd03d-54b1-47f2-99f0-cbc14bd79c6f tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:58:32.902595 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-46afd03d-54b1-47f2-99f0-cbc14bd79c6f tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:58:32.903348 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-46afd03d-54b1-47f2-99f0-cbc14bd79c6f tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:58:32.903777 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-46afd03d-54b1-47f2-99f0-cbc14bd79c6f tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:58:32.998616 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-46afd03d-54b1-47f2-99f0-cbc14bd79c6f tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "POST /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f/action" status: 200 len: 18561 microversion: 2.20 time: 0.108816 Nov 01 01:58:33.002175 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1539/3172] 10.222.0.47 () {62 vars in 1318 bytes} [Mon Nov 1 01:58:32 2021] POST /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f/action => generated 18561 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 01 01:58:34.009558 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-5dbde3b3-abd5-401d-be02-7e604db2a69a tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:58:34.014757 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-5dbde3b3-abd5-401d-be02-7e604db2a69a tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: ba8a1bd2-a708-4b49-a89b-8c9b61ab418f] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:58:34.017423 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-5dbde3b3-abd5-401d-be02-7e604db2a69a tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:58:34.017857 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-5dbde3b3-abd5-401d-be02-7e604db2a69a tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:58:34.018628 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-5dbde3b3-abd5-401d-be02-7e604db2a69a tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:58:34.019051 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-5dbde3b3-abd5-401d-be02-7e604db2a69a tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:58:34.107227 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-5dbde3b3-abd5-401d-be02-7e604db2a69a tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "POST /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f/action" status: 200 len: 20757 microversion: 2.20 time: 0.101484 Nov 01 01:58:34.107808 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1634/3173] 10.222.0.47 () {62 vars in 1318 bytes} [Mon Nov 1 01:58:34 2021] POST /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f/action => generated 20757 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 01 01:58:35.119490 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-8c5618e8-c963-4fda-943d-726bc580cd0a tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:58:35.120522 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-8c5618e8-c963-4fda-943d-726bc580cd0a tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: ba8a1bd2-a708-4b49-a89b-8c9b61ab418f] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:58:35.127588 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8c5618e8-c963-4fda-943d-726bc580cd0a tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:58:35.128038 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8c5618e8-c963-4fda-943d-726bc580cd0a tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:58:35.128812 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8c5618e8-c963-4fda-943d-726bc580cd0a tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:58:35.129242 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8c5618e8-c963-4fda-943d-726bc580cd0a tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:58:35.216598 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-8c5618e8-c963-4fda-943d-726bc580cd0a tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "POST /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f/action" status: 200 len: 22937 microversion: 2.20 time: 0.101564 Nov 01 01:58:35.217215 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1540/3174] 10.222.0.47 () {62 vars in 1318 bytes} [Mon Nov 1 01:58:35 2021] POST /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f/action => generated 22937 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 01 01:58:36.228675 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-6d6002e2-aa87-490f-ab44-36466d44602c tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:58:36.229674 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-6d6002e2-aa87-490f-ab44-36466d44602c tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: ba8a1bd2-a708-4b49-a89b-8c9b61ab418f] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:58:36.236462 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-6d6002e2-aa87-490f-ab44-36466d44602c tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:58:36.236903 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-6d6002e2-aa87-490f-ab44-36466d44602c tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:58:36.237658 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-6d6002e2-aa87-490f-ab44-36466d44602c tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:58:36.238084 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-6d6002e2-aa87-490f-ab44-36466d44602c tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:58:36.328149 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-6d6002e2-aa87-490f-ab44-36466d44602c tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "POST /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f/action" status: 200 len: 23969 microversion: 2.20 time: 0.103993 Nov 01 01:58:36.329019 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1635/3175] 10.222.0.47 () {62 vars in 1318 bytes} [Mon Nov 1 01:58:36 2021] POST /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f/action => generated 23969 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 01 01:58:37.340623 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-2524e017-836b-4bb7-b77c-58de12afc543 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:58:37.341552 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-2524e017-836b-4bb7-b77c-58de12afc543 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: ba8a1bd2-a708-4b49-a89b-8c9b61ab418f] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:58:37.348525 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2524e017-836b-4bb7-b77c-58de12afc543 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:58:37.348973 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2524e017-836b-4bb7-b77c-58de12afc543 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:58:37.349733 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2524e017-836b-4bb7-b77c-58de12afc543 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:58:37.350167 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2524e017-836b-4bb7-b77c-58de12afc543 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:58:37.440072 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-2524e017-836b-4bb7-b77c-58de12afc543 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "POST /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f/action" status: 200 len: 25756 microversion: 2.20 time: 0.103447 Nov 01 01:58:37.440689 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1541/3176] 10.222.0.47 () {62 vars in 1318 bytes} [Mon Nov 1 01:58:37 2021] POST /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f/action => generated 25756 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 01 01:58:38.452067 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-414461ab-42be-4805-a276-6e99850109c5 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:58:38.453064 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-414461ab-42be-4805-a276-6e99850109c5 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: ba8a1bd2-a708-4b49-a89b-8c9b61ab418f] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:58:38.459944 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-414461ab-42be-4805-a276-6e99850109c5 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:58:38.460389 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-414461ab-42be-4805-a276-6e99850109c5 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:58:38.461138 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-414461ab-42be-4805-a276-6e99850109c5 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:58:38.461564 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-414461ab-42be-4805-a276-6e99850109c5 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:58:38.558181 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-414461ab-42be-4805-a276-6e99850109c5 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "POST /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f/action" status: 200 len: 27063 microversion: 2.20 time: 0.109953 Nov 01 01:58:38.558867 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1636/3177] 10.222.0.47 () {62 vars in 1318 bytes} [Mon Nov 1 01:58:38 2021] POST /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f/action => generated 27063 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 01 01:58:39.570687 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-a1488e7b-48a6-4346-9bd5-7f05696a01f2 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:58:39.571675 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-a1488e7b-48a6-4346-9bd5-7f05696a01f2 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: ba8a1bd2-a708-4b49-a89b-8c9b61ab418f] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:58:39.578522 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a1488e7b-48a6-4346-9bd5-7f05696a01f2 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:58:39.578976 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a1488e7b-48a6-4346-9bd5-7f05696a01f2 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:58:39.579728 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a1488e7b-48a6-4346-9bd5-7f05696a01f2 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:58:39.580157 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a1488e7b-48a6-4346-9bd5-7f05696a01f2 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:58:39.674105 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-a1488e7b-48a6-4346-9bd5-7f05696a01f2 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "POST /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f/action" status: 200 len: 27741 microversion: 2.20 time: 0.107540 Nov 01 01:58:39.674683 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1542/3178] 10.222.0.47 () {62 vars in 1318 bytes} [Mon Nov 1 01:58:39 2021] POST /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f/action => generated 27741 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 01 01:58:40.686429 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-81d3f194-5858-43fe-8fa9-90b6c5385570 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:58:40.687442 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-81d3f194-5858-43fe-8fa9-90b6c5385570 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: ba8a1bd2-a708-4b49-a89b-8c9b61ab418f] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:58:40.694872 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-81d3f194-5858-43fe-8fa9-90b6c5385570 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:58:40.695317 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-81d3f194-5858-43fe-8fa9-90b6c5385570 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:58:40.696066 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-81d3f194-5858-43fe-8fa9-90b6c5385570 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:58:40.696488 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-81d3f194-5858-43fe-8fa9-90b6c5385570 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:58:40.792681 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-81d3f194-5858-43fe-8fa9-90b6c5385570 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "POST /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f/action" status: 200 len: 28115 microversion: 2.20 time: 0.110145 Nov 01 01:58:40.793344 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1637/3179] 10.222.0.47 () {62 vars in 1318 bytes} [Mon Nov 1 01:58:40 2021] POST /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f/action => generated 28115 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 01 01:58:42.011722 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-8b48a7ab-a63f-445e-bbaa-e4b8b4761f93 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:58:42.012777 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-8b48a7ab-a63f-445e-bbaa-e4b8b4761f93 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: ba8a1bd2-a708-4b49-a89b-8c9b61ab418f] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:58:42.019388 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8b48a7ab-a63f-445e-bbaa-e4b8b4761f93 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:58:42.019835 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8b48a7ab-a63f-445e-bbaa-e4b8b4761f93 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:58:42.020590 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8b48a7ab-a63f-445e-bbaa-e4b8b4761f93 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:58:42.021019 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8b48a7ab-a63f-445e-bbaa-e4b8b4761f93 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:58:42.115296 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-8b48a7ab-a63f-445e-bbaa-e4b8b4761f93 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "POST /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f/action" status: 200 len: 28232 microversion: 2.20 time: 0.314722 Nov 01 01:58:42.115840 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1543/3180] 10.222.0.47 () {62 vars in 1318 bytes} [Mon Nov 1 01:58:41 2021] POST /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f/action => generated 28232 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 01 01:58:43.127272 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-8cd92d60-3070-42f7-bda1-7feaa654f861 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:58:43.128269 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-8cd92d60-3070-42f7-bda1-7feaa654f861 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: ba8a1bd2-a708-4b49-a89b-8c9b61ab418f] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:58:43.135160 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8cd92d60-3070-42f7-bda1-7feaa654f861 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:58:43.135601 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8cd92d60-3070-42f7-bda1-7feaa654f861 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:58:43.136353 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8cd92d60-3070-42f7-bda1-7feaa654f861 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:58:43.136783 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8cd92d60-3070-42f7-bda1-7feaa654f861 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:58:43.218088 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-8cd92d60-3070-42f7-bda1-7feaa654f861 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "POST /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f/action" status: 200 len: 28232 microversion: 2.20 time: 0.094842 Nov 01 01:58:43.218733 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1638/3181] 10.222.0.47 () {62 vars in 1318 bytes} [Mon Nov 1 01:58:43 2021] POST /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f/action => generated 28232 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 01 01:58:44.229866 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-697c6997-820b-45b3-acc9-3f690511ba4b tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:58:44.230883 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-697c6997-820b-45b3-acc9-3f690511ba4b tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: ba8a1bd2-a708-4b49-a89b-8c9b61ab418f] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:58:44.237557 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-697c6997-820b-45b3-acc9-3f690511ba4b tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:58:44.238025 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-697c6997-820b-45b3-acc9-3f690511ba4b tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:58:44.238797 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-697c6997-820b-45b3-acc9-3f690511ba4b tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:58:44.239230 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-697c6997-820b-45b3-acc9-3f690511ba4b tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:58:44.330170 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-697c6997-820b-45b3-acc9-3f690511ba4b tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "POST /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f/action" status: 200 len: 28232 microversion: 2.20 time: 0.104228 Nov 01 01:58:44.330825 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1544/3182] 10.222.0.47 () {62 vars in 1318 bytes} [Mon Nov 1 01:58:44 2021] POST /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f/action => generated 28232 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 01 01:58:45.342195 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-35b0923d-5d9d-4b5a-bd5b-3d912c0da524 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:58:45.343165 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-35b0923d-5d9d-4b5a-bd5b-3d912c0da524 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: ba8a1bd2-a708-4b49-a89b-8c9b61ab418f] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:58:45.350615 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-35b0923d-5d9d-4b5a-bd5b-3d912c0da524 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:58:45.351069 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-35b0923d-5d9d-4b5a-bd5b-3d912c0da524 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:58:45.351831 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-35b0923d-5d9d-4b5a-bd5b-3d912c0da524 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:58:45.352260 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-35b0923d-5d9d-4b5a-bd5b-3d912c0da524 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:58:45.447789 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-35b0923d-5d9d-4b5a-bd5b-3d912c0da524 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "POST /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f/action" status: 200 len: 28232 microversion: 2.20 time: 0.109686 Nov 01 01:58:45.449183 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1639/3183] 10.222.0.47 () {62 vars in 1318 bytes} [Mon Nov 1 01:58:45 2021] POST /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f/action => generated 28232 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 01 01:58:46.460751 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-b305c758-c8b4-4911-a3b1-3b39391ecc5b tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:58:46.461755 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-b305c758-c8b4-4911-a3b1-3b39391ecc5b tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: ba8a1bd2-a708-4b49-a89b-8c9b61ab418f] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:58:46.468784 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b305c758-c8b4-4911-a3b1-3b39391ecc5b tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:58:46.469267 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b305c758-c8b4-4911-a3b1-3b39391ecc5b tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:58:46.470070 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b305c758-c8b4-4911-a3b1-3b39391ecc5b tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:58:46.470599 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b305c758-c8b4-4911-a3b1-3b39391ecc5b tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:58:46.564852 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-b305c758-c8b4-4911-a3b1-3b39391ecc5b tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "POST /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f/action" status: 200 len: 28232 microversion: 2.20 time: 0.108001 Nov 01 01:58:46.565504 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1545/3184] 10.222.0.47 () {62 vars in 1318 bytes} [Mon Nov 1 01:58:46 2021] POST /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f/action => generated 28232 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 01 01:58:47.577999 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-ec0123f2-bd2c-42c5-9cd2-2adcf275d4dd tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:58:47.579052 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-ec0123f2-bd2c-42c5-9cd2-2adcf275d4dd tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: ba8a1bd2-a708-4b49-a89b-8c9b61ab418f] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:58:47.586151 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ec0123f2-bd2c-42c5-9cd2-2adcf275d4dd tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:58:47.586653 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ec0123f2-bd2c-42c5-9cd2-2adcf275d4dd tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:58:47.587411 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ec0123f2-bd2c-42c5-9cd2-2adcf275d4dd tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:58:47.587838 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ec0123f2-bd2c-42c5-9cd2-2adcf275d4dd tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:58:47.690666 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-ec0123f2-bd2c-42c5-9cd2-2adcf275d4dd tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "POST /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f/action" status: 200 len: 28232 microversion: 2.20 time: 0.116597 Nov 01 01:58:47.691306 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1640/3185] 10.222.0.47 () {62 vars in 1318 bytes} [Mon Nov 1 01:58:47 2021] POST /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f/action => generated 28232 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 01 01:58:48.702842 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-19c6a0b4-1428-4583-869d-43c6f099497e tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:58:48.703834 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-19c6a0b4-1428-4583-869d-43c6f099497e tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: ba8a1bd2-a708-4b49-a89b-8c9b61ab418f] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:58:48.711360 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-19c6a0b4-1428-4583-869d-43c6f099497e tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:58:48.711835 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-19c6a0b4-1428-4583-869d-43c6f099497e tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:58:48.712591 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-19c6a0b4-1428-4583-869d-43c6f099497e tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:58:48.713018 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-19c6a0b4-1428-4583-869d-43c6f099497e tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:58:48.805117 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-19c6a0b4-1428-4583-869d-43c6f099497e tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "POST /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f/action" status: 200 len: 28232 microversion: 2.20 time: 0.106196 Nov 01 01:58:48.805759 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1546/3186] 10.222.0.47 () {62 vars in 1318 bytes} [Mon Nov 1 01:58:48 2021] POST /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f/action => generated 28232 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 01 01:58:49.817344 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-edf3683e-5275-4c49-9ba8-7d931ef49f59 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:58:49.818365 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-edf3683e-5275-4c49-9ba8-7d931ef49f59 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: ba8a1bd2-a708-4b49-a89b-8c9b61ab418f] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:58:49.825146 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-edf3683e-5275-4c49-9ba8-7d931ef49f59 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:58:49.825586 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-edf3683e-5275-4c49-9ba8-7d931ef49f59 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:58:49.826325 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-edf3683e-5275-4c49-9ba8-7d931ef49f59 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:58:49.826774 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-edf3683e-5275-4c49-9ba8-7d931ef49f59 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:58:49.906078 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-edf3683e-5275-4c49-9ba8-7d931ef49f59 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "POST /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f/action" status: 200 len: 28232 microversion: 2.20 time: 0.092526 Nov 01 01:58:49.906677 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1641/3187] 10.222.0.47 () {62 vars in 1318 bytes} [Mon Nov 1 01:58:49 2021] POST /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f/action => generated 28232 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 01 01:58:50.917672 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-39158fe9-0323-407c-8845-c60331529c2a tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:58:50.918736 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-39158fe9-0323-407c-8845-c60331529c2a tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: ba8a1bd2-a708-4b49-a89b-8c9b61ab418f] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:58:50.925854 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-39158fe9-0323-407c-8845-c60331529c2a tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:58:50.926301 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-39158fe9-0323-407c-8845-c60331529c2a tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:58:50.927095 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-39158fe9-0323-407c-8845-c60331529c2a tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:58:50.927530 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-39158fe9-0323-407c-8845-c60331529c2a tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:58:51.010976 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-39158fe9-0323-407c-8845-c60331529c2a tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "POST /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f/action" status: 200 len: 28232 microversion: 2.20 time: 0.097222 Nov 01 01:58:51.011628 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1547/3188] 10.222.0.47 () {62 vars in 1318 bytes} [Mon Nov 1 01:58:50 2021] POST /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f/action => generated 28232 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 01 01:58:52.022354 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-a04074ae-27ce-4e5b-a784-b08f338e4946 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:58:52.023419 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-a04074ae-27ce-4e5b-a784-b08f338e4946 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: ba8a1bd2-a708-4b49-a89b-8c9b61ab418f] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:58:52.030363 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a04074ae-27ce-4e5b-a784-b08f338e4946 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:58:52.030904 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a04074ae-27ce-4e5b-a784-b08f338e4946 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:58:52.031648 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a04074ae-27ce-4e5b-a784-b08f338e4946 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:58:52.032072 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a04074ae-27ce-4e5b-a784-b08f338e4946 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:58:52.127989 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-a04074ae-27ce-4e5b-a784-b08f338e4946 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "POST /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f/action" status: 200 len: 28232 microversion: 2.20 time: 0.109508 Nov 01 01:58:52.128861 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1642/3189] 10.222.0.47 () {62 vars in 1318 bytes} [Mon Nov 1 01:58:52 2021] POST /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f/action => generated 28232 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 01 01:58:53.139332 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-feccd8c4-ac48-4f1f-a0ea-f3ea0b407e4c tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:58:53.140333 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-feccd8c4-ac48-4f1f-a0ea-f3ea0b407e4c tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: ba8a1bd2-a708-4b49-a89b-8c9b61ab418f] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:58:53.147090 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-feccd8c4-ac48-4f1f-a0ea-f3ea0b407e4c tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:58:53.147542 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-feccd8c4-ac48-4f1f-a0ea-f3ea0b407e4c tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:58:53.148309 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-feccd8c4-ac48-4f1f-a0ea-f3ea0b407e4c tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:58:53.148742 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-feccd8c4-ac48-4f1f-a0ea-f3ea0b407e4c tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:58:53.234336 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-feccd8c4-ac48-4f1f-a0ea-f3ea0b407e4c tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "POST /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f/action" status: 200 len: 28232 microversion: 2.20 time: 0.098891 Nov 01 01:58:53.235518 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1548/3190] 10.222.0.47 () {62 vars in 1318 bytes} [Mon Nov 1 01:58:53 2021] POST /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f/action => generated 28232 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 01 01:58:54.246955 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-617b82f9-13b2-419e-8ee3-555482ae739c tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:58:54.247949 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-617b82f9-13b2-419e-8ee3-555482ae739c tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: ba8a1bd2-a708-4b49-a89b-8c9b61ab418f] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:58:54.254843 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-617b82f9-13b2-419e-8ee3-555482ae739c tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:58:54.255283 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-617b82f9-13b2-419e-8ee3-555482ae739c tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:58:54.256027 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-617b82f9-13b2-419e-8ee3-555482ae739c tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:58:54.256448 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-617b82f9-13b2-419e-8ee3-555482ae739c tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:58:54.344158 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-617b82f9-13b2-419e-8ee3-555482ae739c tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "POST /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f/action" status: 200 len: 28523 microversion: 2.20 time: 0.101774 Nov 01 01:58:54.345499 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1643/3191] 10.222.0.47 () {62 vars in 1318 bytes} [Mon Nov 1 01:58:54 2021] POST /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f/action => generated 28523 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 01 01:58:55.356302 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-1a2b1b19-ee14-4467-b927-a2ae15031c5d tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:58:55.357215 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-1a2b1b19-ee14-4467-b927-a2ae15031c5d tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: ba8a1bd2-a708-4b49-a89b-8c9b61ab418f] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:58:55.364060 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1a2b1b19-ee14-4467-b927-a2ae15031c5d tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:58:55.364496 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1a2b1b19-ee14-4467-b927-a2ae15031c5d tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:58:55.365252 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1a2b1b19-ee14-4467-b927-a2ae15031c5d tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:58:55.365675 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1a2b1b19-ee14-4467-b927-a2ae15031c5d tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:58:55.459552 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-1a2b1b19-ee14-4467-b927-a2ae15031c5d tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "POST /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f/action" status: 200 len: 28523 microversion: 2.20 time: 0.107292 Nov 01 01:58:55.460444 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1549/3192] 10.222.0.47 () {62 vars in 1318 bytes} [Mon Nov 1 01:58:55 2021] POST /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f/action => generated 28523 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 01 01:58:56.471998 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-4a43c965-c42b-41e8-b78d-5398acaf5075 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:58:56.472910 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-4a43c965-c42b-41e8-b78d-5398acaf5075 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: ba8a1bd2-a708-4b49-a89b-8c9b61ab418f] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:58:56.479618 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4a43c965-c42b-41e8-b78d-5398acaf5075 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:58:56.482019 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4a43c965-c42b-41e8-b78d-5398acaf5075 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:58:56.482019 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4a43c965-c42b-41e8-b78d-5398acaf5075 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:58:56.482019 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4a43c965-c42b-41e8-b78d-5398acaf5075 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:58:56.576969 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-4a43c965-c42b-41e8-b78d-5398acaf5075 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "POST /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f/action" status: 200 len: 28691 microversion: 2.20 time: 0.107822 Nov 01 01:58:56.578138 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1644/3193] 10.222.0.47 () {62 vars in 1318 bytes} [Mon Nov 1 01:58:56 2021] POST /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f/action => generated 28691 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 01 01:58:57.590165 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-d9c3d2ca-003d-4041-bf63-21f440a4a263 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:58:57.591208 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-d9c3d2ca-003d-4041-bf63-21f440a4a263 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: ba8a1bd2-a708-4b49-a89b-8c9b61ab418f] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:58:57.598087 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d9c3d2ca-003d-4041-bf63-21f440a4a263 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:58:57.598575 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d9c3d2ca-003d-4041-bf63-21f440a4a263 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:58:57.599338 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d9c3d2ca-003d-4041-bf63-21f440a4a263 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:58:57.599772 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d9c3d2ca-003d-4041-bf63-21f440a4a263 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:58:57.685138 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-d9c3d2ca-003d-4041-bf63-21f440a4a263 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "POST /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f/action" status: 200 len: 28691 microversion: 2.20 time: 0.099431 Nov 01 01:58:57.685794 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1550/3194] 10.222.0.47 () {62 vars in 1318 bytes} [Mon Nov 1 01:58:57 2021] POST /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f/action => generated 28691 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 01 01:58:58.697311 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-4d9dc21e-80ac-4b17-be1c-6de25367c268 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:58:58.698317 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-4d9dc21e-80ac-4b17-be1c-6de25367c268 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: ba8a1bd2-a708-4b49-a89b-8c9b61ab418f] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:58:58.705181 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4d9dc21e-80ac-4b17-be1c-6de25367c268 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:58:58.705625 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4d9dc21e-80ac-4b17-be1c-6de25367c268 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:58:58.706375 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4d9dc21e-80ac-4b17-be1c-6de25367c268 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:58:58.706830 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4d9dc21e-80ac-4b17-be1c-6de25367c268 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:58:58.788881 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-4d9dc21e-80ac-4b17-be1c-6de25367c268 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "POST /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f/action" status: 200 len: 28691 microversion: 2.20 time: 0.095510 Nov 01 01:58:58.790254 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1645/3195] 10.222.0.47 () {62 vars in 1318 bytes} [Mon Nov 1 01:58:58 2021] POST /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f/action => generated 28691 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 01 01:58:59.800873 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-66246851-b9e8-4791-87f5-e9b23a906cdd tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:58:59.801867 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-66246851-b9e8-4791-87f5-e9b23a906cdd tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: ba8a1bd2-a708-4b49-a89b-8c9b61ab418f] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:58:59.809170 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-66246851-b9e8-4791-87f5-e9b23a906cdd tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:58:59.809606 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-66246851-b9e8-4791-87f5-e9b23a906cdd tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:58:59.810351 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-66246851-b9e8-4791-87f5-e9b23a906cdd tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:58:59.810910 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-66246851-b9e8-4791-87f5-e9b23a906cdd tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:58:59.893308 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-66246851-b9e8-4791-87f5-e9b23a906cdd tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "POST /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f/action" status: 200 len: 28691 microversion: 2.20 time: 0.096653 Nov 01 01:58:59.894064 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1551/3196] 10.222.0.47 () {62 vars in 1318 bytes} [Mon Nov 1 01:58:59 2021] POST /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f/action => generated 28691 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 01 01:59:00.128059 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 01 01:59:00.131398 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: Mon Nov 1 01:59:00 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 01 01:59:00.905418 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-7f92202c-ad6f-4f7f-926d-99a2673cfde9 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:59:00.906439 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-7f92202c-ad6f-4f7f-926d-99a2673cfde9 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: ba8a1bd2-a708-4b49-a89b-8c9b61ab418f] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:59:00.913291 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-7f92202c-ad6f-4f7f-926d-99a2673cfde9 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:59:00.913730 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-7f92202c-ad6f-4f7f-926d-99a2673cfde9 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:59:00.915032 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-7f92202c-ad6f-4f7f-926d-99a2673cfde9 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:59:00.915462 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-7f92202c-ad6f-4f7f-926d-99a2673cfde9 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:59:00.998293 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-7f92202c-ad6f-4f7f-926d-99a2673cfde9 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "POST /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f/action" status: 200 len: 28691 microversion: 2.20 time: 0.096834 Nov 01 01:59:00.999214 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1646/3197] 10.222.0.47 () {62 vars in 1318 bytes} [Mon Nov 1 01:59:00 2021] POST /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f/action => generated 28691 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 01 01:59:02.010389 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-7d18f8fc-4045-40d1-8d24-a718ccbf13ad tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:59:02.011337 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-7d18f8fc-4045-40d1-8d24-a718ccbf13ad tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: ba8a1bd2-a708-4b49-a89b-8c9b61ab418f] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:59:02.018119 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7d18f8fc-4045-40d1-8d24-a718ccbf13ad tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:59:02.018605 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7d18f8fc-4045-40d1-8d24-a718ccbf13ad tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:59:02.019367 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7d18f8fc-4045-40d1-8d24-a718ccbf13ad tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:59:02.019792 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7d18f8fc-4045-40d1-8d24-a718ccbf13ad tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:59:02.100642 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-7d18f8fc-4045-40d1-8d24-a718ccbf13ad tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "POST /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f/action" status: 200 len: 28691 microversion: 2.20 time: 0.094272 Nov 01 01:59:02.101551 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1552/3198] 10.222.0.47 () {62 vars in 1318 bytes} [Mon Nov 1 01:59:02 2021] POST /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f/action => generated 28691 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 01 01:59:03.113380 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-650736f6-979c-4af7-bb27-3a542818db5e tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:59:03.114374 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-650736f6-979c-4af7-bb27-3a542818db5e tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: ba8a1bd2-a708-4b49-a89b-8c9b61ab418f] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:59:03.121768 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-650736f6-979c-4af7-bb27-3a542818db5e tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:59:03.122209 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-650736f6-979c-4af7-bb27-3a542818db5e tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:59:03.123004 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-650736f6-979c-4af7-bb27-3a542818db5e tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:59:03.123430 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-650736f6-979c-4af7-bb27-3a542818db5e tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:59:03.204881 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-650736f6-979c-4af7-bb27-3a542818db5e tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "POST /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f/action" status: 200 len: 28691 microversion: 2.20 time: 0.095453 Nov 01 01:59:03.205790 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1647/3199] 10.222.0.47 () {62 vars in 1318 bytes} [Mon Nov 1 01:59:03 2021] POST /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f/action => generated 28691 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 01 01:59:04.217912 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-173d3e4d-741f-4f57-98f2-c6910eed79c7 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:59:04.219045 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-173d3e4d-741f-4f57-98f2-c6910eed79c7 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: ba8a1bd2-a708-4b49-a89b-8c9b61ab418f] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:59:04.225961 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-173d3e4d-741f-4f57-98f2-c6910eed79c7 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:59:04.226399 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-173d3e4d-741f-4f57-98f2-c6910eed79c7 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:59:04.227174 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-173d3e4d-741f-4f57-98f2-c6910eed79c7 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:59:04.227595 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-173d3e4d-741f-4f57-98f2-c6910eed79c7 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:59:04.310341 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-173d3e4d-741f-4f57-98f2-c6910eed79c7 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "POST /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f/action" status: 200 len: 28691 microversion: 2.20 time: 0.096687 Nov 01 01:59:04.311034 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1553/3200] 10.222.0.47 () {62 vars in 1318 bytes} [Mon Nov 1 01:59:04 2021] POST /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f/action => generated 28691 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 01 01:59:05.323582 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-8705b606-e978-49a5-8bb2-afa5b7ffcbff tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:59:05.324496 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-8705b606-e978-49a5-8bb2-afa5b7ffcbff tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: ba8a1bd2-a708-4b49-a89b-8c9b61ab418f] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:59:05.331267 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8705b606-e978-49a5-8bb2-afa5b7ffcbff tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:59:05.331704 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8705b606-e978-49a5-8bb2-afa5b7ffcbff tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:59:05.332448 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8705b606-e978-49a5-8bb2-afa5b7ffcbff tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:59:05.332867 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8705b606-e978-49a5-8bb2-afa5b7ffcbff tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:59:05.421972 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-8705b606-e978-49a5-8bb2-afa5b7ffcbff tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "POST /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f/action" status: 200 len: 28691 microversion: 2.20 time: 0.102460 Nov 01 01:59:05.422669 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1648/3201] 10.222.0.47 () {62 vars in 1318 bytes} [Mon Nov 1 01:59:05 2021] POST /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f/action => generated 28691 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 01 01:59:06.434228 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-2f73128f-d279-48f9-bdea-9dc253331ac4 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:59:06.435268 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-2f73128f-d279-48f9-bdea-9dc253331ac4 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: ba8a1bd2-a708-4b49-a89b-8c9b61ab418f] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:59:06.442051 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2f73128f-d279-48f9-bdea-9dc253331ac4 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:59:06.442532 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2f73128f-d279-48f9-bdea-9dc253331ac4 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:59:06.443318 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2f73128f-d279-48f9-bdea-9dc253331ac4 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:59:06.443751 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2f73128f-d279-48f9-bdea-9dc253331ac4 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:59:06.522942 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-2f73128f-d279-48f9-bdea-9dc253331ac4 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "POST /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f/action" status: 200 len: 28691 microversion: 2.20 time: 0.093245 Nov 01 01:59:06.524100 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1554/3202] 10.222.0.47 () {62 vars in 1318 bytes} [Mon Nov 1 01:59:06 2021] POST /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f/action => generated 28691 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 01 01:59:07.535579 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-f9a032a6-58c0-4f3c-97c2-ad0f8ac0faab tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:59:07.536591 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-f9a032a6-58c0-4f3c-97c2-ad0f8ac0faab tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: ba8a1bd2-a708-4b49-a89b-8c9b61ab418f] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:59:07.544156 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f9a032a6-58c0-4f3c-97c2-ad0f8ac0faab tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:59:07.544604 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f9a032a6-58c0-4f3c-97c2-ad0f8ac0faab tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:59:07.545366 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f9a032a6-58c0-4f3c-97c2-ad0f8ac0faab tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:59:07.545796 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f9a032a6-58c0-4f3c-97c2-ad0f8ac0faab tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:59:07.630643 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-f9a032a6-58c0-4f3c-97c2-ad0f8ac0faab tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "POST /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f/action" status: 200 len: 28691 microversion: 2.20 time: 0.098888 Nov 01 01:59:07.631197 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1649/3203] 10.222.0.47 () {62 vars in 1318 bytes} [Mon Nov 1 01:59:07 2021] POST /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f/action => generated 28691 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 01 01:59:08.643392 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-ea433989-1530-446c-8c28-25f32ced39af tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:59:08.644353 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-ea433989-1530-446c-8c28-25f32ced39af tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: ba8a1bd2-a708-4b49-a89b-8c9b61ab418f] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:59:08.651245 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ea433989-1530-446c-8c28-25f32ced39af tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:59:08.651688 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ea433989-1530-446c-8c28-25f32ced39af tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:59:08.652444 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ea433989-1530-446c-8c28-25f32ced39af tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:59:08.652873 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ea433989-1530-446c-8c28-25f32ced39af tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:59:08.755826 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-ea433989-1530-446c-8c28-25f32ced39af tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "POST /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f/action" status: 200 len: 28691 microversion: 2.20 time: 0.116396 Nov 01 01:59:08.756682 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1555/3204] 10.222.0.47 () {62 vars in 1318 bytes} [Mon Nov 1 01:59:08 2021] POST /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f/action => generated 28691 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 01 01:59:09.767938 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-7009c7d8-b83a-459f-9ff1-ddad0dacdc29 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:59:09.769005 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-7009c7d8-b83a-459f-9ff1-ddad0dacdc29 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: ba8a1bd2-a708-4b49-a89b-8c9b61ab418f] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:59:09.775886 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-7009c7d8-b83a-459f-9ff1-ddad0dacdc29 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:59:09.776333 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-7009c7d8-b83a-459f-9ff1-ddad0dacdc29 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:59:09.777090 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-7009c7d8-b83a-459f-9ff1-ddad0dacdc29 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:59:09.777521 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-7009c7d8-b83a-459f-9ff1-ddad0dacdc29 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:59:09.861343 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-7009c7d8-b83a-459f-9ff1-ddad0dacdc29 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "POST /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f/action" status: 200 len: 28691 microversion: 2.20 time: 0.097377 Nov 01 01:59:09.861976 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1650/3205] 10.222.0.47 () {62 vars in 1318 bytes} [Mon Nov 1 01:59:09 2021] POST /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f/action => generated 28691 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 01 01:59:10.873473 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-a76ca633-3bf0-42e6-8349-93267e066536 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:59:10.874492 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-a76ca633-3bf0-42e6-8349-93267e066536 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: ba8a1bd2-a708-4b49-a89b-8c9b61ab418f] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:59:10.881262 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a76ca633-3bf0-42e6-8349-93267e066536 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:59:10.881713 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a76ca633-3bf0-42e6-8349-93267e066536 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:59:10.882468 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a76ca633-3bf0-42e6-8349-93267e066536 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:59:10.883397 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a76ca633-3bf0-42e6-8349-93267e066536 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:59:10.964287 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-a76ca633-3bf0-42e6-8349-93267e066536 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "POST /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f/action" status: 200 len: 28691 microversion: 2.20 time: 0.094828 Nov 01 01:59:10.964957 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1556/3206] 10.222.0.47 () {62 vars in 1318 bytes} [Mon Nov 1 01:59:10 2021] POST /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f/action => generated 28691 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 01 01:59:11.976391 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-f1fd09cd-7e6d-42d2-b1ab-f928ad95fad3 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:59:11.977980 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-f1fd09cd-7e6d-42d2-b1ab-f928ad95fad3 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: ba8a1bd2-a708-4b49-a89b-8c9b61ab418f] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:59:11.984806 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f1fd09cd-7e6d-42d2-b1ab-f928ad95fad3 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:59:11.985247 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f1fd09cd-7e6d-42d2-b1ab-f928ad95fad3 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:59:11.985993 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f1fd09cd-7e6d-42d2-b1ab-f928ad95fad3 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:59:11.986415 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f1fd09cd-7e6d-42d2-b1ab-f928ad95fad3 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:59:12.066542 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-f1fd09cd-7e6d-42d2-b1ab-f928ad95fad3 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "POST /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f/action" status: 200 len: 28691 microversion: 2.20 time: 0.094069 Nov 01 01:59:12.067408 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1651/3207] 10.222.0.47 () {62 vars in 1318 bytes} [Mon Nov 1 01:59:11 2021] POST /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f/action => generated 28691 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 01 01:59:13.077566 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-c83a33d0-3fac-4197-8c79-d7bb5fc04bb3 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:59:13.078629 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-c83a33d0-3fac-4197-8c79-d7bb5fc04bb3 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: ba8a1bd2-a708-4b49-a89b-8c9b61ab418f] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:59:13.085399 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c83a33d0-3fac-4197-8c79-d7bb5fc04bb3 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:59:13.085897 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c83a33d0-3fac-4197-8c79-d7bb5fc04bb3 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:59:13.086619 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c83a33d0-3fac-4197-8c79-d7bb5fc04bb3 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:59:13.087079 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c83a33d0-3fac-4197-8c79-d7bb5fc04bb3 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:59:13.175937 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-c83a33d0-3fac-4197-8c79-d7bb5fc04bb3 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "POST /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f/action" status: 200 len: 28691 microversion: 2.20 time: 0.102330 Nov 01 01:59:13.176609 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1557/3208] 10.222.0.47 () {62 vars in 1318 bytes} [Mon Nov 1 01:59:13 2021] POST /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f/action => generated 28691 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 01 01:59:14.188486 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-4846787a-2d4c-4871-b5c9-516ff1d70bb4 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:59:14.189633 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-4846787a-2d4c-4871-b5c9-516ff1d70bb4 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: ba8a1bd2-a708-4b49-a89b-8c9b61ab418f] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:59:14.196502 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4846787a-2d4c-4871-b5c9-516ff1d70bb4 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:59:14.196947 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4846787a-2d4c-4871-b5c9-516ff1d70bb4 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:59:14.197688 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4846787a-2d4c-4871-b5c9-516ff1d70bb4 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:59:14.198112 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-4846787a-2d4c-4871-b5c9-516ff1d70bb4 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:59:14.280624 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-4846787a-2d4c-4871-b5c9-516ff1d70bb4 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "POST /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f/action" status: 200 len: 28691 microversion: 2.20 time: 0.095963 Nov 01 01:59:14.281377 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1652/3209] 10.222.0.47 () {62 vars in 1318 bytes} [Mon Nov 1 01:59:14 2021] POST /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f/action => generated 28691 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 01 01:59:15.292639 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-c0ef9bb2-1de9-4440-a620-b69c4a8e246f tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:59:15.293639 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-c0ef9bb2-1de9-4440-a620-b69c4a8e246f tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: ba8a1bd2-a708-4b49-a89b-8c9b61ab418f] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:59:15.300850 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c0ef9bb2-1de9-4440-a620-b69c4a8e246f tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:59:15.301295 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c0ef9bb2-1de9-4440-a620-b69c4a8e246f tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:59:15.302047 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c0ef9bb2-1de9-4440-a620-b69c4a8e246f tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:59:15.302516 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c0ef9bb2-1de9-4440-a620-b69c4a8e246f tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:59:15.403709 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-c0ef9bb2-1de9-4440-a620-b69c4a8e246f tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "POST /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f/action" status: 200 len: 28691 microversion: 2.20 time: 0.115465 Nov 01 01:59:15.408533 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1558/3210] 10.222.0.47 () {62 vars in 1318 bytes} [Mon Nov 1 01:59:15 2021] POST /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f/action => generated 28691 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 01 01:59:16.416610 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-cc4f8ab9-cae2-489b-9be6-bc2dc56a20a7 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:59:16.417609 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-cc4f8ab9-cae2-489b-9be6-bc2dc56a20a7 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: ba8a1bd2-a708-4b49-a89b-8c9b61ab418f] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:59:16.424691 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-cc4f8ab9-cae2-489b-9be6-bc2dc56a20a7 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:59:16.430086 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-cc4f8ab9-cae2-489b-9be6-bc2dc56a20a7 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:59:16.430086 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-cc4f8ab9-cae2-489b-9be6-bc2dc56a20a7 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:59:16.430086 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-cc4f8ab9-cae2-489b-9be6-bc2dc56a20a7 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:59:16.507685 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-cc4f8ab9-cae2-489b-9be6-bc2dc56a20a7 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "POST /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f/action" status: 200 len: 28691 microversion: 2.20 time: 0.095518 Nov 01 01:59:16.508387 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1653/3211] 10.222.0.47 () {62 vars in 1318 bytes} [Mon Nov 1 01:59:16 2021] POST /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f/action => generated 28691 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 01 01:59:17.519732 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-7a5a638c-46ea-47d5-97e1-fe8ba886b367 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:59:17.520724 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-7a5a638c-46ea-47d5-97e1-fe8ba886b367 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: ba8a1bd2-a708-4b49-a89b-8c9b61ab418f] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:59:17.527554 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7a5a638c-46ea-47d5-97e1-fe8ba886b367 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:59:17.528001 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7a5a638c-46ea-47d5-97e1-fe8ba886b367 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:59:17.528742 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7a5a638c-46ea-47d5-97e1-fe8ba886b367 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:59:17.529161 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7a5a638c-46ea-47d5-97e1-fe8ba886b367 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:59:17.612863 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-7a5a638c-46ea-47d5-97e1-fe8ba886b367 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "POST /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f/action" status: 200 len: 28691 microversion: 2.20 time: 0.097039 Nov 01 01:59:17.613465 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1559/3212] 10.222.0.47 () {62 vars in 1318 bytes} [Mon Nov 1 01:59:17 2021] POST /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f/action => generated 28691 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 01 01:59:18.625340 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-d52bcf85-34a3-4e0b-bd05-b2e27e08e5e4 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:59:18.626246 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-d52bcf85-34a3-4e0b-bd05-b2e27e08e5e4 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: ba8a1bd2-a708-4b49-a89b-8c9b61ab418f] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:59:18.633085 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d52bcf85-34a3-4e0b-bd05-b2e27e08e5e4 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:59:18.633521 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d52bcf85-34a3-4e0b-bd05-b2e27e08e5e4 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:59:18.634265 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d52bcf85-34a3-4e0b-bd05-b2e27e08e5e4 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:59:18.634711 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d52bcf85-34a3-4e0b-bd05-b2e27e08e5e4 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:59:18.728643 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-d52bcf85-34a3-4e0b-bd05-b2e27e08e5e4 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "POST /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f/action" status: 200 len: 28691 microversion: 2.20 time: 0.107295 Nov 01 01:59:18.729300 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1654/3213] 10.222.0.47 () {62 vars in 1318 bytes} [Mon Nov 1 01:59:18 2021] POST /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f/action => generated 28691 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 01 01:59:19.740783 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-15a6f7c8-d376-414a-9d25-6a32bdcf841f tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:59:19.741781 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-15a6f7c8-d376-414a-9d25-6a32bdcf841f tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: ba8a1bd2-a708-4b49-a89b-8c9b61ab418f] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:59:19.749171 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-15a6f7c8-d376-414a-9d25-6a32bdcf841f tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:59:19.749617 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-15a6f7c8-d376-414a-9d25-6a32bdcf841f tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:59:19.750373 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-15a6f7c8-d376-414a-9d25-6a32bdcf841f tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:59:19.750825 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-15a6f7c8-d376-414a-9d25-6a32bdcf841f tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:59:19.830536 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-15a6f7c8-d376-414a-9d25-6a32bdcf841f tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "POST /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f/action" status: 200 len: 28691 microversion: 2.20 time: 0.093719 Nov 01 01:59:19.831159 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1560/3214] 10.222.0.47 () {62 vars in 1318 bytes} [Mon Nov 1 01:59:19 2021] POST /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f/action => generated 28691 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 01 01:59:20.842699 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-6584e99a-d609-4df1-a424-bca70f1cfad1 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:59:20.843692 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-6584e99a-d609-4df1-a424-bca70f1cfad1 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: ba8a1bd2-a708-4b49-a89b-8c9b61ab418f] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:59:20.850523 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-6584e99a-d609-4df1-a424-bca70f1cfad1 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:59:20.850963 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-6584e99a-d609-4df1-a424-bca70f1cfad1 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:59:20.851705 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-6584e99a-d609-4df1-a424-bca70f1cfad1 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:59:20.852127 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-6584e99a-d609-4df1-a424-bca70f1cfad1 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:59:20.931862 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-6584e99a-d609-4df1-a424-bca70f1cfad1 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "POST /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f/action" status: 200 len: 28691 microversion: 2.20 time: 0.093085 Nov 01 01:59:20.932497 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1655/3215] 10.222.0.47 () {62 vars in 1318 bytes} [Mon Nov 1 01:59:20 2021] POST /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f/action => generated 28691 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 01 01:59:21.943947 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-45679d59-3a9e-4136-8cd7-f395bca8d0dc tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:59:21.944947 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-45679d59-3a9e-4136-8cd7-f395bca8d0dc tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: ba8a1bd2-a708-4b49-a89b-8c9b61ab418f] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:59:21.952393 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-45679d59-3a9e-4136-8cd7-f395bca8d0dc tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:59:21.952844 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-45679d59-3a9e-4136-8cd7-f395bca8d0dc tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:59:21.953608 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-45679d59-3a9e-4136-8cd7-f395bca8d0dc tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:59:21.954039 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-45679d59-3a9e-4136-8cd7-f395bca8d0dc tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:59:22.033352 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-45679d59-3a9e-4136-8cd7-f395bca8d0dc tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "POST /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f/action" status: 200 len: 28691 microversion: 2.20 time: 0.093394 Nov 01 01:59:22.033968 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1561/3216] 10.222.0.47 () {62 vars in 1318 bytes} [Mon Nov 1 01:59:21 2021] POST /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f/action => generated 28691 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 01 01:59:23.046359 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-8ff7b716-b455-4a54-819a-88b1d3b7ef2c tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:59:23.047380 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-8ff7b716-b455-4a54-819a-88b1d3b7ef2c tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: ba8a1bd2-a708-4b49-a89b-8c9b61ab418f] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:59:23.054795 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8ff7b716-b455-4a54-819a-88b1d3b7ef2c tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:59:23.055235 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8ff7b716-b455-4a54-819a-88b1d3b7ef2c tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:59:23.056014 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8ff7b716-b455-4a54-819a-88b1d3b7ef2c tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:59:23.056438 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8ff7b716-b455-4a54-819a-88b1d3b7ef2c tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:59:23.142412 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-8ff7b716-b455-4a54-819a-88b1d3b7ef2c tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "POST /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f/action" status: 200 len: 28691 microversion: 2.20 time: 0.100099 Nov 01 01:59:23.143108 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1656/3217] 10.222.0.47 () {62 vars in 1318 bytes} [Mon Nov 1 01:59:23 2021] POST /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f/action => generated 28691 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 01 01:59:24.153631 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-aa0c7122-2166-455a-b531-169492588af5 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:59:24.154674 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-aa0c7122-2166-455a-b531-169492588af5 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: ba8a1bd2-a708-4b49-a89b-8c9b61ab418f] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:59:24.161492 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-aa0c7122-2166-455a-b531-169492588af5 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:59:24.161941 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-aa0c7122-2166-455a-b531-169492588af5 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:59:24.162987 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-aa0c7122-2166-455a-b531-169492588af5 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:59:24.163159 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-aa0c7122-2166-455a-b531-169492588af5 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:59:24.252994 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-aa0c7122-2166-455a-b531-169492588af5 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "POST /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f/action" status: 200 len: 28691 microversion: 2.20 time: 0.103361 Nov 01 01:59:24.253850 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1562/3218] 10.222.0.47 () {62 vars in 1318 bytes} [Mon Nov 1 01:59:24 2021] POST /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f/action => generated 28691 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 01 01:59:25.265533 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-e8f7eaeb-0c7a-4074-a599-f28aaf6a3fe4 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:59:25.266548 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-e8f7eaeb-0c7a-4074-a599-f28aaf6a3fe4 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: ba8a1bd2-a708-4b49-a89b-8c9b61ab418f] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:59:25.273331 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e8f7eaeb-0c7a-4074-a599-f28aaf6a3fe4 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:59:25.273772 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e8f7eaeb-0c7a-4074-a599-f28aaf6a3fe4 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:59:25.274547 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e8f7eaeb-0c7a-4074-a599-f28aaf6a3fe4 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:59:25.274970 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-e8f7eaeb-0c7a-4074-a599-f28aaf6a3fe4 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:59:25.369107 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-e8f7eaeb-0c7a-4074-a599-f28aaf6a3fe4 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "POST /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f/action" status: 200 len: 30601 microversion: 2.20 time: 0.106940 Nov 01 01:59:25.369813 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1657/3219] 10.222.0.47 () {62 vars in 1318 bytes} [Mon Nov 1 01:59:25 2021] POST /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f/action => generated 30601 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 01 01:59:26.381155 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-b86b4d96-015d-47e7-af5c-11989e83129f tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:59:26.382156 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-b86b4d96-015d-47e7-af5c-11989e83129f tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: ba8a1bd2-a708-4b49-a89b-8c9b61ab418f] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:59:26.389928 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b86b4d96-015d-47e7-af5c-11989e83129f tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:59:26.390630 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b86b4d96-015d-47e7-af5c-11989e83129f tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:59:26.391470 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b86b4d96-015d-47e7-af5c-11989e83129f tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:59:26.391899 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b86b4d96-015d-47e7-af5c-11989e83129f tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:59:26.478645 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-b86b4d96-015d-47e7-af5c-11989e83129f tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "POST /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f/action" status: 200 len: 32654 microversion: 2.20 time: 0.101291 Nov 01 01:59:26.483662 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1563/3220] 10.222.0.47 () {62 vars in 1318 bytes} [Mon Nov 1 01:59:26 2021] POST /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f/action => generated 32654 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 01 01:59:27.490525 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-26d5d3f2-8bdb-42d2-8859-b700534b9a34 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:59:27.491522 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-26d5d3f2-8bdb-42d2-8859-b700534b9a34 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: ba8a1bd2-a708-4b49-a89b-8c9b61ab418f] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:59:27.499262 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-26d5d3f2-8bdb-42d2-8859-b700534b9a34 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:59:27.499703 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-26d5d3f2-8bdb-42d2-8859-b700534b9a34 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:59:27.500485 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-26d5d3f2-8bdb-42d2-8859-b700534b9a34 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:59:27.500909 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-26d5d3f2-8bdb-42d2-8859-b700534b9a34 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:59:27.594077 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-26d5d3f2-8bdb-42d2-8859-b700534b9a34 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "POST /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f/action" status: 200 len: 33707 microversion: 2.20 time: 0.107517 Nov 01 01:59:27.594730 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1658/3221] 10.222.0.47 () {62 vars in 1318 bytes} [Mon Nov 1 01:59:27 2021] POST /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f/action => generated 33707 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 01 01:59:28.606559 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-7eeef8da-0de2-420f-818f-06eaa9637c81 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:59:28.607450 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-7eeef8da-0de2-420f-818f-06eaa9637c81 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: ba8a1bd2-a708-4b49-a89b-8c9b61ab418f] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:59:28.614221 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7eeef8da-0de2-420f-818f-06eaa9637c81 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:59:28.614693 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7eeef8da-0de2-420f-818f-06eaa9637c81 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:59:28.615447 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7eeef8da-0de2-420f-818f-06eaa9637c81 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:59:28.615920 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-7eeef8da-0de2-420f-818f-06eaa9637c81 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:59:28.709822 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-7eeef8da-0de2-420f-818f-06eaa9637c81 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "POST /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f/action" status: 200 len: 35022 microversion: 2.20 time: 0.107805 Nov 01 01:59:28.711423 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1564/3222] 10.222.0.47 () {62 vars in 1318 bytes} [Mon Nov 1 01:59:28 2021] POST /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f/action => generated 35022 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 01 01:59:29.724482 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-225a74b3-185b-4a9e-8945-76d23f48ac42 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:59:29.725490 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-225a74b3-185b-4a9e-8945-76d23f48ac42 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: ba8a1bd2-a708-4b49-a89b-8c9b61ab418f] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:59:29.732397 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-225a74b3-185b-4a9e-8945-76d23f48ac42 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:59:29.732840 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-225a74b3-185b-4a9e-8945-76d23f48ac42 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:59:29.733592 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-225a74b3-185b-4a9e-8945-76d23f48ac42 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:59:29.734017 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-225a74b3-185b-4a9e-8945-76d23f48ac42 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:59:29.825492 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-225a74b3-185b-4a9e-8945-76d23f48ac42 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "POST /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f/action" status: 200 len: 36311 microversion: 2.20 time: 0.106082 Nov 01 01:59:29.826125 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1659/3223] 10.222.0.47 () {62 vars in 1318 bytes} [Mon Nov 1 01:59:29 2021] POST /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f/action => generated 36311 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 01 01:59:30.836969 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-775b9838-6de9-4bc6-9a03-325d04293a7c tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:59:30.837966 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-775b9838-6de9-4bc6-9a03-325d04293a7c tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: ba8a1bd2-a708-4b49-a89b-8c9b61ab418f] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:59:30.845377 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-775b9838-6de9-4bc6-9a03-325d04293a7c tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:59:30.845828 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-775b9838-6de9-4bc6-9a03-325d04293a7c tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:59:30.846612 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-775b9838-6de9-4bc6-9a03-325d04293a7c tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:59:30.847040 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-775b9838-6de9-4bc6-9a03-325d04293a7c tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:59:30.947285 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-775b9838-6de9-4bc6-9a03-325d04293a7c tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "POST /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f/action" status: 200 len: 38010 microversion: 2.20 time: 0.114272 Nov 01 01:59:30.948168 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1565/3224] 10.222.0.47 () {62 vars in 1318 bytes} [Mon Nov 1 01:59:30 2021] POST /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f/action => generated 38010 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 01 01:59:31.960121 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-af96fd91-8699-45db-a36c-9322f5102569 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:59:31.961108 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-af96fd91-8699-45db-a36c-9322f5102569 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: ba8a1bd2-a708-4b49-a89b-8c9b61ab418f] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:59:31.968374 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-af96fd91-8699-45db-a36c-9322f5102569 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:59:31.968813 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-af96fd91-8699-45db-a36c-9322f5102569 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:59:31.969556 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-af96fd91-8699-45db-a36c-9322f5102569 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:59:31.969979 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-af96fd91-8699-45db-a36c-9322f5102569 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:59:32.057671 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-af96fd91-8699-45db-a36c-9322f5102569 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "POST /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f/action" status: 200 len: 38250 microversion: 2.20 time: 0.101461 Nov 01 01:59:32.058455 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1660/3225] 10.222.0.47 () {62 vars in 1318 bytes} [Mon Nov 1 01:59:31 2021] POST /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f/action => generated 38250 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 01 01:59:33.069997 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-bec5c0c8-17dc-4633-a0b5-9106d163a263 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:59:33.070937 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-bec5c0c8-17dc-4633-a0b5-9106d163a263 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: ba8a1bd2-a708-4b49-a89b-8c9b61ab418f] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:59:33.078693 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-bec5c0c8-17dc-4633-a0b5-9106d163a263 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:59:33.079138 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-bec5c0c8-17dc-4633-a0b5-9106d163a263 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:59:33.079922 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-bec5c0c8-17dc-4633-a0b5-9106d163a263 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:59:33.080347 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-bec5c0c8-17dc-4633-a0b5-9106d163a263 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:59:33.161742 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-bec5c0c8-17dc-4633-a0b5-9106d163a263 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "POST /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f/action" status: 200 len: 38250 microversion: 2.20 time: 0.095731 Nov 01 01:59:33.162652 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1566/3226] 10.222.0.47 () {62 vars in 1318 bytes} [Mon Nov 1 01:59:33 2021] POST /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f/action => generated 38250 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 01 01:59:34.174588 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-207fbfc5-c756-4bb2-8c1d-1151924b2e5c tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:59:34.175635 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-207fbfc5-c756-4bb2-8c1d-1151924b2e5c tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: ba8a1bd2-a708-4b49-a89b-8c9b61ab418f] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:59:34.182606 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-207fbfc5-c756-4bb2-8c1d-1151924b2e5c tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:59:34.183000 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-207fbfc5-c756-4bb2-8c1d-1151924b2e5c tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:59:34.183749 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-207fbfc5-c756-4bb2-8c1d-1151924b2e5c tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:59:34.184200 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-207fbfc5-c756-4bb2-8c1d-1151924b2e5c tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:59:34.264696 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-207fbfc5-c756-4bb2-8c1d-1151924b2e5c tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "POST /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f/action" status: 200 len: 38250 microversion: 2.20 time: 0.094373 Nov 01 01:59:34.266719 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1661/3227] 10.222.0.47 () {62 vars in 1318 bytes} [Mon Nov 1 01:59:34 2021] POST /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f/action => generated 38250 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 01 01:59:35.277097 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-5553238f-c015-4edb-97bf-2b5077b17ac7 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:59:35.278092 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-5553238f-c015-4edb-97bf-2b5077b17ac7 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: ba8a1bd2-a708-4b49-a89b-8c9b61ab418f] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:59:35.284936 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5553238f-c015-4edb-97bf-2b5077b17ac7 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:59:35.285386 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5553238f-c015-4edb-97bf-2b5077b17ac7 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:59:35.286142 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5553238f-c015-4edb-97bf-2b5077b17ac7 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:59:35.286605 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5553238f-c015-4edb-97bf-2b5077b17ac7 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:59:35.380262 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-5553238f-c015-4edb-97bf-2b5077b17ac7 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "POST /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f/action" status: 200 len: 38393 microversion: 2.20 time: 0.107090 Nov 01 01:59:35.380918 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1567/3228] 10.222.0.47 () {62 vars in 1318 bytes} [Mon Nov 1 01:59:35 2021] POST /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f/action => generated 38393 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 01 01:59:35.391354 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-1a5201fa-ad8f-4c18-986a-35b78f7087a0 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:59:35.391853 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-1a5201fa-ad8f-4c18-986a-35b78f7087a0 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: ba8a1bd2-a708-4b49-a89b-8c9b61ab418f] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:59:35.398914 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-1a5201fa-ad8f-4c18-986a-35b78f7087a0 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:59:35.402727 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-1a5201fa-ad8f-4c18-986a-35b78f7087a0 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:59:35.402727 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-1a5201fa-ad8f-4c18-986a-35b78f7087a0 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:59:35.402727 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-1a5201fa-ad8f-4c18-986a-35b78f7087a0 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:59:35.428030 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-1a5201fa-ad8f-4c18-986a-35b78f7087a0 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "GET /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f/ips" status: 200 len: 152 microversion: 2.20 time: 0.040733 Nov 01 01:59:35.428616 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1662/3229] 10.222.0.47 () {60 vars in 1288 bytes} [Mon Nov 1 01:59:35 2021] GET /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f/ips => generated 152 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 01 01:59:38.851076 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-d3a83dc2-b799-443b-8f77-4553ee492bcf tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:59:38.851726 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-d3a83dc2-b799-443b-8f77-4553ee492bcf tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: ba8a1bd2-a708-4b49-a89b-8c9b61ab418f] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:59:38.858547 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d3a83dc2-b799-443b-8f77-4553ee492bcf tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:59:38.858994 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d3a83dc2-b799-443b-8f77-4553ee492bcf tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:59:38.859746 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d3a83dc2-b799-443b-8f77-4553ee492bcf tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:59:38.860173 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d3a83dc2-b799-443b-8f77-4553ee492bcf tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:59:38.882310 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.objects.instance [None req-d3a83dc2-b799-443b-8f77-4553ee492bcf tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lazy-loading 'flavor' on Instance uuid ba8a1bd2-a708-4b49-a89b-8c9b61ab418f {{(pid=116266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 01 01:59:39.447714 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-d3a83dc2-b799-443b-8f77-4553ee492bcf tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "POST /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f/action" status: 202 len: 0 microversion: 2.20 time: 0.600612 Nov 01 01:59:39.448327 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1568/3230] 10.222.0.47 () {62 vars in 1318 bytes} [Mon Nov 1 01:59:38 2021] POST /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f/action => generated 0 bytes in 602 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Nov 01 01:59:39.457272 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-33d5e536-5bad-4ad4-b739-2e67d7780e65 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:59:39.457948 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-33d5e536-5bad-4ad4-b739-2e67d7780e65 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: ba8a1bd2-a708-4b49-a89b-8c9b61ab418f] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:59:39.464224 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-33d5e536-5bad-4ad4-b739-2e67d7780e65 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:59:39.465204 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-33d5e536-5bad-4ad4-b739-2e67d7780e65 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:59:39.465543 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-33d5e536-5bad-4ad4-b739-2e67d7780e65 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:59:39.466000 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-33d5e536-5bad-4ad4-b739-2e67d7780e65 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:59:39.587010 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-33d5e536-5bad-4ad4-b739-2e67d7780e65 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:59:39.594748 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-33d5e536-5bad-4ad4-b739-2e67d7780e65 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:59:39.596242 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-33d5e536-5bad-4ad4-b739-2e67d7780e65 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:59:39.597388 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-33d5e536-5bad-4ad4-b739-2e67d7780e65 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "GET /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f" status: 200 len: 1724 microversion: 2.20 time: 0.144914 Nov 01 01:59:39.597947 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1663/3231] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Nov 1 01:59:39 2021] GET /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f => generated 1724 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 01:59:40.616973 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-a27c9ce9-4a35-4d7a-abae-2989c8a2d235 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:59:40.617644 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-a27c9ce9-4a35-4d7a-abae-2989c8a2d235 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: ba8a1bd2-a708-4b49-a89b-8c9b61ab418f] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:59:40.624364 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a27c9ce9-4a35-4d7a-abae-2989c8a2d235 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:59:40.626550 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a27c9ce9-4a35-4d7a-abae-2989c8a2d235 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:59:40.626550 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a27c9ce9-4a35-4d7a-abae-2989c8a2d235 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:59:40.626550 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a27c9ce9-4a35-4d7a-abae-2989c8a2d235 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:59:40.744504 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-a27c9ce9-4a35-4d7a-abae-2989c8a2d235 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:59:40.752657 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-a27c9ce9-4a35-4d7a-abae-2989c8a2d235 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:59:40.754135 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-a27c9ce9-4a35-4d7a-abae-2989c8a2d235 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:59:40.755326 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-a27c9ce9-4a35-4d7a-abae-2989c8a2d235 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "GET /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f" status: 200 len: 1724 microversion: 2.20 time: 0.143119 Nov 01 01:59:40.755875 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1569/3232] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Nov 1 01:59:40 2021] GET /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f => generated 1724 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 01:59:41.774103 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-044e6b4a-c107-47ba-873f-e90351bceaa5 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:59:41.774728 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-044e6b4a-c107-47ba-873f-e90351bceaa5 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: ba8a1bd2-a708-4b49-a89b-8c9b61ab418f] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:59:41.781043 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-044e6b4a-c107-47ba-873f-e90351bceaa5 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:59:41.781510 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-044e6b4a-c107-47ba-873f-e90351bceaa5 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:59:41.782260 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-044e6b4a-c107-47ba-873f-e90351bceaa5 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:59:41.782714 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-044e6b4a-c107-47ba-873f-e90351bceaa5 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:59:41.906855 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-044e6b4a-c107-47ba-873f-e90351bceaa5 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:59:41.914573 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-044e6b4a-c107-47ba-873f-e90351bceaa5 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:59:41.916074 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-044e6b4a-c107-47ba-873f-e90351bceaa5 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:59:41.917222 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-044e6b4a-c107-47ba-873f-e90351bceaa5 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "GET /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f" status: 200 len: 1724 microversion: 2.20 time: 0.146840 Nov 01 01:59:41.918285 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1664/3233] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Nov 1 01:59:41 2021] GET /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f => generated 1724 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 01:59:42.936658 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-44bea9cc-4911-42aa-bb80-882d3ff21f19 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:59:42.937246 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-44bea9cc-4911-42aa-bb80-882d3ff21f19 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: ba8a1bd2-a708-4b49-a89b-8c9b61ab418f] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:59:42.943594 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-44bea9cc-4911-42aa-bb80-882d3ff21f19 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:59:42.944034 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-44bea9cc-4911-42aa-bb80-882d3ff21f19 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:59:42.944778 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-44bea9cc-4911-42aa-bb80-882d3ff21f19 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:59:42.945203 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-44bea9cc-4911-42aa-bb80-882d3ff21f19 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:59:43.064828 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-44bea9cc-4911-42aa-bb80-882d3ff21f19 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:59:43.072484 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-44bea9cc-4911-42aa-bb80-882d3ff21f19 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:59:43.074676 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-44bea9cc-4911-42aa-bb80-882d3ff21f19 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:59:43.075859 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-44bea9cc-4911-42aa-bb80-882d3ff21f19 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "GET /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f" status: 200 len: 1724 microversion: 2.20 time: 0.143389 Nov 01 01:59:43.076773 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1570/3234] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Nov 1 01:59:42 2021] GET /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f => generated 1724 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 01:59:44.094199 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-24ad7130-dd45-4e3b-955b-14d22e3c3b33 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:59:44.094842 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-24ad7130-dd45-4e3b-955b-14d22e3c3b33 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: ba8a1bd2-a708-4b49-a89b-8c9b61ab418f] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:59:44.100941 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-24ad7130-dd45-4e3b-955b-14d22e3c3b33 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:59:44.101378 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-24ad7130-dd45-4e3b-955b-14d22e3c3b33 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:59:44.102125 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-24ad7130-dd45-4e3b-955b-14d22e3c3b33 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:59:44.102592 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-24ad7130-dd45-4e3b-955b-14d22e3c3b33 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:59:44.221725 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-24ad7130-dd45-4e3b-955b-14d22e3c3b33 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:59:44.229504 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-24ad7130-dd45-4e3b-955b-14d22e3c3b33 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:59:44.231024 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-24ad7130-dd45-4e3b-955b-14d22e3c3b33 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:59:44.232172 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-24ad7130-dd45-4e3b-955b-14d22e3c3b33 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "GET /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f" status: 200 len: 1724 microversion: 2.20 time: 0.142402 Nov 01 01:59:44.232724 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1665/3235] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Nov 1 01:59:44 2021] GET /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f => generated 1724 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 01:59:45.250110 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-76912281-6f93-4b44-a518-2150294e1607 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:59:45.250812 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-76912281-6f93-4b44-a518-2150294e1607 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: ba8a1bd2-a708-4b49-a89b-8c9b61ab418f] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:59:45.257022 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-76912281-6f93-4b44-a518-2150294e1607 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:59:45.257467 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-76912281-6f93-4b44-a518-2150294e1607 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:59:45.258226 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-76912281-6f93-4b44-a518-2150294e1607 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:59:45.258689 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-76912281-6f93-4b44-a518-2150294e1607 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:59:45.380850 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-76912281-6f93-4b44-a518-2150294e1607 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:59:45.388828 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-76912281-6f93-4b44-a518-2150294e1607 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:59:45.390320 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-76912281-6f93-4b44-a518-2150294e1607 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:59:45.391494 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-76912281-6f93-4b44-a518-2150294e1607 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "GET /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f" status: 200 len: 1724 microversion: 2.20 time: 0.145653 Nov 01 01:59:45.392043 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1571/3236] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Nov 1 01:59:45 2021] GET /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f => generated 1724 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 01:59:46.409878 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-95161a86-0b45-4ccc-8482-decd9d1d1e0d tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:59:46.410513 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-95161a86-0b45-4ccc-8482-decd9d1d1e0d tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: ba8a1bd2-a708-4b49-a89b-8c9b61ab418f] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:59:46.416784 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-95161a86-0b45-4ccc-8482-decd9d1d1e0d tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:59:46.417226 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-95161a86-0b45-4ccc-8482-decd9d1d1e0d tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:59:46.418000 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-95161a86-0b45-4ccc-8482-decd9d1d1e0d tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:59:46.418447 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-95161a86-0b45-4ccc-8482-decd9d1d1e0d tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:59:46.535634 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-95161a86-0b45-4ccc-8482-decd9d1d1e0d tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:59:46.543510 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-95161a86-0b45-4ccc-8482-decd9d1d1e0d tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:59:46.545005 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-95161a86-0b45-4ccc-8482-decd9d1d1e0d tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:59:46.546150 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-95161a86-0b45-4ccc-8482-decd9d1d1e0d tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "GET /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f" status: 200 len: 1724 microversion: 2.20 time: 0.139980 Nov 01 01:59:46.546751 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1666/3237] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Nov 1 01:59:46 2021] GET /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f => generated 1724 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 01:59:47.564080 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-71742519-3b92-40fa-b60a-58754792514b tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:59:47.564676 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-71742519-3b92-40fa-b60a-58754792514b tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: ba8a1bd2-a708-4b49-a89b-8c9b61ab418f] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:59:47.570976 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-71742519-3b92-40fa-b60a-58754792514b tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:59:47.571414 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-71742519-3b92-40fa-b60a-58754792514b tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:59:47.572154 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-71742519-3b92-40fa-b60a-58754792514b tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:59:47.572578 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-71742519-3b92-40fa-b60a-58754792514b tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:59:47.690706 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-71742519-3b92-40fa-b60a-58754792514b tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:59:47.698887 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-71742519-3b92-40fa-b60a-58754792514b tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:59:47.701263 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-71742519-3b92-40fa-b60a-58754792514b tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:59:47.702416 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-71742519-3b92-40fa-b60a-58754792514b tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "GET /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f" status: 200 len: 1724 microversion: 2.20 time: 0.142055 Nov 01 01:59:47.702997 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1572/3238] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Nov 1 01:59:47 2021] GET /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f => generated 1724 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 01:59:48.721809 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-6c9f723c-f4e1-46ed-8256-3d138bd22e15 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:59:48.723288 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-6c9f723c-f4e1-46ed-8256-3d138bd22e15 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: ba8a1bd2-a708-4b49-a89b-8c9b61ab418f] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:59:48.729638 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-6c9f723c-f4e1-46ed-8256-3d138bd22e15 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:59:48.730077 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-6c9f723c-f4e1-46ed-8256-3d138bd22e15 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:59:48.731371 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-6c9f723c-f4e1-46ed-8256-3d138bd22e15 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:59:48.731795 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-6c9f723c-f4e1-46ed-8256-3d138bd22e15 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:59:48.852347 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-6c9f723c-f4e1-46ed-8256-3d138bd22e15 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:59:48.860542 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-6c9f723c-f4e1-46ed-8256-3d138bd22e15 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:59:48.862048 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-6c9f723c-f4e1-46ed-8256-3d138bd22e15 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:59:48.863231 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-6c9f723c-f4e1-46ed-8256-3d138bd22e15 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "GET /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f" status: 200 len: 1724 microversion: 2.20 time: 0.146669 Nov 01 01:59:48.863792 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1667/3239] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Nov 1 01:59:48 2021] GET /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f => generated 1724 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 01:59:49.881126 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-050eb434-1813-4e76-bba2-6d541c633563 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:59:49.881713 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-050eb434-1813-4e76-bba2-6d541c633563 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: ba8a1bd2-a708-4b49-a89b-8c9b61ab418f] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:59:49.890474 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-050eb434-1813-4e76-bba2-6d541c633563 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:59:49.890924 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-050eb434-1813-4e76-bba2-6d541c633563 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:59:49.891681 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-050eb434-1813-4e76-bba2-6d541c633563 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:59:49.892113 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-050eb434-1813-4e76-bba2-6d541c633563 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:59:50.011517 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-050eb434-1813-4e76-bba2-6d541c633563 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:59:50.019120 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-050eb434-1813-4e76-bba2-6d541c633563 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:59:50.020613 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-050eb434-1813-4e76-bba2-6d541c633563 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:59:50.021763 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-050eb434-1813-4e76-bba2-6d541c633563 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "GET /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f" status: 200 len: 1724 microversion: 2.20 time: 0.144377 Nov 01 01:59:50.022316 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1573/3240] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Nov 1 01:59:49 2021] GET /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f => generated 1724 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 01:59:51.039388 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-02a32275-1253-483d-b3e2-917287cc4b46 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:59:51.039985 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-02a32275-1253-483d-b3e2-917287cc4b46 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: ba8a1bd2-a708-4b49-a89b-8c9b61ab418f] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:59:51.046245 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-02a32275-1253-483d-b3e2-917287cc4b46 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:59:51.046720 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-02a32275-1253-483d-b3e2-917287cc4b46 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:59:51.047730 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-02a32275-1253-483d-b3e2-917287cc4b46 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:59:51.048150 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-02a32275-1253-483d-b3e2-917287cc4b46 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:59:51.169215 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-02a32275-1253-483d-b3e2-917287cc4b46 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:59:51.177052 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-02a32275-1253-483d-b3e2-917287cc4b46 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:59:51.178569 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-02a32275-1253-483d-b3e2-917287cc4b46 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:59:51.179714 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-02a32275-1253-483d-b3e2-917287cc4b46 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "GET /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f" status: 200 len: 1745 microversion: 2.20 time: 0.144087 Nov 01 01:59:51.180258 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1668/3241] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Nov 1 01:59:51 2021] GET /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f => generated 1745 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 01:59:52.198402 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-df571543-df7f-4c17-b1b2-3673a1c438f5 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:59:52.199026 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-df571543-df7f-4c17-b1b2-3673a1c438f5 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: ba8a1bd2-a708-4b49-a89b-8c9b61ab418f] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:59:52.205704 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-df571543-df7f-4c17-b1b2-3673a1c438f5 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:59:52.206147 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-df571543-df7f-4c17-b1b2-3673a1c438f5 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:59:52.207039 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-df571543-df7f-4c17-b1b2-3673a1c438f5 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:59:52.207466 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-df571543-df7f-4c17-b1b2-3673a1c438f5 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:59:52.327619 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-df571543-df7f-4c17-b1b2-3673a1c438f5 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:59:52.335194 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-df571543-df7f-4c17-b1b2-3673a1c438f5 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:59:52.336693 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-df571543-df7f-4c17-b1b2-3673a1c438f5 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:59:52.337834 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-df571543-df7f-4c17-b1b2-3673a1c438f5 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "GET /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f" status: 200 len: 1745 microversion: 2.20 time: 0.143168 Nov 01 01:59:52.338383 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1574/3242] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Nov 1 01:59:52 2021] GET /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f => generated 1745 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 01:59:53.356580 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-83f594f0-0763-4513-96e4-aa4d2ba6a989 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:59:53.357185 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-83f594f0-0763-4513-96e4-aa4d2ba6a989 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: ba8a1bd2-a708-4b49-a89b-8c9b61ab418f] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:59:53.363388 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-83f594f0-0763-4513-96e4-aa4d2ba6a989 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:59:53.363834 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-83f594f0-0763-4513-96e4-aa4d2ba6a989 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:59:53.368400 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-83f594f0-0763-4513-96e4-aa4d2ba6a989 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:59:53.368400 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-83f594f0-0763-4513-96e4-aa4d2ba6a989 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:59:53.484467 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-83f594f0-0763-4513-96e4-aa4d2ba6a989 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:59:53.492254 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-83f594f0-0763-4513-96e4-aa4d2ba6a989 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:59:53.493769 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-83f594f0-0763-4513-96e4-aa4d2ba6a989 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:59:53.494972 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-83f594f0-0763-4513-96e4-aa4d2ba6a989 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "GET /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f" status: 200 len: 1745 microversion: 2.20 time: 0.142118 Nov 01 01:59:53.495538 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1669/3243] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Nov 1 01:59:53 2021] GET /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f => generated 1745 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 01:59:54.513404 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-342c184f-2196-4a56-80b5-a6fcfca1d1bb tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:59:54.514003 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-342c184f-2196-4a56-80b5-a6fcfca1d1bb tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: ba8a1bd2-a708-4b49-a89b-8c9b61ab418f] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:59:54.520245 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-342c184f-2196-4a56-80b5-a6fcfca1d1bb tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:59:54.520691 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-342c184f-2196-4a56-80b5-a6fcfca1d1bb tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:59:54.521477 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-342c184f-2196-4a56-80b5-a6fcfca1d1bb tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:59:54.521904 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-342c184f-2196-4a56-80b5-a6fcfca1d1bb tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:59:54.637772 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-342c184f-2196-4a56-80b5-a6fcfca1d1bb tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:59:54.645420 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-342c184f-2196-4a56-80b5-a6fcfca1d1bb tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:59:54.646955 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-342c184f-2196-4a56-80b5-a6fcfca1d1bb tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:59:54.648118 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-342c184f-2196-4a56-80b5-a6fcfca1d1bb tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "GET /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f" status: 200 len: 1745 microversion: 2.20 time: 0.138993 Nov 01 01:59:54.648683 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1575/3244] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Nov 1 01:59:54 2021] GET /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f => generated 1745 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 01:59:55.546340 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [req-6850088a-414d-4142-977f-2c7719f2a917 req-5b0e513c-610a-4c5a-86a2-18fa04e5a45a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba8a1bd2-a708-4b49-a89b-8c9b61ab418f", "name": "network-vif-plugged", "status": "completed", "tag": "639f2165-b424-447e-8ca4-13353eb4416d"}]} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 01:59:55.548293 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 01 01:59:55.548293 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: warnings.warn(msg) Nov 01 01:59:55.555136 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [req-6850088a-414d-4142-977f-2c7719f2a917 req-5b0e513c-610a-4c5a-86a2-18fa04e5a45a service nova] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:59:55.555577 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [req-6850088a-414d-4142-977f-2c7719f2a917 req-5b0e513c-610a-4c5a-86a2-18fa04e5a45a service nova] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:59:55.566228 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.compute.server_external_events [req-6850088a-414d-4142-977f-2c7719f2a917 req-5b0e513c-610a-4c5a-86a2-18fa04e5a45a service nova] Creating event network-vif-plugged:639f2165-b424-447e-8ca4-13353eb4416d for instance ba8a1bd2-a708-4b49-a89b-8c9b61ab418f on hv-cinder-81561 Nov 01 01:59:55.571333 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [req-6850088a-414d-4142-977f-2c7719f2a917 req-5b0e513c-610a-4c5a-86a2-18fa04e5a45a service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088973 Nov 01 01:59:55.572022 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1670/3245] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Nov 1 01:59:55 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 01:59:55.665863 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-26429b7b-8f31-4915-b4ba-7b03bb2a2d25 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:59:55.666485 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-26429b7b-8f31-4915-b4ba-7b03bb2a2d25 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: ba8a1bd2-a708-4b49-a89b-8c9b61ab418f] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:59:55.673567 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-26429b7b-8f31-4915-b4ba-7b03bb2a2d25 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:59:55.674008 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-26429b7b-8f31-4915-b4ba-7b03bb2a2d25 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:59:55.674779 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-26429b7b-8f31-4915-b4ba-7b03bb2a2d25 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:59:55.675205 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-26429b7b-8f31-4915-b4ba-7b03bb2a2d25 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:59:55.795823 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-26429b7b-8f31-4915-b4ba-7b03bb2a2d25 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:59:55.803579 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-26429b7b-8f31-4915-b4ba-7b03bb2a2d25 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:59:55.805053 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-26429b7b-8f31-4915-b4ba-7b03bb2a2d25 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:59:55.806177 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-26429b7b-8f31-4915-b4ba-7b03bb2a2d25 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "GET /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f" status: 200 len: 1745 microversion: 2.20 time: 0.144020 Nov 01 01:59:55.806756 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1576/3246] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Nov 1 01:59:55 2021] GET /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f => generated 1745 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 01:59:56.825756 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-2415dd37-1413-49dd-b880-f40d9cc54b9e tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:59:56.826475 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-2415dd37-1413-49dd-b880-f40d9cc54b9e tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: ba8a1bd2-a708-4b49-a89b-8c9b61ab418f] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:59:56.832591 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-2415dd37-1413-49dd-b880-f40d9cc54b9e tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:59:56.833035 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-2415dd37-1413-49dd-b880-f40d9cc54b9e tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:59:56.833794 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-2415dd37-1413-49dd-b880-f40d9cc54b9e tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:59:56.834225 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-2415dd37-1413-49dd-b880-f40d9cc54b9e tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:59:56.962230 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-2415dd37-1413-49dd-b880-f40d9cc54b9e tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:59:56.970541 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-2415dd37-1413-49dd-b880-f40d9cc54b9e tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:59:56.972347 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-2415dd37-1413-49dd-b880-f40d9cc54b9e tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:59:56.973756 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-2415dd37-1413-49dd-b880-f40d9cc54b9e tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "GET /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f" status: 200 len: 1740 microversion: 2.20 time: 0.152635 Nov 01 01:59:56.974878 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1671/3247] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Nov 1 01:59:56 2021] GET /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f => generated 1740 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 01:59:57.994483 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-15eac1d7-d5df-4216-b032-4a0ba5b17659 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:59:57.995113 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-15eac1d7-d5df-4216-b032-4a0ba5b17659 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: ba8a1bd2-a708-4b49-a89b-8c9b61ab418f] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:59:58.002280 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-15eac1d7-d5df-4216-b032-4a0ba5b17659 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:59:58.002786 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-15eac1d7-d5df-4216-b032-4a0ba5b17659 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:59:58.003637 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-15eac1d7-d5df-4216-b032-4a0ba5b17659 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:59:58.004158 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-15eac1d7-d5df-4216-b032-4a0ba5b17659 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:59:58.134694 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-15eac1d7-d5df-4216-b032-4a0ba5b17659 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:59:58.147178 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-15eac1d7-d5df-4216-b032-4a0ba5b17659 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:59:58.148683 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-15eac1d7-d5df-4216-b032-4a0ba5b17659 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:59:58.149984 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-15eac1d7-d5df-4216-b032-4a0ba5b17659 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "GET /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f" status: 200 len: 1740 microversion: 2.20 time: 0.159249 Nov 01 01:59:58.150566 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1577/3248] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Nov 1 01:59:57 2021] GET /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f => generated 1740 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 01:59:59.169993 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-8a43e4bd-4a1a-4e4f-8438-038cd2b6f4f7 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 01:59:59.171399 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-8a43e4bd-4a1a-4e4f-8438-038cd2b6f4f7 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: ba8a1bd2-a708-4b49-a89b-8c9b61ab418f] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 01:59:59.177976 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8a43e4bd-4a1a-4e4f-8438-038cd2b6f4f7 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:59:59.178851 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8a43e4bd-4a1a-4e4f-8438-038cd2b6f4f7 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:59:59.179883 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8a43e4bd-4a1a-4e4f-8438-038cd2b6f4f7 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 01:59:59.180381 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-8a43e4bd-4a1a-4e4f-8438-038cd2b6f4f7 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 01:59:59.311284 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-8a43e4bd-4a1a-4e4f-8438-038cd2b6f4f7 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:59:59.319069 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-8a43e4bd-4a1a-4e4f-8438-038cd2b6f4f7 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:59:59.320567 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-8a43e4bd-4a1a-4e4f-8438-038cd2b6f4f7 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 01:59:59.321724 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-8a43e4bd-4a1a-4e4f-8438-038cd2b6f4f7 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "GET /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f" status: 200 len: 1740 microversion: 2.20 time: 0.155499 Nov 01 01:59:59.326560 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1672/3249] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Nov 1 01:59:59 2021] GET /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f => generated 1740 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 02:00:00.339501 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-89099064-b2c1-4b91-9bc5-cf0122660a75 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 02:00:00.340121 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-89099064-b2c1-4b91-9bc5-cf0122660a75 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: ba8a1bd2-a708-4b49-a89b-8c9b61ab418f] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 02:00:00.346927 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-89099064-b2c1-4b91-9bc5-cf0122660a75 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:00:00.347369 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-89099064-b2c1-4b91-9bc5-cf0122660a75 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:00:00.348457 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-89099064-b2c1-4b91-9bc5-cf0122660a75 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:00:00.349225 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-89099064-b2c1-4b91-9bc5-cf0122660a75 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:00:00.487587 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-89099064-b2c1-4b91-9bc5-cf0122660a75 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 02:00:00.497045 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-89099064-b2c1-4b91-9bc5-cf0122660a75 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 02:00:00.498737 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-89099064-b2c1-4b91-9bc5-cf0122660a75 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 02:00:00.500430 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-89099064-b2c1-4b91-9bc5-cf0122660a75 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "GET /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f" status: 200 len: 1740 microversion: 2.20 time: 0.164708 Nov 01 02:00:00.501559 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1578/3250] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Nov 1 02:00:00 2021] GET /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f => generated 1740 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 02:00:01.519595 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-00b1a95b-95cd-4393-8dcd-267fd56a2332 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 02:00:01.520352 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-00b1a95b-95cd-4393-8dcd-267fd56a2332 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: ba8a1bd2-a708-4b49-a89b-8c9b61ab418f] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 02:00:01.526935 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-00b1a95b-95cd-4393-8dcd-267fd56a2332 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:00:01.527857 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-00b1a95b-95cd-4393-8dcd-267fd56a2332 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:00:01.528886 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-00b1a95b-95cd-4393-8dcd-267fd56a2332 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:00:01.529371 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-00b1a95b-95cd-4393-8dcd-267fd56a2332 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:00:01.656049 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-00b1a95b-95cd-4393-8dcd-267fd56a2332 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 02:00:01.664509 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-00b1a95b-95cd-4393-8dcd-267fd56a2332 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 02:00:01.666054 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-00b1a95b-95cd-4393-8dcd-267fd56a2332 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 02:00:01.667268 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-00b1a95b-95cd-4393-8dcd-267fd56a2332 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "GET /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f" status: 200 len: 1740 microversion: 2.20 time: 0.151381 Nov 01 02:00:01.667837 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1673/3251] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Nov 1 02:00:01 2021] GET /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f => generated 1740 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 02:00:02.687557 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-788d968b-a451-4efa-b61f-2197b71ba593 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 02:00:02.688575 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-788d968b-a451-4efa-b61f-2197b71ba593 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: ba8a1bd2-a708-4b49-a89b-8c9b61ab418f] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 02:00:02.695834 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-788d968b-a451-4efa-b61f-2197b71ba593 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:00:02.696389 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-788d968b-a451-4efa-b61f-2197b71ba593 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:00:02.697337 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-788d968b-a451-4efa-b61f-2197b71ba593 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:00:02.697789 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-788d968b-a451-4efa-b61f-2197b71ba593 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:00:02.839683 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-788d968b-a451-4efa-b61f-2197b71ba593 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 02:00:02.847353 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-788d968b-a451-4efa-b61f-2197b71ba593 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 02:00:02.848853 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-788d968b-a451-4efa-b61f-2197b71ba593 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 02:00:02.849987 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-788d968b-a451-4efa-b61f-2197b71ba593 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "GET /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f" status: 200 len: 1740 microversion: 2.20 time: 0.167167 Nov 01 02:00:02.850569 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1579/3252] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Nov 1 02:00:02 2021] GET /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f => generated 1740 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 02:00:03.869151 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-1792e7d5-7376-4a91-8e17-a50bcf39bd93 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 02:00:03.869874 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-1792e7d5-7376-4a91-8e17-a50bcf39bd93 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: ba8a1bd2-a708-4b49-a89b-8c9b61ab418f] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 02:00:03.877148 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-1792e7d5-7376-4a91-8e17-a50bcf39bd93 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:00:03.877941 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-1792e7d5-7376-4a91-8e17-a50bcf39bd93 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:00:03.878989 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-1792e7d5-7376-4a91-8e17-a50bcf39bd93 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:00:03.879829 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-1792e7d5-7376-4a91-8e17-a50bcf39bd93 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:00:04.031881 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-1792e7d5-7376-4a91-8e17-a50bcf39bd93 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 02:00:04.040766 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-1792e7d5-7376-4a91-8e17-a50bcf39bd93 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 02:00:04.042281 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-1792e7d5-7376-4a91-8e17-a50bcf39bd93 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 02:00:04.043460 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-1792e7d5-7376-4a91-8e17-a50bcf39bd93 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "GET /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f" status: 200 len: 1740 microversion: 2.20 time: 0.178216 Nov 01 02:00:04.055330 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1674/3253] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Nov 1 02:00:03 2021] GET /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f => generated 1740 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 02:00:05.061435 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-77821f38-2a9b-4c46-8e15-4e1d83ae867d tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 02:00:05.062175 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-77821f38-2a9b-4c46-8e15-4e1d83ae867d tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: ba8a1bd2-a708-4b49-a89b-8c9b61ab418f] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 02:00:05.069106 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-77821f38-2a9b-4c46-8e15-4e1d83ae867d tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:00:05.069501 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-77821f38-2a9b-4c46-8e15-4e1d83ae867d tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:00:05.070485 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-77821f38-2a9b-4c46-8e15-4e1d83ae867d tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:00:05.070721 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-77821f38-2a9b-4c46-8e15-4e1d83ae867d tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:00:05.205244 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-77821f38-2a9b-4c46-8e15-4e1d83ae867d tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 02:00:05.216887 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-77821f38-2a9b-4c46-8e15-4e1d83ae867d tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 02:00:05.218576 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-77821f38-2a9b-4c46-8e15-4e1d83ae867d tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 02:00:05.219745 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-77821f38-2a9b-4c46-8e15-4e1d83ae867d tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "GET /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f" status: 200 len: 1740 microversion: 2.20 time: 0.162629 Nov 01 02:00:05.220301 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1580/3254] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Nov 1 02:00:05 2021] GET /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f => generated 1740 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 02:00:06.237830 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-a840140b-301f-4638-adfe-db41875986ad tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 02:00:06.238579 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-a840140b-301f-4638-adfe-db41875986ad tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: ba8a1bd2-a708-4b49-a89b-8c9b61ab418f] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 02:00:06.244844 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a840140b-301f-4638-adfe-db41875986ad tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:00:06.245254 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a840140b-301f-4638-adfe-db41875986ad tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:00:06.246027 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a840140b-301f-4638-adfe-db41875986ad tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:00:06.246479 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a840140b-301f-4638-adfe-db41875986ad tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:00:06.391961 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-a840140b-301f-4638-adfe-db41875986ad tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 02:00:06.405203 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-a840140b-301f-4638-adfe-db41875986ad tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 02:00:06.409585 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-a840140b-301f-4638-adfe-db41875986ad tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 02:00:06.409585 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-a840140b-301f-4638-adfe-db41875986ad tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "GET /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f" status: 200 len: 1740 microversion: 2.20 time: 0.174314 Nov 01 02:00:06.409585 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1675/3255] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Nov 1 02:00:06 2021] GET /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f => generated 1740 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 02:00:07.426075 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-357dd0f2-136c-42f7-9f91-9a7cf3e85c00 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 02:00:07.426709 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-357dd0f2-136c-42f7-9f91-9a7cf3e85c00 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: ba8a1bd2-a708-4b49-a89b-8c9b61ab418f] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 02:00:07.432910 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-357dd0f2-136c-42f7-9f91-9a7cf3e85c00 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:00:07.433356 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-357dd0f2-136c-42f7-9f91-9a7cf3e85c00 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:00:07.434115 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-357dd0f2-136c-42f7-9f91-9a7cf3e85c00 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:00:07.435207 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-357dd0f2-136c-42f7-9f91-9a7cf3e85c00 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:00:07.552317 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-357dd0f2-136c-42f7-9f91-9a7cf3e85c00 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 02:00:07.559938 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-357dd0f2-136c-42f7-9f91-9a7cf3e85c00 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 02:00:07.561459 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-357dd0f2-136c-42f7-9f91-9a7cf3e85c00 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 02:00:07.562642 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-357dd0f2-136c-42f7-9f91-9a7cf3e85c00 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "GET /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f" status: 200 len: 1740 microversion: 2.20 time: 0.140229 Nov 01 02:00:07.563199 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1581/3256] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Nov 1 02:00:07 2021] GET /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f => generated 1740 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 02:00:08.581176 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-effc94e3-4b79-49b6-aaf0-79964f1bcab0 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 02:00:08.581787 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-effc94e3-4b79-49b6-aaf0-79964f1bcab0 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: ba8a1bd2-a708-4b49-a89b-8c9b61ab418f] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 02:00:08.587890 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-effc94e3-4b79-49b6-aaf0-79964f1bcab0 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:00:08.588326 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-effc94e3-4b79-49b6-aaf0-79964f1bcab0 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:00:08.589082 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-effc94e3-4b79-49b6-aaf0-79964f1bcab0 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:00:08.589499 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-effc94e3-4b79-49b6-aaf0-79964f1bcab0 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:00:08.707838 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-effc94e3-4b79-49b6-aaf0-79964f1bcab0 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 02:00:08.715490 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-effc94e3-4b79-49b6-aaf0-79964f1bcab0 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 02:00:08.716966 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-effc94e3-4b79-49b6-aaf0-79964f1bcab0 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 02:00:08.718100 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-effc94e3-4b79-49b6-aaf0-79964f1bcab0 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "GET /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f" status: 200 len: 1722 microversion: 2.20 time: 0.140743 Nov 01 02:00:08.718679 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1676/3257] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Nov 1 02:00:08 2021] GET /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f => generated 1722 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 02:00:09.735769 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-95fb3f5a-77ea-4e58-86dc-f8d50fafa693 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 02:00:09.736373 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-95fb3f5a-77ea-4e58-86dc-f8d50fafa693 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: ba8a1bd2-a708-4b49-a89b-8c9b61ab418f] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 02:00:09.742600 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-95fb3f5a-77ea-4e58-86dc-f8d50fafa693 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:00:09.743048 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-95fb3f5a-77ea-4e58-86dc-f8d50fafa693 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:00:09.743800 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-95fb3f5a-77ea-4e58-86dc-f8d50fafa693 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:00:09.744228 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-95fb3f5a-77ea-4e58-86dc-f8d50fafa693 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:00:09.863691 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-95fb3f5a-77ea-4e58-86dc-f8d50fafa693 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 02:00:09.871224 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-95fb3f5a-77ea-4e58-86dc-f8d50fafa693 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 02:00:09.873233 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-95fb3f5a-77ea-4e58-86dc-f8d50fafa693 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 02:00:09.874366 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-95fb3f5a-77ea-4e58-86dc-f8d50fafa693 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "GET /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f" status: 200 len: 1722 microversion: 2.20 time: 0.142273 Nov 01 02:00:09.874949 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1582/3258] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Nov 1 02:00:09 2021] GET /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f => generated 1722 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 02:00:10.893074 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-492b5fcd-3aa5-4172-9630-1dd5b747d395 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 02:00:10.893665 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-492b5fcd-3aa5-4172-9630-1dd5b747d395 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: ba8a1bd2-a708-4b49-a89b-8c9b61ab418f] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 02:00:10.899959 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-492b5fcd-3aa5-4172-9630-1dd5b747d395 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:00:10.905072 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-492b5fcd-3aa5-4172-9630-1dd5b747d395 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:00:10.905072 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-492b5fcd-3aa5-4172-9630-1dd5b747d395 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:00:10.905072 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-492b5fcd-3aa5-4172-9630-1dd5b747d395 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:00:11.018775 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-492b5fcd-3aa5-4172-9630-1dd5b747d395 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 02:00:11.026353 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-492b5fcd-3aa5-4172-9630-1dd5b747d395 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 02:00:11.027886 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-492b5fcd-3aa5-4172-9630-1dd5b747d395 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 02:00:11.029033 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-492b5fcd-3aa5-4172-9630-1dd5b747d395 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "GET /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f" status: 200 len: 1725 microversion: 2.20 time: 0.140302 Nov 01 02:00:11.030290 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1677/3259] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Nov 1 02:00:10 2021] GET /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f => generated 1725 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 02:00:11.047323 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-8ed0a052-4dd9-4785-9412-ce715dedffb0 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "de477497-e086-4a9d-b171-ed26ee79af59"}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 02:00:11.048415 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-8ed0a052-4dd9-4785-9412-ce715dedffb0 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: ba8a1bd2-a708-4b49-a89b-8c9b61ab418f] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 02:00:11.054585 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8ed0a052-4dd9-4785-9412-ce715dedffb0 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:00:11.055030 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8ed0a052-4dd9-4785-9412-ce715dedffb0 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:00:11.055784 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8ed0a052-4dd9-4785-9412-ce715dedffb0 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:00:11.056211 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8ed0a052-4dd9-4785-9412-ce715dedffb0 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:00:11.447944 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [req-07b27693-f4b9-40eb-a069-38c45fc05ae7 req-9c618bba-2c5c-40ba-91bd-d62baf54231a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba8a1bd2-a708-4b49-a89b-8c9b61ab418f", "name": "network-vif-unplugged", "status": "completed", "tag": "639f2165-b424-447e-8ca4-13353eb4416d"}]} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 02:00:11.449539 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 01 02:00:11.449539 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: warnings.warn(msg) Nov 01 02:00:11.456318 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [req-07b27693-f4b9-40eb-a069-38c45fc05ae7 req-9c618bba-2c5c-40ba-91bd-d62baf54231a service nova] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:00:11.456751 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [req-07b27693-f4b9-40eb-a069-38c45fc05ae7 req-9c618bba-2c5c-40ba-91bd-d62baf54231a service nova] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:00:11.467769 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.compute.server_external_events [req-07b27693-f4b9-40eb-a069-38c45fc05ae7 req-9c618bba-2c5c-40ba-91bd-d62baf54231a service nova] Unable to find a host for instance ba8a1bd2-a708-4b49-a89b-8c9b61ab418f. Dropping event network-vif-unplugged {{(pid=116267) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Nov 01 02:00:11.468746 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [req-07b27693-f4b9-40eb-a069-38c45fc05ae7 req-9c618bba-2c5c-40ba-91bd-d62baf54231a service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.024418 Nov 01 02:00:11.469455 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1678/3260] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Nov 1 02:00:11 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 26 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Nov 01 02:00:11.847351 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-8ed0a052-4dd9-4785-9412-ce715dedffb0 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "POST /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.804020 Nov 01 02:00:11.847950 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1583/3261] 10.222.0.47 () {62 vars in 1363 bytes} [Mon Nov 1 02:00:11 2021] POST /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f/os-volume_attachments => generated 188 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 01 02:00:11.953269 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-675fa92a-cd40-44ff-b065-643d656040c7 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 02:00:11.953786 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-675fa92a-cd40-44ff-b065-643d656040c7 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: ba8a1bd2-a708-4b49-a89b-8c9b61ab418f] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 02:00:11.959848 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-675fa92a-cd40-44ff-b065-643d656040c7 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:00:11.960287 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-675fa92a-cd40-44ff-b065-643d656040c7 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:00:11.961033 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-675fa92a-cd40-44ff-b065-643d656040c7 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:00:11.961457 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-675fa92a-cd40-44ff-b065-643d656040c7 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:00:12.453579 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-675fa92a-cd40-44ff-b065-643d656040c7 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "DELETE /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f/os-volume_attachments/de477497-e086-4a9d-b171-ed26ee79af59" status: 202 len: 0 microversion: 2.20 time: 0.504414 Nov 01 02:00:12.454170 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1679/3262] 10.222.0.47 () {60 vars in 1456 bytes} [Mon Nov 1 02:00:11 2021] DELETE /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f/os-volume_attachments/de477497-e086-4a9d-b171-ed26ee79af59 => generated 0 bytes in 506 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 01 02:00:12.506987 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-f2b3ce68-6bdc-4e57-9700-22b6f95f58da tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 02:00:12.507551 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-f2b3ce68-6bdc-4e57-9700-22b6f95f58da tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: ba8a1bd2-a708-4b49-a89b-8c9b61ab418f] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 02:00:12.513808 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f2b3ce68-6bdc-4e57-9700-22b6f95f58da tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:00:12.514253 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f2b3ce68-6bdc-4e57-9700-22b6f95f58da tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:00:12.515531 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f2b3ce68-6bdc-4e57-9700-22b6f95f58da tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:00:12.515959 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f2b3ce68-6bdc-4e57-9700-22b6f95f58da tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:00:12.736236 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-f2b3ce68-6bdc-4e57-9700-22b6f95f58da tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "POST /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f/action" status: 202 len: 0 microversion: 2.20 time: 0.232850 Nov 01 02:00:12.736764 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1584/3263] 10.222.0.47 () {62 vars in 1318 bytes} [Mon Nov 1 02:00:12 2021] POST /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f/action => generated 0 bytes in 234 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 01 02:00:12.744758 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-c50d3d24-6701-4963-9057-ebaa8679694d tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 02:00:12.745361 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-c50d3d24-6701-4963-9057-ebaa8679694d tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: ba8a1bd2-a708-4b49-a89b-8c9b61ab418f] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 02:00:12.752707 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c50d3d24-6701-4963-9057-ebaa8679694d tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:00:12.753148 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c50d3d24-6701-4963-9057-ebaa8679694d tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:00:12.754029 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c50d3d24-6701-4963-9057-ebaa8679694d tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:00:12.754395 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-c50d3d24-6701-4963-9057-ebaa8679694d tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:00:12.874817 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-c50d3d24-6701-4963-9057-ebaa8679694d tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 02:00:12.882605 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-c50d3d24-6701-4963-9057-ebaa8679694d tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 02:00:12.884101 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-c50d3d24-6701-4963-9057-ebaa8679694d tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 02:00:12.885276 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-c50d3d24-6701-4963-9057-ebaa8679694d tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "GET /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f" status: 200 len: 1673 microversion: 2.20 time: 0.144358 Nov 01 02:00:12.885829 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1680/3264] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Nov 1 02:00:12 2021] GET /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f => generated 1673 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 02:00:13.904389 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-37d2ca6f-4dd9-42b4-bf1f-5a5c6a906596 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 02:00:13.905646 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-37d2ca6f-4dd9-42b4-bf1f-5a5c6a906596 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: ba8a1bd2-a708-4b49-a89b-8c9b61ab418f] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 02:00:13.922800 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-37d2ca6f-4dd9-42b4-bf1f-5a5c6a906596 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:00:13.923310 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-37d2ca6f-4dd9-42b4-bf1f-5a5c6a906596 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:00:13.924089 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-37d2ca6f-4dd9-42b4-bf1f-5a5c6a906596 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:00:13.924515 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-37d2ca6f-4dd9-42b4-bf1f-5a5c6a906596 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:00:14.052121 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-37d2ca6f-4dd9-42b4-bf1f-5a5c6a906596 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 02:00:14.059843 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-37d2ca6f-4dd9-42b4-bf1f-5a5c6a906596 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 02:00:14.063405 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-37d2ca6f-4dd9-42b4-bf1f-5a5c6a906596 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 02:00:14.063405 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-37d2ca6f-4dd9-42b4-bf1f-5a5c6a906596 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "GET /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f" status: 200 len: 1675 microversion: 2.20 time: 0.162268 Nov 01 02:00:14.063405 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1585/3265] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Nov 1 02:00:13 2021] GET /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f => generated 1675 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 02:00:15.080563 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-83218819-5f90-4fbf-afbf-2dc8a76b3736 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 02:00:15.081163 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-83218819-5f90-4fbf-afbf-2dc8a76b3736 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: ba8a1bd2-a708-4b49-a89b-8c9b61ab418f] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 02:00:15.087413 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-83218819-5f90-4fbf-afbf-2dc8a76b3736 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:00:15.087853 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-83218819-5f90-4fbf-afbf-2dc8a76b3736 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:00:15.088605 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-83218819-5f90-4fbf-afbf-2dc8a76b3736 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:00:15.089033 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-83218819-5f90-4fbf-afbf-2dc8a76b3736 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:00:15.212752 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-83218819-5f90-4fbf-afbf-2dc8a76b3736 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 02:00:15.220844 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-83218819-5f90-4fbf-afbf-2dc8a76b3736 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 02:00:15.222362 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-83218819-5f90-4fbf-afbf-2dc8a76b3736 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 02:00:15.223538 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-83218819-5f90-4fbf-afbf-2dc8a76b3736 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "GET /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f" status: 200 len: 1731 microversion: 2.20 time: 0.146579 Nov 01 02:00:15.224095 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1681/3266] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Nov 1 02:00:15 2021] GET /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f => generated 1731 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 02:00:16.242154 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-0a26c09f-caa7-4ba9-8c41-90d2ab6f6780 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 02:00:16.242824 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-0a26c09f-caa7-4ba9-8c41-90d2ab6f6780 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: ba8a1bd2-a708-4b49-a89b-8c9b61ab418f] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 02:00:16.249493 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0a26c09f-caa7-4ba9-8c41-90d2ab6f6780 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:00:16.249943 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0a26c09f-caa7-4ba9-8c41-90d2ab6f6780 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:00:16.250733 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0a26c09f-caa7-4ba9-8c41-90d2ab6f6780 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:00:16.251168 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0a26c09f-caa7-4ba9-8c41-90d2ab6f6780 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:00:16.375536 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-0a26c09f-caa7-4ba9-8c41-90d2ab6f6780 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 02:00:16.383406 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-0a26c09f-caa7-4ba9-8c41-90d2ab6f6780 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 02:00:16.385108 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-0a26c09f-caa7-4ba9-8c41-90d2ab6f6780 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 02:00:16.386374 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-0a26c09f-caa7-4ba9-8c41-90d2ab6f6780 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "GET /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f" status: 200 len: 1731 microversion: 2.20 time: 0.148072 Nov 01 02:00:16.392190 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1586/3267] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Nov 1 02:00:16 2021] GET /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f => generated 1731 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 02:00:17.405526 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-99070055-f29b-4678-a001-2a88e3e3fb64 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 02:00:17.406129 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-99070055-f29b-4678-a001-2a88e3e3fb64 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: ba8a1bd2-a708-4b49-a89b-8c9b61ab418f] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 02:00:17.412434 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-99070055-f29b-4678-a001-2a88e3e3fb64 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:00:17.412880 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-99070055-f29b-4678-a001-2a88e3e3fb64 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:00:17.413631 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-99070055-f29b-4678-a001-2a88e3e3fb64 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:00:17.414058 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-99070055-f29b-4678-a001-2a88e3e3fb64 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:00:17.543160 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-99070055-f29b-4678-a001-2a88e3e3fb64 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 02:00:17.551340 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-99070055-f29b-4678-a001-2a88e3e3fb64 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 02:00:17.552843 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-99070055-f29b-4678-a001-2a88e3e3fb64 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 02:00:17.553994 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-99070055-f29b-4678-a001-2a88e3e3fb64 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "GET /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f" status: 200 len: 1731 microversion: 2.20 time: 0.152670 Nov 01 02:00:17.554590 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1682/3268] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Nov 1 02:00:17 2021] GET /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f => generated 1731 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 02:00:18.572602 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-2d0471dd-ef74-418a-b6d6-c5133b800040 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 02:00:18.573163 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-2d0471dd-ef74-418a-b6d6-c5133b800040 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: ba8a1bd2-a708-4b49-a89b-8c9b61ab418f] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 02:00:18.580213 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2d0471dd-ef74-418a-b6d6-c5133b800040 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:00:18.580653 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2d0471dd-ef74-418a-b6d6-c5133b800040 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:00:18.581414 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2d0471dd-ef74-418a-b6d6-c5133b800040 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:00:18.581841 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2d0471dd-ef74-418a-b6d6-c5133b800040 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:00:18.707853 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-2d0471dd-ef74-418a-b6d6-c5133b800040 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 02:00:18.715487 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-2d0471dd-ef74-418a-b6d6-c5133b800040 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 02:00:18.717000 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-2d0471dd-ef74-418a-b6d6-c5133b800040 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 02:00:18.718215 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-2d0471dd-ef74-418a-b6d6-c5133b800040 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "GET /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f" status: 200 len: 1731 microversion: 2.20 time: 0.149488 Nov 01 02:00:18.718805 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1587/3269] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Nov 1 02:00:18 2021] GET /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f => generated 1731 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 02:00:19.737270 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-b6a7c114-f9cb-4a9e-b935-78b88f6d98c0 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 02:00:19.738146 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-b6a7c114-f9cb-4a9e-b935-78b88f6d98c0 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: ba8a1bd2-a708-4b49-a89b-8c9b61ab418f] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 02:00:19.744631 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b6a7c114-f9cb-4a9e-b935-78b88f6d98c0 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:00:19.745081 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b6a7c114-f9cb-4a9e-b935-78b88f6d98c0 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:00:19.745848 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b6a7c114-f9cb-4a9e-b935-78b88f6d98c0 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:00:19.746279 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b6a7c114-f9cb-4a9e-b935-78b88f6d98c0 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:00:19.867853 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-b6a7c114-f9cb-4a9e-b935-78b88f6d98c0 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 02:00:19.877110 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-b6a7c114-f9cb-4a9e-b935-78b88f6d98c0 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 02:00:19.878701 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-b6a7c114-f9cb-4a9e-b935-78b88f6d98c0 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 02:00:19.879877 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-b6a7c114-f9cb-4a9e-b935-78b88f6d98c0 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "GET /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f" status: 200 len: 1731 microversion: 2.20 time: 0.147076 Nov 01 02:00:19.889820 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1683/3270] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Nov 1 02:00:19 2021] GET /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f => generated 1731 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 02:00:20.896882 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-87c92396-536a-4be0-b8d9-ce2d137c47a5 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 02:00:20.897554 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-87c92396-536a-4be0-b8d9-ce2d137c47a5 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: ba8a1bd2-a708-4b49-a89b-8c9b61ab418f] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 02:00:20.904386 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-87c92396-536a-4be0-b8d9-ce2d137c47a5 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:00:20.904834 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-87c92396-536a-4be0-b8d9-ce2d137c47a5 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:00:20.905680 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-87c92396-536a-4be0-b8d9-ce2d137c47a5 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:00:20.906173 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-87c92396-536a-4be0-b8d9-ce2d137c47a5 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:00:21.034664 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-87c92396-536a-4be0-b8d9-ce2d137c47a5 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 02:00:21.042272 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-87c92396-536a-4be0-b8d9-ce2d137c47a5 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 02:00:21.044034 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-87c92396-536a-4be0-b8d9-ce2d137c47a5 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 02:00:21.045214 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-87c92396-536a-4be0-b8d9-ce2d137c47a5 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "GET /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f" status: 200 len: 1731 microversion: 2.20 time: 0.152048 Nov 01 02:00:21.045768 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1588/3271] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Nov 1 02:00:20 2021] GET /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f => generated 1731 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 02:00:22.063877 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-a7e08f49-6073-4b0c-9547-a41817330dde tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 02:00:22.064494 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-a7e08f49-6073-4b0c-9547-a41817330dde tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: ba8a1bd2-a708-4b49-a89b-8c9b61ab418f] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 02:00:22.070724 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a7e08f49-6073-4b0c-9547-a41817330dde tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:00:22.071167 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a7e08f49-6073-4b0c-9547-a41817330dde tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:00:22.072239 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a7e08f49-6073-4b0c-9547-a41817330dde tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:00:22.072465 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a7e08f49-6073-4b0c-9547-a41817330dde tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:00:22.202849 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-a7e08f49-6073-4b0c-9547-a41817330dde tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 02:00:22.210532 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-a7e08f49-6073-4b0c-9547-a41817330dde tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 02:00:22.212048 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-a7e08f49-6073-4b0c-9547-a41817330dde tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 02:00:22.213758 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-a7e08f49-6073-4b0c-9547-a41817330dde tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "GET /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f" status: 200 len: 1731 microversion: 2.20 time: 0.154006 Nov 01 02:00:22.214347 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1684/3272] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Nov 1 02:00:22 2021] GET /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f => generated 1731 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 02:00:23.233393 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-f08a69d9-2d51-4a5b-9baf-3679b012db32 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 02:00:23.234137 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-f08a69d9-2d51-4a5b-9baf-3679b012db32 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: ba8a1bd2-a708-4b49-a89b-8c9b61ab418f] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 02:00:23.242999 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f08a69d9-2d51-4a5b-9baf-3679b012db32 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:00:23.243533 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f08a69d9-2d51-4a5b-9baf-3679b012db32 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:00:23.244311 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f08a69d9-2d51-4a5b-9baf-3679b012db32 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:00:23.244739 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f08a69d9-2d51-4a5b-9baf-3679b012db32 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:00:23.387473 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-f08a69d9-2d51-4a5b-9baf-3679b012db32 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 02:00:23.395384 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-f08a69d9-2d51-4a5b-9baf-3679b012db32 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 02:00:23.396907 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-f08a69d9-2d51-4a5b-9baf-3679b012db32 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 02:00:23.398062 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-f08a69d9-2d51-4a5b-9baf-3679b012db32 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "GET /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f" status: 200 len: 1731 microversion: 2.20 time: 0.168473 Nov 01 02:00:23.398652 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1589/3273] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Nov 1 02:00:23 2021] GET /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f => generated 1731 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 02:00:24.422122 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-a39d2ce4-dc7f-4e4b-afde-c0868c496324 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 02:00:24.422942 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-a39d2ce4-dc7f-4e4b-afde-c0868c496324 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: ba8a1bd2-a708-4b49-a89b-8c9b61ab418f] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 02:00:24.429668 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a39d2ce4-dc7f-4e4b-afde-c0868c496324 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:00:24.430110 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a39d2ce4-dc7f-4e4b-afde-c0868c496324 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:00:24.431184 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a39d2ce4-dc7f-4e4b-afde-c0868c496324 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:00:24.431638 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a39d2ce4-dc7f-4e4b-afde-c0868c496324 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:00:24.564513 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-a39d2ce4-dc7f-4e4b-afde-c0868c496324 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 02:00:24.574950 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-a39d2ce4-dc7f-4e4b-afde-c0868c496324 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 02:00:24.576691 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-a39d2ce4-dc7f-4e4b-afde-c0868c496324 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 02:00:24.578372 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-a39d2ce4-dc7f-4e4b-afde-c0868c496324 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "GET /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f" status: 200 len: 1731 microversion: 2.20 time: 0.160479 Nov 01 02:00:24.578952 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1685/3274] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Nov 1 02:00:24 2021] GET /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f => generated 1731 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 02:00:25.596097 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-76370fc0-b336-4686-9173-dc1486fd9a9f tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 02:00:25.596699 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-76370fc0-b336-4686-9173-dc1486fd9a9f tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: ba8a1bd2-a708-4b49-a89b-8c9b61ab418f] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 02:00:25.603150 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-76370fc0-b336-4686-9173-dc1486fd9a9f tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:00:25.604445 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-76370fc0-b336-4686-9173-dc1486fd9a9f tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:00:25.604445 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-76370fc0-b336-4686-9173-dc1486fd9a9f tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:00:25.604779 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-76370fc0-b336-4686-9173-dc1486fd9a9f tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:00:25.722570 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-76370fc0-b336-4686-9173-dc1486fd9a9f tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 02:00:25.730120 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-76370fc0-b336-4686-9173-dc1486fd9a9f tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 02:00:25.731649 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-76370fc0-b336-4686-9173-dc1486fd9a9f tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 02:00:25.732790 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-76370fc0-b336-4686-9173-dc1486fd9a9f tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "GET /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f" status: 200 len: 1731 microversion: 2.20 time: 0.140483 Nov 01 02:00:25.733339 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1590/3275] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Nov 1 02:00:25 2021] GET /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f => generated 1731 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 02:00:26.751265 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-90320f33-4041-4bf2-8e31-68f3f699bf3e tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 02:00:26.751874 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-90320f33-4041-4bf2-8e31-68f3f699bf3e tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: ba8a1bd2-a708-4b49-a89b-8c9b61ab418f] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 02:00:26.757800 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-90320f33-4041-4bf2-8e31-68f3f699bf3e tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:00:26.758276 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-90320f33-4041-4bf2-8e31-68f3f699bf3e tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:00:26.759075 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-90320f33-4041-4bf2-8e31-68f3f699bf3e tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:00:26.759507 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-90320f33-4041-4bf2-8e31-68f3f699bf3e tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:00:26.882854 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-90320f33-4041-4bf2-8e31-68f3f699bf3e tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 02:00:26.890465 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-90320f33-4041-4bf2-8e31-68f3f699bf3e tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 02:00:26.891957 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-90320f33-4041-4bf2-8e31-68f3f699bf3e tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 02:00:26.893095 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-90320f33-4041-4bf2-8e31-68f3f699bf3e tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "GET /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f" status: 200 len: 1731 microversion: 2.20 time: 0.146204 Nov 01 02:00:26.893643 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1686/3276] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Nov 1 02:00:26 2021] GET /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f => generated 1731 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 02:00:27.911405 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-d6dcae84-a8f8-4a5c-b0e8-c1138fbc51cd tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 02:00:27.912012 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-d6dcae84-a8f8-4a5c-b0e8-c1138fbc51cd tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: ba8a1bd2-a708-4b49-a89b-8c9b61ab418f] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 02:00:27.917912 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d6dcae84-a8f8-4a5c-b0e8-c1138fbc51cd tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:00:27.918351 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d6dcae84-a8f8-4a5c-b0e8-c1138fbc51cd tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:00:27.919134 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d6dcae84-a8f8-4a5c-b0e8-c1138fbc51cd tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:00:27.919559 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d6dcae84-a8f8-4a5c-b0e8-c1138fbc51cd tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:00:28.039245 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-d6dcae84-a8f8-4a5c-b0e8-c1138fbc51cd tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 02:00:28.047622 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-d6dcae84-a8f8-4a5c-b0e8-c1138fbc51cd tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 02:00:28.049109 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-d6dcae84-a8f8-4a5c-b0e8-c1138fbc51cd tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 02:00:28.050237 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-d6dcae84-a8f8-4a5c-b0e8-c1138fbc51cd tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "GET /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f" status: 200 len: 1731 microversion: 2.20 time: 0.142593 Nov 01 02:00:28.050822 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1591/3277] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Nov 1 02:00:27 2021] GET /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f => generated 1731 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 01 02:00:29.068598 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-09694bf1-ea7c-4841-89db-67467c0bf6a3 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 02:00:29.069228 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-09694bf1-ea7c-4841-89db-67467c0bf6a3 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: ba8a1bd2-a708-4b49-a89b-8c9b61ab418f] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 02:00:29.075549 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-09694bf1-ea7c-4841-89db-67467c0bf6a3 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:00:29.075995 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-09694bf1-ea7c-4841-89db-67467c0bf6a3 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:00:29.076749 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-09694bf1-ea7c-4841-89db-67467c0bf6a3 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:00:29.077175 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-09694bf1-ea7c-4841-89db-67467c0bf6a3 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:00:29.196195 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-09694bf1-ea7c-4841-89db-67467c0bf6a3 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 02:00:29.203792 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-09694bf1-ea7c-4841-89db-67467c0bf6a3 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 02:00:29.205281 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-09694bf1-ea7c-4841-89db-67467c0bf6a3 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 02:00:29.206482 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-09694bf1-ea7c-4841-89db-67467c0bf6a3 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "GET /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f" status: 200 len: 1731 microversion: 2.20 time: 0.141562 Nov 01 02:00:29.207049 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1687/3278] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Nov 1 02:00:29 2021] GET /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f => generated 1731 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 02:00:30.224519 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-1fdba282-1b11-45bb-8589-6e2ace826251 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 02:00:30.225211 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-1fdba282-1b11-45bb-8589-6e2ace826251 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: ba8a1bd2-a708-4b49-a89b-8c9b61ab418f] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 02:00:30.231423 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1fdba282-1b11-45bb-8589-6e2ace826251 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:00:30.231865 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1fdba282-1b11-45bb-8589-6e2ace826251 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:00:30.232614 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1fdba282-1b11-45bb-8589-6e2ace826251 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:00:30.233043 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-1fdba282-1b11-45bb-8589-6e2ace826251 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:00:30.358561 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-1fdba282-1b11-45bb-8589-6e2ace826251 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 02:00:30.366899 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-1fdba282-1b11-45bb-8589-6e2ace826251 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 02:00:30.368388 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-1fdba282-1b11-45bb-8589-6e2ace826251 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 02:00:30.369534 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-1fdba282-1b11-45bb-8589-6e2ace826251 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "GET /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f" status: 200 len: 1731 microversion: 2.20 time: 0.148792 Nov 01 02:00:30.370256 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1592/3279] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Nov 1 02:00:30 2021] GET /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f => generated 1731 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 02:00:31.388234 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-660b421e-395e-4af4-bbf4-5bc5f79fc4d3 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 02:00:31.388838 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-660b421e-395e-4af4-bbf4-5bc5f79fc4d3 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: ba8a1bd2-a708-4b49-a89b-8c9b61ab418f] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 02:00:31.395682 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-660b421e-395e-4af4-bbf4-5bc5f79fc4d3 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:00:31.396124 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-660b421e-395e-4af4-bbf4-5bc5f79fc4d3 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:00:31.396876 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-660b421e-395e-4af4-bbf4-5bc5f79fc4d3 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:00:31.397301 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-660b421e-395e-4af4-bbf4-5bc5f79fc4d3 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:00:31.518843 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-660b421e-395e-4af4-bbf4-5bc5f79fc4d3 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 02:00:31.526533 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-660b421e-395e-4af4-bbf4-5bc5f79fc4d3 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 02:00:31.528035 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-660b421e-395e-4af4-bbf4-5bc5f79fc4d3 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 02:00:31.529176 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-660b421e-395e-4af4-bbf4-5bc5f79fc4d3 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "GET /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f" status: 200 len: 1731 microversion: 2.20 time: 0.144717 Nov 01 02:00:31.529728 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1688/3280] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Nov 1 02:00:31 2021] GET /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f => generated 1731 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 02:00:32.546520 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-ed29f3b7-078b-4e10-bf81-fb1396d003f0 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 02:00:32.547116 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-ed29f3b7-078b-4e10-bf81-fb1396d003f0 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: ba8a1bd2-a708-4b49-a89b-8c9b61ab418f] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 02:00:32.553859 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ed29f3b7-078b-4e10-bf81-fb1396d003f0 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:00:32.554299 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ed29f3b7-078b-4e10-bf81-fb1396d003f0 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:00:32.555084 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ed29f3b7-078b-4e10-bf81-fb1396d003f0 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:00:32.555513 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ed29f3b7-078b-4e10-bf81-fb1396d003f0 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:00:32.671556 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-ed29f3b7-078b-4e10-bf81-fb1396d003f0 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 02:00:32.679649 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-ed29f3b7-078b-4e10-bf81-fb1396d003f0 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 02:00:32.681126 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-ed29f3b7-078b-4e10-bf81-fb1396d003f0 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 02:00:32.682260 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-ed29f3b7-078b-4e10-bf81-fb1396d003f0 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "GET /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f" status: 200 len: 1731 microversion: 2.20 time: 0.139694 Nov 01 02:00:32.682839 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1593/3281] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Nov 1 02:00:32 2021] GET /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f => generated 1731 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 02:00:32.725578 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 01 02:00:32.726201 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: Mon Nov 1 02:00:32 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 01 02:00:33.700544 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-3c840094-099e-4fb5-9b9b-f9afcdec4374 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 02:00:33.701153 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-3c840094-099e-4fb5-9b9b-f9afcdec4374 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: ba8a1bd2-a708-4b49-a89b-8c9b61ab418f] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 02:00:33.708020 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3c840094-099e-4fb5-9b9b-f9afcdec4374 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:00:33.708462 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3c840094-099e-4fb5-9b9b-f9afcdec4374 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:00:33.709217 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3c840094-099e-4fb5-9b9b-f9afcdec4374 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:00:33.709649 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3c840094-099e-4fb5-9b9b-f9afcdec4374 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:00:33.829796 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-3c840094-099e-4fb5-9b9b-f9afcdec4374 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 02:00:33.837578 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-3c840094-099e-4fb5-9b9b-f9afcdec4374 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 02:00:33.839169 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-3c840094-099e-4fb5-9b9b-f9afcdec4374 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 02:00:34.099191 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-3c840094-099e-4fb5-9b9b-f9afcdec4374 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "GET /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f" status: 200 len: 1731 microversion: 2.20 time: 0.143509 Nov 01 02:00:34.099191 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1689/3282] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Nov 1 02:00:33 2021] GET /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f => generated 1731 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 02:00:34.377572 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 01 02:00:34.377735 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: Mon Nov 1 02:00:34 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 01 02:00:34.858309 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-e3aacfda-8c94-40ce-9af0-e42f49b3cefb tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 02:00:34.858964 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-e3aacfda-8c94-40ce-9af0-e42f49b3cefb tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: ba8a1bd2-a708-4b49-a89b-8c9b61ab418f] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 02:00:34.868404 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e3aacfda-8c94-40ce-9af0-e42f49b3cefb tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:00:34.868852 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e3aacfda-8c94-40ce-9af0-e42f49b3cefb tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:00:34.869617 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e3aacfda-8c94-40ce-9af0-e42f49b3cefb tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:00:34.870045 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e3aacfda-8c94-40ce-9af0-e42f49b3cefb tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:00:34.990965 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-e3aacfda-8c94-40ce-9af0-e42f49b3cefb tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 02:00:34.998655 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-e3aacfda-8c94-40ce-9af0-e42f49b3cefb tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 02:00:35.000160 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-e3aacfda-8c94-40ce-9af0-e42f49b3cefb tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 02:00:35.001302 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-e3aacfda-8c94-40ce-9af0-e42f49b3cefb tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "GET /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f" status: 200 len: 1731 microversion: 2.20 time: 0.146752 Nov 01 02:00:35.001848 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1594/3283] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Nov 1 02:00:34 2021] GET /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f => generated 1731 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 02:00:35.652178 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [req-2de03015-c52a-4315-b1ba-0e61a8dfae53 req-77261f78-45b4-47b6-b70a-d238ded6a303 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba8a1bd2-a708-4b49-a89b-8c9b61ab418f", "name": "network-vif-plugged", "status": "completed", "tag": "639f2165-b424-447e-8ca4-13353eb4416d"}]} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 02:00:35.653661 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 01 02:00:35.653661 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: warnings.warn(msg) Nov 01 02:00:35.660998 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [req-2de03015-c52a-4315-b1ba-0e61a8dfae53 req-77261f78-45b4-47b6-b70a-d238ded6a303 service nova] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:00:35.661441 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [req-2de03015-c52a-4315-b1ba-0e61a8dfae53 req-77261f78-45b4-47b6-b70a-d238ded6a303 service nova] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:00:35.673367 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.compute.server_external_events [req-2de03015-c52a-4315-b1ba-0e61a8dfae53 req-77261f78-45b4-47b6-b70a-d238ded6a303 service nova] Creating event network-vif-plugged:639f2165-b424-447e-8ca4-13353eb4416d for instance ba8a1bd2-a708-4b49-a89b-8c9b61ab418f on hv-cinder-81561 Nov 01 02:00:35.678659 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [req-2de03015-c52a-4315-b1ba-0e61a8dfae53 req-77261f78-45b4-47b6-b70a-d238ded6a303 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030051 Nov 01 02:00:35.679728 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1690/3284] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Nov 1 02:00:35 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 02:00:36.019347 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-8475d774-6ce0-406b-bef2-19c596c33cc4 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 02:00:36.019953 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-8475d774-6ce0-406b-bef2-19c596c33cc4 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: ba8a1bd2-a708-4b49-a89b-8c9b61ab418f] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 02:00:36.026342 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8475d774-6ce0-406b-bef2-19c596c33cc4 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:00:36.026823 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8475d774-6ce0-406b-bef2-19c596c33cc4 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:00:36.027597 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8475d774-6ce0-406b-bef2-19c596c33cc4 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:00:36.028022 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8475d774-6ce0-406b-bef2-19c596c33cc4 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:00:36.160413 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-8475d774-6ce0-406b-bef2-19c596c33cc4 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 02:00:36.168688 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-8475d774-6ce0-406b-bef2-19c596c33cc4 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 02:00:36.170210 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-8475d774-6ce0-406b-bef2-19c596c33cc4 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 02:00:36.171679 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-8475d774-6ce0-406b-bef2-19c596c33cc4 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "GET /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f" status: 200 len: 1731 microversion: 2.20 time: 0.156082 Nov 01 02:00:36.172245 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1595/3285] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Nov 1 02:00:36 2021] GET /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f => generated 1731 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 02:00:37.191954 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-fb7c0380-8132-4f5a-b058-d8192f7f101f tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 02:00:37.192696 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-fb7c0380-8132-4f5a-b058-d8192f7f101f tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: ba8a1bd2-a708-4b49-a89b-8c9b61ab418f] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 02:00:37.198711 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-fb7c0380-8132-4f5a-b058-d8192f7f101f tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:00:37.199174 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-fb7c0380-8132-4f5a-b058-d8192f7f101f tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:00:37.199911 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-fb7c0380-8132-4f5a-b058-d8192f7f101f tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:00:37.200340 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-fb7c0380-8132-4f5a-b058-d8192f7f101f tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:00:37.318018 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-fb7c0380-8132-4f5a-b058-d8192f7f101f tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 02:00:37.325589 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-fb7c0380-8132-4f5a-b058-d8192f7f101f tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 02:00:37.327108 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-fb7c0380-8132-4f5a-b058-d8192f7f101f tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 02:00:37.328246 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-fb7c0380-8132-4f5a-b058-d8192f7f101f tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "GET /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f" status: 200 len: 1731 microversion: 2.20 time: 0.141321 Nov 01 02:00:37.328791 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1691/3286] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Nov 1 02:00:37 2021] GET /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f => generated 1731 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 02:00:38.349882 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-f183c471-481a-4488-971a-34ee8e7eeaec tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 02:00:38.350575 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-f183c471-481a-4488-971a-34ee8e7eeaec tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: ba8a1bd2-a708-4b49-a89b-8c9b61ab418f] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 02:00:38.356440 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f183c471-481a-4488-971a-34ee8e7eeaec tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:00:38.356881 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f183c471-481a-4488-971a-34ee8e7eeaec tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:00:38.357787 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f183c471-481a-4488-971a-34ee8e7eeaec tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:00:38.358278 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f183c471-481a-4488-971a-34ee8e7eeaec tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:00:38.483120 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-f183c471-481a-4488-971a-34ee8e7eeaec tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 02:00:38.491876 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-f183c471-481a-4488-971a-34ee8e7eeaec tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 02:00:38.493310 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-f183c471-481a-4488-971a-34ee8e7eeaec tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 02:00:38.494492 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-f183c471-481a-4488-971a-34ee8e7eeaec tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "GET /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f" status: 200 len: 1731 microversion: 2.20 time: 0.152110 Nov 01 02:00:38.495030 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1596/3287] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Nov 1 02:00:38 2021] GET /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f => generated 1731 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 02:00:39.512406 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-486d4e3f-5796-4082-94d3-965269fdbc8f tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 02:00:39.513005 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-486d4e3f-5796-4082-94d3-965269fdbc8f tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: ba8a1bd2-a708-4b49-a89b-8c9b61ab418f] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 02:00:39.519927 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-486d4e3f-5796-4082-94d3-965269fdbc8f tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:00:39.520371 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-486d4e3f-5796-4082-94d3-965269fdbc8f tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:00:39.521120 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-486d4e3f-5796-4082-94d3-965269fdbc8f tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:00:39.521540 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-486d4e3f-5796-4082-94d3-965269fdbc8f tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:00:39.639196 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-486d4e3f-5796-4082-94d3-965269fdbc8f tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 02:00:39.647483 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-486d4e3f-5796-4082-94d3-965269fdbc8f tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 02:00:39.648963 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-486d4e3f-5796-4082-94d3-965269fdbc8f tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 02:00:39.650099 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-486d4e3f-5796-4082-94d3-965269fdbc8f tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "GET /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f" status: 200 len: 1718 microversion: 2.20 time: 0.141448 Nov 01 02:00:39.650676 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1692/3288] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Nov 1 02:00:39 2021] GET /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f => generated 1718 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 02:01:35.296676 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-0ff41dc2-d22d-4bde-b62f-11ae7baf1150 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 02:01:35.298330 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-0ff41dc2-d22d-4bde-b62f-11ae7baf1150 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: ba8a1bd2-a708-4b49-a89b-8c9b61ab418f] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 02:01:35.304175 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0ff41dc2-d22d-4bde-b62f-11ae7baf1150 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:01:35.304626 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0ff41dc2-d22d-4bde-b62f-11ae7baf1150 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:01:35.305382 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0ff41dc2-d22d-4bde-b62f-11ae7baf1150 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:01:35.305820 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0ff41dc2-d22d-4bde-b62f-11ae7baf1150 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:01:35.333686 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-0ff41dc2-d22d-4bde-b62f-11ae7baf1150 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "GET /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.041125 Nov 01 02:01:35.337246 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1597/3289] 10.222.0.47 () {60 vars in 1342 bytes} [Mon Nov 1 02:01:35 2021] GET /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 02:01:35.398874 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-5efb9719-c82f-4c84-acbf-0e2e53e1fe96 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 02:01:35.399338 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-5efb9719-c82f-4c84-acbf-0e2e53e1fe96 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: ba8a1bd2-a708-4b49-a89b-8c9b61ab418f] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 02:01:35.405553 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-5efb9719-c82f-4c84-acbf-0e2e53e1fe96 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:01:35.405995 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-5efb9719-c82f-4c84-acbf-0e2e53e1fe96 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:01:35.407311 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-5efb9719-c82f-4c84-acbf-0e2e53e1fe96 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:01:35.407731 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-5efb9719-c82f-4c84-acbf-0e2e53e1fe96 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:01:35.432610 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-5efb9719-c82f-4c84-acbf-0e2e53e1fe96 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: ba8a1bd2-a708-4b49-a89b-8c9b61ab418f] Going to try to terminate instance {{(pid=116267) delete /opt/stack/nova/nova/compute/api.py:2612}} Nov 01 02:01:35.715550 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-5efb9719-c82f-4c84-acbf-0e2e53e1fe96 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "DELETE /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f" status: 204 len: 0 microversion: 2.20 time: 0.320092 Nov 01 02:01:35.716137 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1693/3290] 10.222.0.47 () {60 vars in 1279 bytes} [Mon Nov 1 02:01:35 2021] DELETE /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f => generated 0 bytes in 322 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 01 02:01:35.724603 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-78098e96-3398-42e7-8b65-c62b1c4818c3 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 02:01:35.725264 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-78098e96-3398-42e7-8b65-c62b1c4818c3 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: ba8a1bd2-a708-4b49-a89b-8c9b61ab418f] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 02:01:35.731067 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-78098e96-3398-42e7-8b65-c62b1c4818c3 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:01:35.731515 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-78098e96-3398-42e7-8b65-c62b1c4818c3 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:01:35.732269 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-78098e96-3398-42e7-8b65-c62b1c4818c3 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:01:35.732697 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-78098e96-3398-42e7-8b65-c62b1c4818c3 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:01:35.850264 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-78098e96-3398-42e7-8b65-c62b1c4818c3 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 02:01:35.857846 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-78098e96-3398-42e7-8b65-c62b1c4818c3 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 02:01:35.859879 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-78098e96-3398-42e7-8b65-c62b1c4818c3 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 02:01:35.861028 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-78098e96-3398-42e7-8b65-c62b1c4818c3 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "GET /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f" status: 200 len: 1724 microversion: 2.20 time: 0.140068 Nov 01 02:01:35.861578 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1598/3291] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Nov 1 02:01:35 2021] GET /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f => generated 1724 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 02:01:36.880707 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-9feea986-9157-4267-98e7-206a4c89382e tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 02:01:36.881397 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-9feea986-9157-4267-98e7-206a4c89382e tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: ba8a1bd2-a708-4b49-a89b-8c9b61ab418f] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 02:01:36.888173 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9feea986-9157-4267-98e7-206a4c89382e tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:01:36.888613 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9feea986-9157-4267-98e7-206a4c89382e tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:01:36.889354 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9feea986-9157-4267-98e7-206a4c89382e tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:01:36.889804 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-9feea986-9157-4267-98e7-206a4c89382e tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:01:37.065385 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-9feea986-9157-4267-98e7-206a4c89382e tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 02:01:37.073033 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-9feea986-9157-4267-98e7-206a4c89382e tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 02:01:37.074573 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-9feea986-9157-4267-98e7-206a4c89382e tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 02:01:37.075714 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-9feea986-9157-4267-98e7-206a4c89382e tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "GET /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f" status: 200 len: 1724 microversion: 2.20 time: 0.199306 Nov 01 02:01:37.076277 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1694/3292] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Nov 1 02:01:36 2021] GET /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f => generated 1724 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 02:01:38.092912 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-89bc8046-f708-45e1-9a37-0f7eeca892a8 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 02:01:38.093588 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-89bc8046-f708-45e1-9a37-0f7eeca892a8 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: ba8a1bd2-a708-4b49-a89b-8c9b61ab418f] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 02:01:38.100052 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-89bc8046-f708-45e1-9a37-0f7eeca892a8 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:01:38.100510 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-89bc8046-f708-45e1-9a37-0f7eeca892a8 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:01:38.101347 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-89bc8046-f708-45e1-9a37-0f7eeca892a8 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:01:38.101858 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-89bc8046-f708-45e1-9a37-0f7eeca892a8 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:01:38.162165 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-89bc8046-f708-45e1-9a37-0f7eeca892a8 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 02:01:38.170160 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-89bc8046-f708-45e1-9a37-0f7eeca892a8 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 02:01:38.171691 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-89bc8046-f708-45e1-9a37-0f7eeca892a8 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 02:01:38.173370 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-89bc8046-f708-45e1-9a37-0f7eeca892a8 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "GET /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f" status: 200 len: 1657 microversion: 2.20 time: 0.084181 Nov 01 02:01:38.173917 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1599/3293] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Nov 1 02:01:38 2021] GET /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f => generated 1657 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 02:01:38.329291 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [req-7ae3930f-2b1e-465c-8c52-e1a346aa2114 req-1da0a476-71c4-4907-9c32-f3a4089dd538 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba8a1bd2-a708-4b49-a89b-8c9b61ab418f", "name": "network-vif-deleted", "tag": "639f2165-b424-447e-8ca4-13353eb4416d"}]} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 02:01:38.330809 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 01 02:01:38.330809 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: warnings.warn(msg) Nov 01 02:01:38.337993 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [req-7ae3930f-2b1e-465c-8c52-e1a346aa2114 req-1da0a476-71c4-4907-9c32-f3a4089dd538 service nova] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:01:38.338459 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [req-7ae3930f-2b1e-465c-8c52-e1a346aa2114 req-1da0a476-71c4-4907-9c32-f3a4089dd538 service nova] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:01:38.349744 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.compute.server_external_events [req-7ae3930f-2b1e-465c-8c52-e1a346aa2114 req-1da0a476-71c4-4907-9c32-f3a4089dd538 service nova] Creating event network-vif-deleted:639f2165-b424-447e-8ca4-13353eb4416d for instance ba8a1bd2-a708-4b49-a89b-8c9b61ab418f on hv-cinder-81561 Nov 01 02:01:38.354666 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [req-7ae3930f-2b1e-465c-8c52-e1a346aa2114 req-1da0a476-71c4-4907-9c32-f3a4089dd538 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028846 Nov 01 02:01:38.355189 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1695/3294] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Nov 1 02:01:38 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 02:01:39.193162 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-07b7ce07-be52-415a-9aa4-b9539273c800 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 02:01:39.193695 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-07b7ce07-be52-415a-9aa4-b9539273c800 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: ba8a1bd2-a708-4b49-a89b-8c9b61ab418f] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 02:01:39.201225 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-07b7ce07-be52-415a-9aa4-b9539273c800 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:01:39.201841 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-07b7ce07-be52-415a-9aa4-b9539273c800 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:01:39.202655 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-07b7ce07-be52-415a-9aa4-b9539273c800 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:01:39.203093 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-07b7ce07-be52-415a-9aa4-b9539273c800 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:01:39.235598 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-07b7ce07-be52-415a-9aa4-b9539273c800 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:01:39.236318 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-07b7ce07-be52-415a-9aa4-b9539273c800 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:01:39.236777 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.objects.instance [None req-07b7ce07-be52-415a-9aa4-b9539273c800 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lazy-loading 'fault' on Instance uuid ba8a1bd2-a708-4b49-a89b-8c9b61ab418f {{(pid=116266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 01 02:01:39.283392 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-07b7ce07-be52-415a-9aa4-b9539273c800 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 02:01:39.291047 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-07b7ce07-be52-415a-9aa4-b9539273c800 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 02:01:39.292771 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-07b7ce07-be52-415a-9aa4-b9539273c800 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1828ba5acba040a38cbeb610db7952c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a6514bbe449b2b35c20f16ffaddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 02:01:39.293996 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-07b7ce07-be52-415a-9aa4-b9539273c800 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "GET /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f" status: 200 len: 1372 microversion: 2.20 time: 0.105337 Nov 01 02:01:39.294822 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1600/3295] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Nov 1 02:01:39 2021] GET /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f => generated 1372 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 01 02:01:40.314313 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-11909fad-667a-4ccf-9679-7d1fe6e0da01 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 02:01:40.315019 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-11909fad-667a-4ccf-9679-7d1fe6e0da01 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: ba8a1bd2-a708-4b49-a89b-8c9b61ab418f] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 02:01:40.320993 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-11909fad-667a-4ccf-9679-7d1fe6e0da01 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:01:40.321429 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-11909fad-667a-4ccf-9679-7d1fe6e0da01 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:01:40.322172 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-11909fad-667a-4ccf-9679-7d1fe6e0da01 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:01:40.322629 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-11909fad-667a-4ccf-9679-7d1fe6e0da01 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:01:40.335679 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.wsgi [None req-11909fad-667a-4ccf-9679-7d1fe6e0da01 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] HTTP exception thrown: Instance ba8a1bd2-a708-4b49-a89b-8c9b61ab418f could not be found. Nov 01 02:01:40.336245 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-11909fad-667a-4ccf-9679-7d1fe6e0da01 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Returning 404 to user: Instance ba8a1bd2-a708-4b49-a89b-8c9b61ab418f could not be found. {{(pid=116267) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 01 02:01:40.337030 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-11909fad-667a-4ccf-9679-7d1fe6e0da01 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "GET /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f" status: 404 len: 111 microversion: 2.20 time: 0.027300 Nov 01 02:01:40.337533 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1696/3296] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Nov 1 02:01:40 2021] GET /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 01 02:01:40.346396 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-7a4ec7db-5f06-4267-b89f-5519759d2c5c tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Calling method '.version_select at 0x7fccf6a4e790>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 02:01:40.445999 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-7a4ec7db-5f06-4267-b89f-5519759d2c5c tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2030943824" status: 204 len: 0 microversion: 2.20 time: 0.104063 Nov 01 02:01:40.446640 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1601/3297] 10.222.0.47 () {60 vars in 1261 bytes} [Mon Nov 1 02:01:40 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2030943824 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 01 02:01:42.452279 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-f8755246-c213-4bde-a310-8936cb7181e1 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 02:01:42.452767 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-f8755246-c213-4bde-a310-8936cb7181e1 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: ba8a1bd2-a708-4b49-a89b-8c9b61ab418f] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 02:01:42.459534 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f8755246-c213-4bde-a310-8936cb7181e1 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:01:42.459971 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f8755246-c213-4bde-a310-8936cb7181e1 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:01:42.460715 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f8755246-c213-4bde-a310-8936cb7181e1 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:01:42.461134 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f8755246-c213-4bde-a310-8936cb7181e1 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:01:42.475000 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.wsgi [None req-f8755246-c213-4bde-a310-8936cb7181e1 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] HTTP exception thrown: Instance ba8a1bd2-a708-4b49-a89b-8c9b61ab418f could not be found. Nov 01 02:01:42.480693 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-f8755246-c213-4bde-a310-8936cb7181e1 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Returning 404 to user: Instance ba8a1bd2-a708-4b49-a89b-8c9b61ab418f could not be found. {{(pid=116267) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 01 02:01:42.480693 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-f8755246-c213-4bde-a310-8936cb7181e1 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "DELETE /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f" status: 404 len: 111 microversion: 2.1 time: 0.027790 Nov 01 02:01:42.480693 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1697/3298] 10.222.0.47 () {58 vars in 1238 bytes} [Mon Nov 1 02:01:42 2021] DELETE /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 02:01:42.487336 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-cea9d4d3-d27c-4667-a7ae-dcc576aa2bed tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 02:01:42.487971 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-cea9d4d3-d27c-4667-a7ae-dcc576aa2bed tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: ba8a1bd2-a708-4b49-a89b-8c9b61ab418f] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 02:01:42.494743 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-cea9d4d3-d27c-4667-a7ae-dcc576aa2bed tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:01:42.496441 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-cea9d4d3-d27c-4667-a7ae-dcc576aa2bed tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:01:42.496441 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-cea9d4d3-d27c-4667-a7ae-dcc576aa2bed tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:01:42.496441 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-cea9d4d3-d27c-4667-a7ae-dcc576aa2bed tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:01:42.508929 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.wsgi [None req-cea9d4d3-d27c-4667-a7ae-dcc576aa2bed tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] HTTP exception thrown: Instance ba8a1bd2-a708-4b49-a89b-8c9b61ab418f could not be found. Nov 01 02:01:42.509498 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-cea9d4d3-d27c-4667-a7ae-dcc576aa2bed tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Returning 404 to user: Instance ba8a1bd2-a708-4b49-a89b-8c9b61ab418f could not be found. {{(pid=116266) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 01 02:01:42.510290 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-cea9d4d3-d27c-4667-a7ae-dcc576aa2bed tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "GET /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f" status: 404 len: 111 microversion: 2.1 time: 0.026965 Nov 01 02:01:42.511049 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1602/3299] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 02:01:42 2021] GET /compute/v2.1/servers/ba8a1bd2-a708-4b49-a89b-8c9b61ab418f => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 02:01:43.757274 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-2c0e7beb-ef0b-4a76-b71b-536b48bae483 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 02:01:43.757789 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-2c0e7beb-ef0b-4a76-b71b-536b48bae483 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: 6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 02:01:43.764006 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-2c0e7beb-ef0b-4a76-b71b-536b48bae483 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:01:43.764450 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-2c0e7beb-ef0b-4a76-b71b-536b48bae483 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:01:43.765197 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-2c0e7beb-ef0b-4a76-b71b-536b48bae483 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:01:43.765644 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-2c0e7beb-ef0b-4a76-b71b-536b48bae483 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:01:43.778351 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.wsgi [None req-2c0e7beb-ef0b-4a76-b71b-536b48bae483 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] HTTP exception thrown: Instance 6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad could not be found. Nov 01 02:01:43.778942 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-2c0e7beb-ef0b-4a76-b71b-536b48bae483 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Returning 404 to user: Instance 6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad could not be found. {{(pid=116267) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 01 02:01:43.779730 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-2c0e7beb-ef0b-4a76-b71b-536b48bae483 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "DELETE /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad" status: 404 len: 111 microversion: 2.1 time: 0.026097 Nov 01 02:01:43.780252 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1698/3300] 10.222.0.47 () {58 vars in 1238 bytes} [Mon Nov 1 02:01:43 2021] DELETE /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 02:01:43.787823 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-e59631b2-e084-4a52-9ce6-efa191638c06 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 02:01:43.788446 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-e59631b2-e084-4a52-9ce6-efa191638c06 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] [instance: 6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 02:01:43.795050 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e59631b2-e084-4a52-9ce6-efa191638c06 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:01:43.795495 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e59631b2-e084-4a52-9ce6-efa191638c06 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:01:43.796255 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e59631b2-e084-4a52-9ce6-efa191638c06 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:01:43.797181 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e59631b2-e084-4a52-9ce6-efa191638c06 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:01:43.809814 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.wsgi [None req-e59631b2-e084-4a52-9ce6-efa191638c06 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] HTTP exception thrown: Instance 6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad could not be found. Nov 01 02:01:43.810393 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-e59631b2-e084-4a52-9ce6-efa191638c06 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] Returning 404 to user: Instance 6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad could not be found. {{(pid=116266) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 01 02:01:43.811218 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-e59631b2-e084-4a52-9ce6-efa191638c06 tempest-AttachVolumeShelveTestJSON-1104893152 tempest-AttachVolumeShelveTestJSON-1104893152-project] 10.222.0.47 "GET /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad" status: 404 len: 111 microversion: 2.1 time: 0.027103 Nov 01 02:01:43.811730 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1603/3301] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 02:01:43 2021] GET /compute/v2.1/servers/6bcb7b49-c95d-4c26-ae06-8e5483f3a3ad => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 02:01:50.609712 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-81ca0679-8727-419a-92c0-50560840d338 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1584452397", "imageRef": "b9068d8d-b02d-4043-9f0c-3d774cb372b3", "flavorRef": "452", "networks": [{"uuid": "8d4ac867-bf0b-462f-8ac6-2516bf6ce1bc"}]}} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 02:01:50.661780 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.network.neutron [None req-81ca0679-8727-419a-92c0-50560840d338 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] validate_networks() for [('8d4ac867-bf0b-462f-8ac6-2516bf6ce1bc', None, None, None, None, None)] {{(pid=116267) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Nov 01 02:01:51.048323 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.virt.hardware [None req-81ca0679-8727-419a-92c0-50560840d338 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Flavor limits 0:0:0 {{(pid=116267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 01 02:01:51.048766 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.virt.hardware [None req-81ca0679-8727-419a-92c0-50560840d338 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Image limits 0:0:0 {{(pid=116267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 01 02:01:51.049263 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.virt.hardware [None req-81ca0679-8727-419a-92c0-50560840d338 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Flavor pref 0:0:0 {{(pid=116267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 01 02:01:51.049673 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.virt.hardware [None req-81ca0679-8727-419a-92c0-50560840d338 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Image pref 0:0:0 {{(pid=116267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 01 02:01:51.050079 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.virt.hardware [None req-81ca0679-8727-419a-92c0-50560840d338 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 01 02:01:51.058606 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-81ca0679-8727-419a-92c0-50560840d338 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:01:51.059049 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-81ca0679-8727-419a-92c0-50560840d338 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:01:51.059839 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-81ca0679-8727-419a-92c0-50560840d338 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:01:51.060269 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-81ca0679-8727-419a-92c0-50560840d338 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:01:51.076511 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.quota [None req-81ca0679-8727-419a-92c0-50560840d338 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Getting quotas for project bc399e683fbf435a8917245373404232. Resources: {'instances', 'cores', 'ram'} {{(pid=116267) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 01 02:01:51.081021 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.quota [None req-81ca0679-8727-419a-92c0-50560840d338 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Getting quotas for user 61b3a4d85a244d42adf006700e2e312a and project bc399e683fbf435a8917245373404232. Resources: {'instances', 'cores', 'ram'} {{(pid=116267) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 01 02:01:51.091460 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-81ca0679-8727-419a-92c0-50560840d338 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Going to run 1 instances... {{(pid=116267) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 01 02:01:51.093674 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-81ca0679-8727-419a-92c0-50560840d338 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] [instance: 01cdb4c3-37bc-411a-9fc4-2a1f70e02c61] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b9068d8d-b02d-4043-9f0c-3d774cb372b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116267) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 01 02:01:51.231211 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-81ca0679-8727-419a-92c0-50560840d338 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.729260 Nov 01 02:01:51.231850 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1699/3302] 10.222.0.47 () {60 vars in 1146 bytes} [Mon Nov 1 02:01:50 2021] POST /compute/v2.1/servers => generated 380 bytes in 731 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 01 02:01:51.242260 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-cbf0cab4-7bb7-47a1-87cc-cfe4d1cf2cfb tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 02:01:51.242906 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-cbf0cab4-7bb7-47a1-87cc-cfe4d1cf2cfb tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] [instance: 01cdb4c3-37bc-411a-9fc4-2a1f70e02c61] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 02:01:51.298545 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-cbf0cab4-7bb7-47a1-87cc-cfe4d1cf2cfb tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3a4d85a244d42adf006700e2e312a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc399e683fbf435a8917245373404232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 02:01:51.305118 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-cbf0cab4-7bb7-47a1-87cc-cfe4d1cf2cfb tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] 10.222.0.47 "GET /compute/v2.1/servers/01cdb4c3-37bc-411a-9fc4-2a1f70e02c61" status: 200 len: 1218 microversion: 2.1 time: 0.066574 Nov 01 02:01:51.309924 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1604/3303] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 02:01:51 2021] GET /compute/v2.1/servers/01cdb4c3-37bc-411a-9fc4-2a1f70e02c61 => generated 1218 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 02:01:52.322724 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-7e31e24a-7e6b-43d9-988e-f5aaea7cdb03 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 02:01:52.323444 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-7e31e24a-7e6b-43d9-988e-f5aaea7cdb03 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] [instance: 01cdb4c3-37bc-411a-9fc4-2a1f70e02c61] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 02:01:52.330453 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-7e31e24a-7e6b-43d9-988e-f5aaea7cdb03 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:01:52.330899 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-7e31e24a-7e6b-43d9-988e-f5aaea7cdb03 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:01:52.331652 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-7e31e24a-7e6b-43d9-988e-f5aaea7cdb03 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:01:52.332077 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-7e31e24a-7e6b-43d9-988e-f5aaea7cdb03 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:01:52.391695 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-7e31e24a-7e6b-43d9-988e-f5aaea7cdb03 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3a4d85a244d42adf006700e2e312a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc399e683fbf435a8917245373404232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 02:01:52.399423 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-7e31e24a-7e6b-43d9-988e-f5aaea7cdb03 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] 10.222.0.47 "GET /compute/v2.1/servers/01cdb4c3-37bc-411a-9fc4-2a1f70e02c61" status: 200 len: 1222 microversion: 2.1 time: 0.080918 Nov 01 02:01:52.400204 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1700/3304] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 02:01:52 2021] GET /compute/v2.1/servers/01cdb4c3-37bc-411a-9fc4-2a1f70e02c61 => generated 1222 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 02:01:53.416139 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-922d6514-784f-4714-8c2c-6e0e38adff9f tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 02:01:53.416689 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-922d6514-784f-4714-8c2c-6e0e38adff9f tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] [instance: 01cdb4c3-37bc-411a-9fc4-2a1f70e02c61] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 02:01:53.425632 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-922d6514-784f-4714-8c2c-6e0e38adff9f tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:01:53.426095 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-922d6514-784f-4714-8c2c-6e0e38adff9f tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:01:53.426903 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-922d6514-784f-4714-8c2c-6e0e38adff9f tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:01:53.427353 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-922d6514-784f-4714-8c2c-6e0e38adff9f tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:01:53.491957 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-922d6514-784f-4714-8c2c-6e0e38adff9f tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3a4d85a244d42adf006700e2e312a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc399e683fbf435a8917245373404232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 02:01:53.499127 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-922d6514-784f-4714-8c2c-6e0e38adff9f tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] 10.222.0.47 "GET /compute/v2.1/servers/01cdb4c3-37bc-411a-9fc4-2a1f70e02c61" status: 200 len: 1288 microversion: 2.1 time: 0.086792 Nov 01 02:01:53.499783 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1605/3305] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 02:01:53 2021] GET /compute/v2.1/servers/01cdb4c3-37bc-411a-9fc4-2a1f70e02c61 => generated 1288 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 02:01:54.515853 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-837945c9-fd19-4fa0-aaf1-97c29661f2db tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 02:01:54.516477 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-837945c9-fd19-4fa0-aaf1-97c29661f2db tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] [instance: 01cdb4c3-37bc-411a-9fc4-2a1f70e02c61] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 02:01:54.522740 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-837945c9-fd19-4fa0-aaf1-97c29661f2db tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:01:54.523180 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-837945c9-fd19-4fa0-aaf1-97c29661f2db tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:01:54.523928 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-837945c9-fd19-4fa0-aaf1-97c29661f2db tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:01:54.524353 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-837945c9-fd19-4fa0-aaf1-97c29661f2db tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:01:54.651073 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-837945c9-fd19-4fa0-aaf1-97c29661f2db tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3a4d85a244d42adf006700e2e312a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc399e683fbf435a8917245373404232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 02:01:54.658919 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-837945c9-fd19-4fa0-aaf1-97c29661f2db tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] 10.222.0.47 "GET /compute/v2.1/servers/01cdb4c3-37bc-411a-9fc4-2a1f70e02c61" status: 200 len: 1318 microversion: 2.1 time: 0.146708 Nov 01 02:01:54.659482 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1701/3306] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 02:01:54 2021] GET /compute/v2.1/servers/01cdb4c3-37bc-411a-9fc4-2a1f70e02c61 => generated 1318 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 02:01:54.813097 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [req-d89e1e66-2a57-4981-a2e5-fd7019bde1a3 req-1e687127-3c87-4396-890e-3822d5dd8099 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "01cdb4c3-37bc-411a-9fc4-2a1f70e02c61", "tag": "7df858e9-d560-4b9c-a8ca-e1371fcf4ac5"}]} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 02:01:54.815338 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 01 02:01:54.815338 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: warnings.warn(msg) Nov 01 02:01:54.822679 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [req-d89e1e66-2a57-4981-a2e5-fd7019bde1a3 req-1e687127-3c87-4396-890e-3822d5dd8099 service nova] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:01:54.823125 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [req-d89e1e66-2a57-4981-a2e5-fd7019bde1a3 req-1e687127-3c87-4396-890e-3822d5dd8099 service nova] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:01:54.835339 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.compute.server_external_events [req-d89e1e66-2a57-4981-a2e5-fd7019bde1a3 req-1e687127-3c87-4396-890e-3822d5dd8099 service nova] Creating event network-changed:7df858e9-d560-4b9c-a8ca-e1371fcf4ac5 for instance 01cdb4c3-37bc-411a-9fc4-2a1f70e02c61 on hv-cinder-81561 Nov 01 02:01:54.840092 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [req-d89e1e66-2a57-4981-a2e5-fd7019bde1a3 req-1e687127-3c87-4396-890e-3822d5dd8099 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030878 Nov 01 02:01:54.840680 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1606/3307] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Nov 1 02:01:54 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 02:01:55.675737 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-640c991f-0bf1-47ff-859e-db72cebb91dc tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 02:01:55.676339 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-640c991f-0bf1-47ff-859e-db72cebb91dc tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] [instance: 01cdb4c3-37bc-411a-9fc4-2a1f70e02c61] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 02:01:55.682143 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-640c991f-0bf1-47ff-859e-db72cebb91dc tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:01:55.682627 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-640c991f-0bf1-47ff-859e-db72cebb91dc tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:01:55.683474 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-640c991f-0bf1-47ff-859e-db72cebb91dc tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:01:55.683902 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-640c991f-0bf1-47ff-859e-db72cebb91dc tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:01:55.802040 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-640c991f-0bf1-47ff-859e-db72cebb91dc tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3a4d85a244d42adf006700e2e312a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc399e683fbf435a8917245373404232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 02:01:55.809133 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-640c991f-0bf1-47ff-859e-db72cebb91dc tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] 10.222.0.47 "GET /compute/v2.1/servers/01cdb4c3-37bc-411a-9fc4-2a1f70e02c61" status: 200 len: 1318 microversion: 2.1 time: 0.137062 Nov 01 02:01:55.809684 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1702/3308] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 02:01:55 2021] GET /compute/v2.1/servers/01cdb4c3-37bc-411a-9fc4-2a1f70e02c61 => generated 1318 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 02:01:56.825878 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-d6a13e86-464d-4915-815b-c831ba23264f tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 02:01:56.826596 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-d6a13e86-464d-4915-815b-c831ba23264f tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] [instance: 01cdb4c3-37bc-411a-9fc4-2a1f70e02c61] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 02:01:56.832655 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d6a13e86-464d-4915-815b-c831ba23264f tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:01:56.833098 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d6a13e86-464d-4915-815b-c831ba23264f tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:01:56.833855 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d6a13e86-464d-4915-815b-c831ba23264f tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:01:56.834287 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d6a13e86-464d-4915-815b-c831ba23264f tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:01:56.954267 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-d6a13e86-464d-4915-815b-c831ba23264f tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3a4d85a244d42adf006700e2e312a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc399e683fbf435a8917245373404232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 02:01:56.961390 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-d6a13e86-464d-4915-815b-c831ba23264f tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] 10.222.0.47 "GET /compute/v2.1/servers/01cdb4c3-37bc-411a-9fc4-2a1f70e02c61" status: 200 len: 1318 microversion: 2.1 time: 0.140110 Nov 01 02:01:56.961949 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1607/3309] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 02:01:56 2021] GET /compute/v2.1/servers/01cdb4c3-37bc-411a-9fc4-2a1f70e02c61 => generated 1318 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 02:01:57.978348 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-2172e93c-2648-4c7a-a432-6044a2bb9c25 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 02:01:57.979003 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-2172e93c-2648-4c7a-a432-6044a2bb9c25 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] [instance: 01cdb4c3-37bc-411a-9fc4-2a1f70e02c61] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 02:01:57.985745 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-2172e93c-2648-4c7a-a432-6044a2bb9c25 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:01:57.986191 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-2172e93c-2648-4c7a-a432-6044a2bb9c25 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:01:57.987014 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-2172e93c-2648-4c7a-a432-6044a2bb9c25 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:01:57.987446 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-2172e93c-2648-4c7a-a432-6044a2bb9c25 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:01:58.109973 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-2172e93c-2648-4c7a-a432-6044a2bb9c25 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3a4d85a244d42adf006700e2e312a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc399e683fbf435a8917245373404232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 02:01:58.117073 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-2172e93c-2648-4c7a-a432-6044a2bb9c25 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] 10.222.0.47 "GET /compute/v2.1/servers/01cdb4c3-37bc-411a-9fc4-2a1f70e02c61" status: 200 len: 1318 microversion: 2.1 time: 0.142381 Nov 01 02:01:58.117635 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1703/3310] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 02:01:57 2021] GET /compute/v2.1/servers/01cdb4c3-37bc-411a-9fc4-2a1f70e02c61 => generated 1318 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 02:01:59.134180 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-80ca0193-8db7-48b7-bd46-acbef12eccc6 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 02:01:59.134802 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-80ca0193-8db7-48b7-bd46-acbef12eccc6 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] [instance: 01cdb4c3-37bc-411a-9fc4-2a1f70e02c61] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 02:01:59.141025 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-80ca0193-8db7-48b7-bd46-acbef12eccc6 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:01:59.141458 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-80ca0193-8db7-48b7-bd46-acbef12eccc6 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:01:59.142208 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-80ca0193-8db7-48b7-bd46-acbef12eccc6 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:01:59.142663 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-80ca0193-8db7-48b7-bd46-acbef12eccc6 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:01:59.261406 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-80ca0193-8db7-48b7-bd46-acbef12eccc6 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3a4d85a244d42adf006700e2e312a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc399e683fbf435a8917245373404232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 02:01:59.268626 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-80ca0193-8db7-48b7-bd46-acbef12eccc6 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] 10.222.0.47 "GET /compute/v2.1/servers/01cdb4c3-37bc-411a-9fc4-2a1f70e02c61" status: 200 len: 1318 microversion: 2.1 time: 0.138092 Nov 01 02:01:59.269170 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1608/3311] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 02:01:59 2021] GET /compute/v2.1/servers/01cdb4c3-37bc-411a-9fc4-2a1f70e02c61 => generated 1318 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 02:02:00.284817 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-d67b6588-f95e-48fa-8d18-d985f199e099 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 02:02:00.285428 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-d67b6588-f95e-48fa-8d18-d985f199e099 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] [instance: 01cdb4c3-37bc-411a-9fc4-2a1f70e02c61] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 02:02:00.291796 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d67b6588-f95e-48fa-8d18-d985f199e099 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:02:00.292240 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d67b6588-f95e-48fa-8d18-d985f199e099 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:02:00.293000 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d67b6588-f95e-48fa-8d18-d985f199e099 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:02:00.293419 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d67b6588-f95e-48fa-8d18-d985f199e099 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:02:00.410933 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-d67b6588-f95e-48fa-8d18-d985f199e099 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3a4d85a244d42adf006700e2e312a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc399e683fbf435a8917245373404232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 02:02:00.418086 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-d67b6588-f95e-48fa-8d18-d985f199e099 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] 10.222.0.47 "GET /compute/v2.1/servers/01cdb4c3-37bc-411a-9fc4-2a1f70e02c61" status: 200 len: 1318 microversion: 2.1 time: 0.136940 Nov 01 02:02:00.418683 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1704/3312] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 02:02:00 2021] GET /compute/v2.1/servers/01cdb4c3-37bc-411a-9fc4-2a1f70e02c61 => generated 1318 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 02:02:01.435544 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-93b3741c-3d4c-426e-a1ca-23ccb415115b tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 02:02:01.436146 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-93b3741c-3d4c-426e-a1ca-23ccb415115b tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] [instance: 01cdb4c3-37bc-411a-9fc4-2a1f70e02c61] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 02:02:01.442865 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-93b3741c-3d4c-426e-a1ca-23ccb415115b tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:02:01.443307 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-93b3741c-3d4c-426e-a1ca-23ccb415115b tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:02:01.444051 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-93b3741c-3d4c-426e-a1ca-23ccb415115b tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:02:01.444472 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-93b3741c-3d4c-426e-a1ca-23ccb415115b tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:02:01.568118 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-93b3741c-3d4c-426e-a1ca-23ccb415115b tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3a4d85a244d42adf006700e2e312a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc399e683fbf435a8917245373404232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 02:02:01.575213 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-93b3741c-3d4c-426e-a1ca-23ccb415115b tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] 10.222.0.47 "GET /compute/v2.1/servers/01cdb4c3-37bc-411a-9fc4-2a1f70e02c61" status: 200 len: 1318 microversion: 2.1 time: 0.143312 Nov 01 02:02:01.575762 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1609/3313] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 02:02:01 2021] GET /compute/v2.1/servers/01cdb4c3-37bc-411a-9fc4-2a1f70e02c61 => generated 1318 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 02:02:02.209997 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [req-4f5afcc2-a37b-44de-ab2a-41132262e44e req-5bf004be-ae8e-49e3-92e3-13ae963d5143 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01cdb4c3-37bc-411a-9fc4-2a1f70e02c61", "name": "network-vif-plugged", "status": "completed", "tag": "7df858e9-d560-4b9c-a8ca-e1371fcf4ac5"}]} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 02:02:02.211668 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 01 02:02:02.211668 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: warnings.warn(msg) Nov 01 02:02:02.219325 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [req-4f5afcc2-a37b-44de-ab2a-41132262e44e req-5bf004be-ae8e-49e3-92e3-13ae963d5143 service nova] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:02:02.219769 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [req-4f5afcc2-a37b-44de-ab2a-41132262e44e req-5bf004be-ae8e-49e3-92e3-13ae963d5143 service nova] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:02:02.277011 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.compute.server_external_events [req-4f5afcc2-a37b-44de-ab2a-41132262e44e req-5bf004be-ae8e-49e3-92e3-13ae963d5143 service nova] Creating event network-vif-plugged:7df858e9-d560-4b9c-a8ca-e1371fcf4ac5 for instance 01cdb4c3-37bc-411a-9fc4-2a1f70e02c61 on hv-cinder-81561 Nov 01 02:02:02.277011 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [req-4f5afcc2-a37b-44de-ab2a-41132262e44e req-5bf004be-ae8e-49e3-92e3-13ae963d5143 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029190 Nov 01 02:02:02.277011 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1705/3314] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Nov 1 02:02:02 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 02:02:02.592590 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-855dc0ef-e37b-4709-934f-f61c711e7633 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 02:02:02.593212 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-855dc0ef-e37b-4709-934f-f61c711e7633 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] [instance: 01cdb4c3-37bc-411a-9fc4-2a1f70e02c61] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 02:02:02.600043 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-855dc0ef-e37b-4709-934f-f61c711e7633 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:02:02.600555 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-855dc0ef-e37b-4709-934f-f61c711e7633 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:02:02.601373 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-855dc0ef-e37b-4709-934f-f61c711e7633 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:02:02.601802 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-855dc0ef-e37b-4709-934f-f61c711e7633 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:02:02.721725 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-855dc0ef-e37b-4709-934f-f61c711e7633 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3a4d85a244d42adf006700e2e312a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc399e683fbf435a8917245373404232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 02:02:02.729088 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-855dc0ef-e37b-4709-934f-f61c711e7633 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] 10.222.0.47 "GET /compute/v2.1/servers/01cdb4c3-37bc-411a-9fc4-2a1f70e02c61" status: 200 len: 1318 microversion: 2.1 time: 0.140138 Nov 01 02:02:02.729656 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1610/3315] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 02:02:02 2021] GET /compute/v2.1/servers/01cdb4c3-37bc-411a-9fc4-2a1f70e02c61 => generated 1318 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 02:02:03.746292 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-156b0058-45fe-41e0-bcac-e9a594c46b6c tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 02:02:03.747014 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-156b0058-45fe-41e0-bcac-e9a594c46b6c tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] [instance: 01cdb4c3-37bc-411a-9fc4-2a1f70e02c61] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 02:02:03.753133 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-156b0058-45fe-41e0-bcac-e9a594c46b6c tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:02:03.753576 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-156b0058-45fe-41e0-bcac-e9a594c46b6c tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:02:03.754325 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-156b0058-45fe-41e0-bcac-e9a594c46b6c tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:02:03.754777 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-156b0058-45fe-41e0-bcac-e9a594c46b6c tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:02:03.874074 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-156b0058-45fe-41e0-bcac-e9a594c46b6c tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3a4d85a244d42adf006700e2e312a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc399e683fbf435a8917245373404232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 02:02:03.881314 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-156b0058-45fe-41e0-bcac-e9a594c46b6c tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] 10.222.0.47 "GET /compute/v2.1/servers/01cdb4c3-37bc-411a-9fc4-2a1f70e02c61" status: 200 len: 1318 microversion: 2.1 time: 0.139419 Nov 01 02:02:03.881922 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1706/3316] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 02:02:03 2021] GET /compute/v2.1/servers/01cdb4c3-37bc-411a-9fc4-2a1f70e02c61 => generated 1318 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 02:02:04.897411 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-a22b95dc-fc7b-4cd2-98b2-b080567be8d8 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 02:02:04.898030 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-a22b95dc-fc7b-4cd2-98b2-b080567be8d8 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] [instance: 01cdb4c3-37bc-411a-9fc4-2a1f70e02c61] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 02:02:04.904261 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a22b95dc-fc7b-4cd2-98b2-b080567be8d8 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:02:04.904706 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a22b95dc-fc7b-4cd2-98b2-b080567be8d8 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:02:04.905463 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a22b95dc-fc7b-4cd2-98b2-b080567be8d8 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:02:04.905893 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a22b95dc-fc7b-4cd2-98b2-b080567be8d8 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:02:05.030662 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-a22b95dc-fc7b-4cd2-98b2-b080567be8d8 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3a4d85a244d42adf006700e2e312a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc399e683fbf435a8917245373404232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 02:02:05.038381 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-a22b95dc-fc7b-4cd2-98b2-b080567be8d8 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] 10.222.0.47 "GET /compute/v2.1/servers/01cdb4c3-37bc-411a-9fc4-2a1f70e02c61" status: 200 len: 1508 microversion: 2.1 time: 0.144657 Nov 01 02:02:05.038965 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1611/3317] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 02:02:04 2021] GET /compute/v2.1/servers/01cdb4c3-37bc-411a-9fc4-2a1f70e02c61 => generated 1508 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 02:02:06.789496 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-eb87e694-fc83-4e52-bdc8-d924cc4339bc tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d1e64147-a60f-4d6c-9a64-084ec7de0980"}} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 02:02:06.790889 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-eb87e694-fc83-4e52-bdc8-d924cc4339bc tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] [instance: 01cdb4c3-37bc-411a-9fc4-2a1f70e02c61] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 02:02:06.797070 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-eb87e694-fc83-4e52-bdc8-d924cc4339bc tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:02:06.797505 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-eb87e694-fc83-4e52-bdc8-d924cc4339bc tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:02:06.798249 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-eb87e694-fc83-4e52-bdc8-d924cc4339bc tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:02:06.798817 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-eb87e694-fc83-4e52-bdc8-d924cc4339bc tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:02:07.568612 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-eb87e694-fc83-4e52-bdc8-d924cc4339bc tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] 10.222.0.47 "POST /compute/v2.1/servers/01cdb4c3-37bc-411a-9fc4-2a1f70e02c61/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.783219 Nov 01 02:02:07.569217 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1707/3318] 10.222.0.47 () {60 vars in 1322 bytes} [Mon Nov 1 02:02:06 2021] POST /compute/v2.1/servers/01cdb4c3-37bc-411a-9fc4-2a1f70e02c61/os-volume_attachments => generated 194 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 02:02:16.117157 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-0c51dac4-d57a-4f56-8681-6104b3da9f5f tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1154589907", "imageRef": "b9068d8d-b02d-4043-9f0c-3d774cb372b3", "flavorRef": "452", "networks": [{"uuid": "8d4ac867-bf0b-462f-8ac6-2516bf6ce1bc"}]}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 02:02:16.170665 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.network.neutron [None req-0c51dac4-d57a-4f56-8681-6104b3da9f5f tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] validate_networks() for [('8d4ac867-bf0b-462f-8ac6-2516bf6ce1bc', None, None, None, None, None)] {{(pid=116266) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Nov 01 02:02:16.533273 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.virt.hardware [None req-0c51dac4-d57a-4f56-8681-6104b3da9f5f tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Flavor limits 0:0:0 {{(pid=116266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 01 02:02:16.533686 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.virt.hardware [None req-0c51dac4-d57a-4f56-8681-6104b3da9f5f tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Image limits 0:0:0 {{(pid=116266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 01 02:02:16.534151 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.virt.hardware [None req-0c51dac4-d57a-4f56-8681-6104b3da9f5f tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Flavor pref 0:0:0 {{(pid=116266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 01 02:02:16.534593 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.virt.hardware [None req-0c51dac4-d57a-4f56-8681-6104b3da9f5f tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Image pref 0:0:0 {{(pid=116266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 01 02:02:16.543001 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.virt.hardware [None req-0c51dac4-d57a-4f56-8681-6104b3da9f5f tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 01 02:02:16.544433 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0c51dac4-d57a-4f56-8681-6104b3da9f5f tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:02:16.544875 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0c51dac4-d57a-4f56-8681-6104b3da9f5f tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:02:16.545665 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0c51dac4-d57a-4f56-8681-6104b3da9f5f tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:02:16.546095 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0c51dac4-d57a-4f56-8681-6104b3da9f5f tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:02:16.561695 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.quota [None req-0c51dac4-d57a-4f56-8681-6104b3da9f5f tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Getting quotas for project bc399e683fbf435a8917245373404232. Resources: {'instances', 'cores', 'ram'} {{(pid=116266) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 01 02:02:16.565600 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.quota [None req-0c51dac4-d57a-4f56-8681-6104b3da9f5f tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Getting quotas for user 61b3a4d85a244d42adf006700e2e312a and project bc399e683fbf435a8917245373404232. Resources: {'instances', 'cores', 'ram'} {{(pid=116266) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 01 02:02:16.576099 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-0c51dac4-d57a-4f56-8681-6104b3da9f5f tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Going to run 1 instances... {{(pid=116266) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 01 02:02:16.582958 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-0c51dac4-d57a-4f56-8681-6104b3da9f5f tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] [instance: e2a04587-1f86-4f76-9a97-08098a35e56e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b9068d8d-b02d-4043-9f0c-3d774cb372b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116266) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 01 02:02:16.699359 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-0c51dac4-d57a-4f56-8681-6104b3da9f5f tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.586356 Nov 01 02:02:16.700031 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1612/3319] 10.222.0.47 () {60 vars in 1146 bytes} [Mon Nov 1 02:02:16 2021] POST /compute/v2.1/servers => generated 380 bytes in 588 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 01 02:02:16.711765 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-1ce5352b-50b5-4f30-944f-5ba23d441bbc tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 02:02:16.712466 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-1ce5352b-50b5-4f30-944f-5ba23d441bbc tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] [instance: e2a04587-1f86-4f76-9a97-08098a35e56e] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 02:02:16.768112 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-1ce5352b-50b5-4f30-944f-5ba23d441bbc tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3a4d85a244d42adf006700e2e312a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc399e683fbf435a8917245373404232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 02:02:16.775372 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-1ce5352b-50b5-4f30-944f-5ba23d441bbc tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] 10.222.0.47 "GET /compute/v2.1/servers/e2a04587-1f86-4f76-9a97-08098a35e56e" status: 200 len: 1218 microversion: 2.1 time: 0.068962 Nov 01 02:02:16.775943 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1708/3320] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 02:02:16 2021] GET /compute/v2.1/servers/e2a04587-1f86-4f76-9a97-08098a35e56e => generated 1218 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 02:02:17.791702 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-8eef334a-bd46-43dc-bde0-607ec55a537b tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 02:02:17.792305 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-8eef334a-bd46-43dc-bde0-607ec55a537b tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] [instance: e2a04587-1f86-4f76-9a97-08098a35e56e] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 02:02:17.801394 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8eef334a-bd46-43dc-bde0-607ec55a537b tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:02:17.801833 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8eef334a-bd46-43dc-bde0-607ec55a537b tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:02:17.803129 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8eef334a-bd46-43dc-bde0-607ec55a537b tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:02:17.803552 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8eef334a-bd46-43dc-bde0-607ec55a537b tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:02:17.862279 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-8eef334a-bd46-43dc-bde0-607ec55a537b tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3a4d85a244d42adf006700e2e312a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc399e683fbf435a8917245373404232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 02:02:17.870027 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-8eef334a-bd46-43dc-bde0-607ec55a537b tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] 10.222.0.47 "GET /compute/v2.1/servers/e2a04587-1f86-4f76-9a97-08098a35e56e" status: 200 len: 1222 microversion: 2.1 time: 0.081979 Nov 01 02:02:17.870611 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1613/3321] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 02:02:17 2021] GET /compute/v2.1/servers/e2a04587-1f86-4f76-9a97-08098a35e56e => generated 1222 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 02:02:18.887048 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-f6139af7-c06c-4774-b33f-5079f94a6431 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 02:02:18.887629 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-f6139af7-c06c-4774-b33f-5079f94a6431 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] [instance: e2a04587-1f86-4f76-9a97-08098a35e56e] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 02:02:18.894892 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f6139af7-c06c-4774-b33f-5079f94a6431 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:02:18.895330 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f6139af7-c06c-4774-b33f-5079f94a6431 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:02:18.896086 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f6139af7-c06c-4774-b33f-5079f94a6431 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:02:18.897136 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f6139af7-c06c-4774-b33f-5079f94a6431 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:02:18.964240 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-f6139af7-c06c-4774-b33f-5079f94a6431 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3a4d85a244d42adf006700e2e312a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc399e683fbf435a8917245373404232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 02:02:18.964802 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-f6139af7-c06c-4774-b33f-5079f94a6431 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] 10.222.0.47 "GET /compute/v2.1/servers/e2a04587-1f86-4f76-9a97-08098a35e56e" status: 200 len: 1278 microversion: 2.1 time: 0.081445 Nov 01 02:02:18.965469 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1709/3322] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 02:02:18 2021] GET /compute/v2.1/servers/e2a04587-1f86-4f76-9a97-08098a35e56e => generated 1278 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 02:02:19.981500 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-21864dde-5e71-4000-bbb8-2cf0c7bc5bbf tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 02:02:19.982167 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-21864dde-5e71-4000-bbb8-2cf0c7bc5bbf tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] [instance: e2a04587-1f86-4f76-9a97-08098a35e56e] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 02:02:19.988440 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-21864dde-5e71-4000-bbb8-2cf0c7bc5bbf tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:02:19.988880 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-21864dde-5e71-4000-bbb8-2cf0c7bc5bbf tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:02:19.989634 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-21864dde-5e71-4000-bbb8-2cf0c7bc5bbf tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:02:19.990058 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-21864dde-5e71-4000-bbb8-2cf0c7bc5bbf tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:02:20.107264 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-21864dde-5e71-4000-bbb8-2cf0c7bc5bbf tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3a4d85a244d42adf006700e2e312a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc399e683fbf435a8917245373404232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 02:02:20.114629 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-21864dde-5e71-4000-bbb8-2cf0c7bc5bbf tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] 10.222.0.47 "GET /compute/v2.1/servers/e2a04587-1f86-4f76-9a97-08098a35e56e" status: 200 len: 1318 microversion: 2.1 time: 0.136801 Nov 01 02:02:20.115190 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1614/3323] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 02:02:19 2021] GET /compute/v2.1/servers/e2a04587-1f86-4f76-9a97-08098a35e56e => generated 1318 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 02:02:20.681477 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [req-c56c0995-3dd2-402d-b825-87725eca7236 req-8931b4c5-c7c2-4e34-b47c-d7410fa7fa2b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2a04587-1f86-4f76-9a97-08098a35e56e", "tag": "8641bfc5-5c3c-4884-b29a-40c7f1fdeab6"}]} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 02:02:20.683253 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 01 02:02:20.683253 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: warnings.warn(msg) Nov 01 02:02:20.690876 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [req-c56c0995-3dd2-402d-b825-87725eca7236 req-8931b4c5-c7c2-4e34-b47c-d7410fa7fa2b service nova] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:02:20.691401 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [req-c56c0995-3dd2-402d-b825-87725eca7236 req-8931b4c5-c7c2-4e34-b47c-d7410fa7fa2b service nova] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:02:20.702956 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.compute.server_external_events [req-c56c0995-3dd2-402d-b825-87725eca7236 req-8931b4c5-c7c2-4e34-b47c-d7410fa7fa2b service nova] Creating event network-changed:8641bfc5-5c3c-4884-b29a-40c7f1fdeab6 for instance e2a04587-1f86-4f76-9a97-08098a35e56e on hv-cinder-81561 Nov 01 02:02:20.707634 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [req-c56c0995-3dd2-402d-b825-87725eca7236 req-8931b4c5-c7c2-4e34-b47c-d7410fa7fa2b service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029856 Nov 01 02:02:20.708243 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1710/3324] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Nov 1 02:02:20 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 02:02:21.131845 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-0d34fa55-10c0-4d06-960c-270738505caf tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 02:02:21.132469 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-0d34fa55-10c0-4d06-960c-270738505caf tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] [instance: e2a04587-1f86-4f76-9a97-08098a35e56e] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 02:02:21.138633 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0d34fa55-10c0-4d06-960c-270738505caf tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:02:21.139086 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0d34fa55-10c0-4d06-960c-270738505caf tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:02:21.139855 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0d34fa55-10c0-4d06-960c-270738505caf tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:02:21.140288 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0d34fa55-10c0-4d06-960c-270738505caf tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:02:21.263015 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-0d34fa55-10c0-4d06-960c-270738505caf tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3a4d85a244d42adf006700e2e312a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc399e683fbf435a8917245373404232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 02:02:21.270173 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-0d34fa55-10c0-4d06-960c-270738505caf tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] 10.222.0.47 "GET /compute/v2.1/servers/e2a04587-1f86-4f76-9a97-08098a35e56e" status: 200 len: 1318 microversion: 2.1 time: 0.142173 Nov 01 02:02:21.270753 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1615/3325] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 02:02:21 2021] GET /compute/v2.1/servers/e2a04587-1f86-4f76-9a97-08098a35e56e => generated 1318 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 02:02:22.287825 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-76769126-e98a-4801-8271-ef58baba8733 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 02:02:22.288555 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-76769126-e98a-4801-8271-ef58baba8733 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] [instance: e2a04587-1f86-4f76-9a97-08098a35e56e] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 02:02:22.295022 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-76769126-e98a-4801-8271-ef58baba8733 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:02:22.295469 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-76769126-e98a-4801-8271-ef58baba8733 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:02:22.296223 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-76769126-e98a-4801-8271-ef58baba8733 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:02:22.296657 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-76769126-e98a-4801-8271-ef58baba8733 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:02:22.417835 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-76769126-e98a-4801-8271-ef58baba8733 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3a4d85a244d42adf006700e2e312a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc399e683fbf435a8917245373404232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 02:02:22.425181 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-76769126-e98a-4801-8271-ef58baba8733 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] 10.222.0.47 "GET /compute/v2.1/servers/e2a04587-1f86-4f76-9a97-08098a35e56e" status: 200 len: 1318 microversion: 2.1 time: 0.141908 Nov 01 02:02:22.425751 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1711/3326] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 02:02:22 2021] GET /compute/v2.1/servers/e2a04587-1f86-4f76-9a97-08098a35e56e => generated 1318 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 02:02:23.442650 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-d7eef241-7d19-439b-b90f-9aa6eb7b0e91 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 02:02:23.443263 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-d7eef241-7d19-439b-b90f-9aa6eb7b0e91 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] [instance: e2a04587-1f86-4f76-9a97-08098a35e56e] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 02:02:23.453421 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d7eef241-7d19-439b-b90f-9aa6eb7b0e91 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:02:23.453882 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d7eef241-7d19-439b-b90f-9aa6eb7b0e91 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:02:23.454715 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d7eef241-7d19-439b-b90f-9aa6eb7b0e91 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:02:23.455146 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-d7eef241-7d19-439b-b90f-9aa6eb7b0e91 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:02:23.579461 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-d7eef241-7d19-439b-b90f-9aa6eb7b0e91 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3a4d85a244d42adf006700e2e312a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc399e683fbf435a8917245373404232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 02:02:23.586490 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-d7eef241-7d19-439b-b90f-9aa6eb7b0e91 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] 10.222.0.47 "GET /compute/v2.1/servers/e2a04587-1f86-4f76-9a97-08098a35e56e" status: 200 len: 1318 microversion: 2.1 time: 0.147940 Nov 01 02:02:23.587069 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1616/3327] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 02:02:23 2021] GET /compute/v2.1/servers/e2a04587-1f86-4f76-9a97-08098a35e56e => generated 1318 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 02:02:24.603008 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-73c8791e-7896-4c08-a745-60d21798b537 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 02:02:24.603605 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-73c8791e-7896-4c08-a745-60d21798b537 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] [instance: e2a04587-1f86-4f76-9a97-08098a35e56e] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 02:02:24.609822 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-73c8791e-7896-4c08-a745-60d21798b537 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:02:24.610258 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-73c8791e-7896-4c08-a745-60d21798b537 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:02:24.611061 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-73c8791e-7896-4c08-a745-60d21798b537 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:02:24.611482 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-73c8791e-7896-4c08-a745-60d21798b537 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:02:24.732710 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-73c8791e-7896-4c08-a745-60d21798b537 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3a4d85a244d42adf006700e2e312a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc399e683fbf435a8917245373404232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 02:02:24.740452 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-73c8791e-7896-4c08-a745-60d21798b537 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] 10.222.0.47 "GET /compute/v2.1/servers/e2a04587-1f86-4f76-9a97-08098a35e56e" status: 200 len: 1318 microversion: 2.1 time: 0.140687 Nov 01 02:02:24.741027 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1712/3328] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 02:02:24 2021] GET /compute/v2.1/servers/e2a04587-1f86-4f76-9a97-08098a35e56e => generated 1318 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 02:02:25.757346 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-ccdd0de8-b3fc-4eb7-a80c-2253fa2ea7c9 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 02:02:25.757956 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-ccdd0de8-b3fc-4eb7-a80c-2253fa2ea7c9 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] [instance: e2a04587-1f86-4f76-9a97-08098a35e56e] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 02:02:25.764261 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ccdd0de8-b3fc-4eb7-a80c-2253fa2ea7c9 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:02:25.764706 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ccdd0de8-b3fc-4eb7-a80c-2253fa2ea7c9 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:02:25.765499 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ccdd0de8-b3fc-4eb7-a80c-2253fa2ea7c9 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:02:25.765929 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-ccdd0de8-b3fc-4eb7-a80c-2253fa2ea7c9 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:02:25.907528 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-ccdd0de8-b3fc-4eb7-a80c-2253fa2ea7c9 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3a4d85a244d42adf006700e2e312a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc399e683fbf435a8917245373404232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 02:02:25.914667 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-ccdd0de8-b3fc-4eb7-a80c-2253fa2ea7c9 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] 10.222.0.47 "GET /compute/v2.1/servers/e2a04587-1f86-4f76-9a97-08098a35e56e" status: 200 len: 1318 microversion: 2.1 time: 0.161510 Nov 01 02:02:25.915231 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1617/3329] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 02:02:25 2021] GET /compute/v2.1/servers/e2a04587-1f86-4f76-9a97-08098a35e56e => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 02:02:26.931485 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-0e1664e1-ffc5-46a5-9029-062887a437d3 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 02:02:26.932083 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-0e1664e1-ffc5-46a5-9029-062887a437d3 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] [instance: e2a04587-1f86-4f76-9a97-08098a35e56e] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 02:02:26.938315 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0e1664e1-ffc5-46a5-9029-062887a437d3 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:02:26.938783 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0e1664e1-ffc5-46a5-9029-062887a437d3 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:02:26.939531 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0e1664e1-ffc5-46a5-9029-062887a437d3 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:02:26.939953 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0e1664e1-ffc5-46a5-9029-062887a437d3 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:02:27.056019 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-0e1664e1-ffc5-46a5-9029-062887a437d3 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3a4d85a244d42adf006700e2e312a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc399e683fbf435a8917245373404232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 02:02:27.063189 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-0e1664e1-ffc5-46a5-9029-062887a437d3 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] 10.222.0.47 "GET /compute/v2.1/servers/e2a04587-1f86-4f76-9a97-08098a35e56e" status: 200 len: 1318 microversion: 2.1 time: 0.135361 Nov 01 02:02:27.063742 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1713/3330] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 02:02:26 2021] GET /compute/v2.1/servers/e2a04587-1f86-4f76-9a97-08098a35e56e => generated 1318 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 02:02:28.080394 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-f3873578-ea32-4dc9-8ef7-9d0b1cc0a12a tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 02:02:28.081091 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-f3873578-ea32-4dc9-8ef7-9d0b1cc0a12a tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] [instance: e2a04587-1f86-4f76-9a97-08098a35e56e] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 02:02:28.087501 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f3873578-ea32-4dc9-8ef7-9d0b1cc0a12a tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:02:28.087952 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f3873578-ea32-4dc9-8ef7-9d0b1cc0a12a tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:02:28.088742 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f3873578-ea32-4dc9-8ef7-9d0b1cc0a12a tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:02:28.089199 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f3873578-ea32-4dc9-8ef7-9d0b1cc0a12a tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:02:28.141941 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [req-1316cb73-3888-46e6-95de-6e7837e956b7 req-3880a41c-e7b5-425c-aa2b-f2e46e5cfd45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2a04587-1f86-4f76-9a97-08098a35e56e", "name": "network-vif-plugged", "status": "completed", "tag": "8641bfc5-5c3c-4884-b29a-40c7f1fdeab6"}]} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 02:02:28.143624 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 01 02:02:28.143624 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: warnings.warn(msg) Nov 01 02:02:28.151378 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [req-1316cb73-3888-46e6-95de-6e7837e956b7 req-3880a41c-e7b5-425c-aa2b-f2e46e5cfd45 service nova] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:02:28.151898 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [req-1316cb73-3888-46e6-95de-6e7837e956b7 req-3880a41c-e7b5-425c-aa2b-f2e46e5cfd45 service nova] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:02:28.163108 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.compute.server_external_events [req-1316cb73-3888-46e6-95de-6e7837e956b7 req-3880a41c-e7b5-425c-aa2b-f2e46e5cfd45 service nova] Creating event network-vif-plugged:8641bfc5-5c3c-4884-b29a-40c7f1fdeab6 for instance e2a04587-1f86-4f76-9a97-08098a35e56e on hv-cinder-81561 Nov 01 02:02:28.168155 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [req-1316cb73-3888-46e6-95de-6e7837e956b7 req-3880a41c-e7b5-425c-aa2b-f2e46e5cfd45 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030109 Nov 01 02:02:28.168939 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1714/3331] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Nov 1 02:02:28 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 01 02:02:28.221771 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-f3873578-ea32-4dc9-8ef7-9d0b1cc0a12a tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3a4d85a244d42adf006700e2e312a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc399e683fbf435a8917245373404232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 02:02:28.229652 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-f3873578-ea32-4dc9-8ef7-9d0b1cc0a12a tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] 10.222.0.47 "GET /compute/v2.1/servers/e2a04587-1f86-4f76-9a97-08098a35e56e" status: 200 len: 1318 microversion: 2.1 time: 0.152977 Nov 01 02:02:28.230235 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1618/3332] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 02:02:28 2021] GET /compute/v2.1/servers/e2a04587-1f86-4f76-9a97-08098a35e56e => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 02:02:29.247749 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-d2a948f9-a983-442b-8a02-a228a3415751 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 02:02:29.248160 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-d2a948f9-a983-442b-8a02-a228a3415751 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] [instance: e2a04587-1f86-4f76-9a97-08098a35e56e] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 02:02:29.254370 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d2a948f9-a983-442b-8a02-a228a3415751 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:02:29.254849 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d2a948f9-a983-442b-8a02-a228a3415751 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:02:29.255686 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d2a948f9-a983-442b-8a02-a228a3415751 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:02:29.256165 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d2a948f9-a983-442b-8a02-a228a3415751 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:02:29.389457 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-d2a948f9-a983-442b-8a02-a228a3415751 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3a4d85a244d42adf006700e2e312a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc399e683fbf435a8917245373404232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 02:02:29.400001 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-d2a948f9-a983-442b-8a02-a228a3415751 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] 10.222.0.47 "GET /compute/v2.1/servers/e2a04587-1f86-4f76-9a97-08098a35e56e" status: 200 len: 1318 microversion: 2.1 time: 0.156870 Nov 01 02:02:29.400946 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1715/3333] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 02:02:29 2021] GET /compute/v2.1/servers/e2a04587-1f86-4f76-9a97-08098a35e56e => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 02:02:30.416437 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-59e05e59-ff93-40aa-95e6-d35b514c86e7 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 02:02:30.417035 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-59e05e59-ff93-40aa-95e6-d35b514c86e7 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] [instance: e2a04587-1f86-4f76-9a97-08098a35e56e] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 02:02:30.423455 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-59e05e59-ff93-40aa-95e6-d35b514c86e7 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:02:30.423895 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-59e05e59-ff93-40aa-95e6-d35b514c86e7 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:02:30.424646 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-59e05e59-ff93-40aa-95e6-d35b514c86e7 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:02:30.425068 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-59e05e59-ff93-40aa-95e6-d35b514c86e7 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:02:30.546248 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-59e05e59-ff93-40aa-95e6-d35b514c86e7 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3a4d85a244d42adf006700e2e312a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc399e683fbf435a8917245373404232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 02:02:30.554030 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-59e05e59-ff93-40aa-95e6-d35b514c86e7 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] 10.222.0.47 "GET /compute/v2.1/servers/e2a04587-1f86-4f76-9a97-08098a35e56e" status: 200 len: 1508 microversion: 2.1 time: 0.141204 Nov 01 02:02:30.554613 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1619/3334] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 02:02:30 2021] GET /compute/v2.1/servers/e2a04587-1f86-4f76-9a97-08098a35e56e => generated 1508 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 02:02:30.570689 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-f8cafe13-a46e-4ae7-b9a0-9678209a87d9 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d1e64147-a60f-4d6c-9a64-084ec7de0980"}} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 02:02:30.571739 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-f8cafe13-a46e-4ae7-b9a0-9678209a87d9 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] [instance: e2a04587-1f86-4f76-9a97-08098a35e56e] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 02:02:30.578020 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f8cafe13-a46e-4ae7-b9a0-9678209a87d9 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:02:30.578482 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f8cafe13-a46e-4ae7-b9a0-9678209a87d9 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:02:30.579272 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f8cafe13-a46e-4ae7-b9a0-9678209a87d9 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:02:30.579701 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f8cafe13-a46e-4ae7-b9a0-9678209a87d9 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:02:30.653263 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.wsgi [None req-f8cafe13-a46e-4ae7-b9a0-9678209a87d9 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] HTTP exception thrown: Invalid volume: volume d1e64147-a60f-4d6c-9a64-084ec7de0980 is already attached to instances: 01cdb4c3-37bc-411a-9fc4-2a1f70e02c61 Nov 01 02:02:30.653858 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-f8cafe13-a46e-4ae7-b9a0-9678209a87d9 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Returning 400 to user: Invalid volume: volume d1e64147-a60f-4d6c-9a64-084ec7de0980 is already attached to instances: 01cdb4c3-37bc-411a-9fc4-2a1f70e02c61 {{(pid=116267) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 01 02:02:30.654726 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-f8cafe13-a46e-4ae7-b9a0-9678209a87d9 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] 10.222.0.47 "POST /compute/v2.1/servers/e2a04587-1f86-4f76-9a97-08098a35e56e/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.088478 Nov 01 02:02:30.655266 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1716/3335] 10.222.0.47 () {60 vars in 1322 bytes} [Mon Nov 1 02:02:30 2021] POST /compute/v2.1/servers/e2a04587-1f86-4f76-9a97-08098a35e56e/os-volume_attachments => generated 174 bytes in 90 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Nov 01 02:02:30.711511 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-c76a23f7-8b95-456d-8a9d-58edd73bd047 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 02:02:30.711996 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-c76a23f7-8b95-456d-8a9d-58edd73bd047 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] [instance: 01cdb4c3-37bc-411a-9fc4-2a1f70e02c61] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 02:02:30.717695 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c76a23f7-8b95-456d-8a9d-58edd73bd047 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:02:30.718134 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c76a23f7-8b95-456d-8a9d-58edd73bd047 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:02:30.718905 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c76a23f7-8b95-456d-8a9d-58edd73bd047 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:02:30.719327 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-c76a23f7-8b95-456d-8a9d-58edd73bd047 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:02:30.795270 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.objects.instance [None req-c76a23f7-8b95-456d-8a9d-58edd73bd047 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lazy-loading 'services' on Instance uuid 01cdb4c3-37bc-411a-9fc4-2a1f70e02c61 {{(pid=116266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 01 02:02:31.005210 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-c76a23f7-8b95-456d-8a9d-58edd73bd047 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] 10.222.0.47 "DELETE /compute/v2.1/servers/01cdb4c3-37bc-411a-9fc4-2a1f70e02c61/os-volume_attachments/d1e64147-a60f-4d6c-9a64-084ec7de0980" status: 202 len: 0 microversion: 2.1 time: 0.297194 Nov 01 02:02:31.005783 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1620/3336] 10.222.0.47 () {58 vars in 1415 bytes} [Mon Nov 1 02:02:30 2021] DELETE /compute/v2.1/servers/01cdb4c3-37bc-411a-9fc4-2a1f70e02c61/os-volume_attachments/d1e64147-a60f-4d6c-9a64-084ec7de0980 => generated 0 bytes in 299 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 01 02:02:31.014056 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-533317ee-41a8-4ff6-a1e1-604d034450cf tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 02:02:31.015065 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-533317ee-41a8-4ff6-a1e1-604d034450cf tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] [instance: 01cdb4c3-37bc-411a-9fc4-2a1f70e02c61] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 02:02:31.020855 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-533317ee-41a8-4ff6-a1e1-604d034450cf tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:02:31.021298 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-533317ee-41a8-4ff6-a1e1-604d034450cf tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:02:31.022059 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-533317ee-41a8-4ff6-a1e1-604d034450cf tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:02:31.022517 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-533317ee-41a8-4ff6-a1e1-604d034450cf tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:02:31.052257 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-533317ee-41a8-4ff6-a1e1-604d034450cf tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] 10.222.0.47 "GET /compute/v2.1/servers/01cdb4c3-37bc-411a-9fc4-2a1f70e02c61/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041931 Nov 01 02:02:31.053479 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1717/3337] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 02:02:31 2021] GET /compute/v2.1/servers/01cdb4c3-37bc-411a-9fc4-2a1f70e02c61/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 02:02:32.065771 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-56703eb7-f4da-4d9a-8e86-fb695a77d7a6 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 02:02:32.066762 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-56703eb7-f4da-4d9a-8e86-fb695a77d7a6 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] [instance: 01cdb4c3-37bc-411a-9fc4-2a1f70e02c61] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 02:02:32.073371 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-56703eb7-f4da-4d9a-8e86-fb695a77d7a6 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:02:32.073789 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-56703eb7-f4da-4d9a-8e86-fb695a77d7a6 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:02:32.074577 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-56703eb7-f4da-4d9a-8e86-fb695a77d7a6 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:02:32.075007 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-56703eb7-f4da-4d9a-8e86-fb695a77d7a6 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:02:32.104342 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-56703eb7-f4da-4d9a-8e86-fb695a77d7a6 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] 10.222.0.47 "GET /compute/v2.1/servers/01cdb4c3-37bc-411a-9fc4-2a1f70e02c61/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043295 Nov 01 02:02:32.104882 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1621/3338] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 02:02:32 2021] GET /compute/v2.1/servers/01cdb4c3-37bc-411a-9fc4-2a1f70e02c61/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 02:02:33.115855 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-ec4eabf5-fff5-4cf8-a057-1b554a44d873 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 02:02:33.116682 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-ec4eabf5-fff5-4cf8-a057-1b554a44d873 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] [instance: 01cdb4c3-37bc-411a-9fc4-2a1f70e02c61] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 02:02:33.123063 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ec4eabf5-fff5-4cf8-a057-1b554a44d873 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:02:33.123502 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ec4eabf5-fff5-4cf8-a057-1b554a44d873 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:02:33.124255 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ec4eabf5-fff5-4cf8-a057-1b554a44d873 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:02:33.124679 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ec4eabf5-fff5-4cf8-a057-1b554a44d873 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:02:33.153622 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-ec4eabf5-fff5-4cf8-a057-1b554a44d873 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] 10.222.0.47 "GET /compute/v2.1/servers/01cdb4c3-37bc-411a-9fc4-2a1f70e02c61/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041592 Nov 01 02:02:33.154166 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1718/3339] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 02:02:33 2021] GET /compute/v2.1/servers/01cdb4c3-37bc-411a-9fc4-2a1f70e02c61/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 01 02:02:33.249999 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-8d1ef961-06cf-4578-80f0-cb2a1c189382 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-617892613", "imageRef": "b9068d8d-b02d-4043-9f0c-3d774cb372b3", "flavorRef": "452", "networks": [{"uuid": "8d4ac867-bf0b-462f-8ac6-2516bf6ce1bc"}]}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 02:02:33.422498 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.network.neutron [None req-8d1ef961-06cf-4578-80f0-cb2a1c189382 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] validate_networks() for [('8d4ac867-bf0b-462f-8ac6-2516bf6ce1bc', None, None, None, None, None)] {{(pid=116266) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Nov 01 02:02:34.011883 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.virt.hardware [None req-8d1ef961-06cf-4578-80f0-cb2a1c189382 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Flavor limits 0:0:0 {{(pid=116266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 01 02:02:34.012291 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.virt.hardware [None req-8d1ef961-06cf-4578-80f0-cb2a1c189382 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Image limits 0:0:0 {{(pid=116266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 01 02:02:34.012758 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.virt.hardware [None req-8d1ef961-06cf-4578-80f0-cb2a1c189382 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Flavor pref 0:0:0 {{(pid=116266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 01 02:02:34.013156 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.virt.hardware [None req-8d1ef961-06cf-4578-80f0-cb2a1c189382 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Image pref 0:0:0 {{(pid=116266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 01 02:02:34.013557 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.virt.hardware [None req-8d1ef961-06cf-4578-80f0-cb2a1c189382 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 01 02:02:34.021906 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8d1ef961-06cf-4578-80f0-cb2a1c189382 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:02:34.022465 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8d1ef961-06cf-4578-80f0-cb2a1c189382 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:02:34.023268 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8d1ef961-06cf-4578-80f0-cb2a1c189382 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:02:34.023693 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-8d1ef961-06cf-4578-80f0-cb2a1c189382 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:02:34.039821 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.quota [None req-8d1ef961-06cf-4578-80f0-cb2a1c189382 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Getting quotas for project bc399e683fbf435a8917245373404232. Resources: {'instances', 'cores', 'ram'} {{(pid=116266) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 01 02:02:34.043943 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.quota [None req-8d1ef961-06cf-4578-80f0-cb2a1c189382 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Getting quotas for user 61b3a4d85a244d42adf006700e2e312a and project bc399e683fbf435a8917245373404232. Resources: {'instances', 'cores', 'ram'} {{(pid=116266) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 01 02:02:34.054890 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-8d1ef961-06cf-4578-80f0-cb2a1c189382 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Going to run 1 instances... {{(pid=116266) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 01 02:02:34.057186 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-8d1ef961-06cf-4578-80f0-cb2a1c189382 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] [instance: cb36afe7-6664-4cd8-9de4-43f4458a436f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b9068d8d-b02d-4043-9f0c-3d774cb372b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116266) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 01 02:02:34.155838 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-8d1ef961-06cf-4578-80f0-cb2a1c189382 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.909502 Nov 01 02:02:34.156472 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1622/3340] 10.222.0.47 () {60 vars in 1146 bytes} [Mon Nov 1 02:02:33 2021] POST /compute/v2.1/servers => generated 380 bytes in 911 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 01 02:02:34.166666 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-928222bc-20fd-484d-a645-a702af3f57c2 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 02:02:34.167299 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-928222bc-20fd-484d-a645-a702af3f57c2 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] [instance: cb36afe7-6664-4cd8-9de4-43f4458a436f] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 02:02:34.220778 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-928222bc-20fd-484d-a645-a702af3f57c2 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3a4d85a244d42adf006700e2e312a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc399e683fbf435a8917245373404232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 02:02:34.228344 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-928222bc-20fd-484d-a645-a702af3f57c2 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] 10.222.0.47 "GET /compute/v2.1/servers/cb36afe7-6664-4cd8-9de4-43f4458a436f" status: 200 len: 1217 microversion: 2.1 time: 0.065747 Nov 01 02:02:34.228965 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1719/3341] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 02:02:34 2021] GET /compute/v2.1/servers/cb36afe7-6664-4cd8-9de4-43f4458a436f => generated 1217 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 02:02:35.245747 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-2e380de5-c65b-419c-97ca-3c04a0ef7c2a tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 02:02:35.246256 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-2e380de5-c65b-419c-97ca-3c04a0ef7c2a tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] [instance: cb36afe7-6664-4cd8-9de4-43f4458a436f] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 02:02:35.253008 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2e380de5-c65b-419c-97ca-3c04a0ef7c2a tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:02:35.253459 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2e380de5-c65b-419c-97ca-3c04a0ef7c2a tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:02:35.254237 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2e380de5-c65b-419c-97ca-3c04a0ef7c2a tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:02:35.254698 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2e380de5-c65b-419c-97ca-3c04a0ef7c2a tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:02:35.315219 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-2e380de5-c65b-419c-97ca-3c04a0ef7c2a tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3a4d85a244d42adf006700e2e312a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc399e683fbf435a8917245373404232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 02:02:35.322381 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-2e380de5-c65b-419c-97ca-3c04a0ef7c2a tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] 10.222.0.47 "GET /compute/v2.1/servers/cb36afe7-6664-4cd8-9de4-43f4458a436f" status: 200 len: 1221 microversion: 2.1 time: 0.081016 Nov 01 02:02:35.322962 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1623/3342] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 02:02:35 2021] GET /compute/v2.1/servers/cb36afe7-6664-4cd8-9de4-43f4458a436f => generated 1221 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 02:02:36.339198 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-12ca470c-aeb1-4031-83ab-01a412074ace tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 02:02:36.340413 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-12ca470c-aeb1-4031-83ab-01a412074ace tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] [instance: cb36afe7-6664-4cd8-9de4-43f4458a436f] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 02:02:36.347711 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-12ca470c-aeb1-4031-83ab-01a412074ace tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:02:36.348248 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-12ca470c-aeb1-4031-83ab-01a412074ace tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:02:36.349106 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-12ca470c-aeb1-4031-83ab-01a412074ace tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:02:36.349641 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-12ca470c-aeb1-4031-83ab-01a412074ace tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:02:36.412284 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-12ca470c-aeb1-4031-83ab-01a412074ace tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3a4d85a244d42adf006700e2e312a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc399e683fbf435a8917245373404232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 02:02:36.420077 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-12ca470c-aeb1-4031-83ab-01a412074ace tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] 10.222.0.47 "GET /compute/v2.1/servers/cb36afe7-6664-4cd8-9de4-43f4458a436f" status: 200 len: 1277 microversion: 2.1 time: 0.084568 Nov 01 02:02:36.420739 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1720/3343] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 02:02:36 2021] GET /compute/v2.1/servers/cb36afe7-6664-4cd8-9de4-43f4458a436f => generated 1277 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 02:02:37.437498 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-32466b29-ad19-4e03-af89-f5ae945bdd25 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 02:02:37.438124 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-32466b29-ad19-4e03-af89-f5ae945bdd25 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] [instance: cb36afe7-6664-4cd8-9de4-43f4458a436f] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 02:02:37.444473 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-32466b29-ad19-4e03-af89-f5ae945bdd25 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:02:37.444918 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-32466b29-ad19-4e03-af89-f5ae945bdd25 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:02:37.445695 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-32466b29-ad19-4e03-af89-f5ae945bdd25 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:02:37.446123 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-32466b29-ad19-4e03-af89-f5ae945bdd25 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:02:37.566480 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-32466b29-ad19-4e03-af89-f5ae945bdd25 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3a4d85a244d42adf006700e2e312a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc399e683fbf435a8917245373404232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 02:02:37.573822 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-32466b29-ad19-4e03-af89-f5ae945bdd25 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] 10.222.0.47 "GET /compute/v2.1/servers/cb36afe7-6664-4cd8-9de4-43f4458a436f" status: 200 len: 1317 microversion: 2.1 time: 0.140657 Nov 01 02:02:37.574456 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1624/3344] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 02:02:37 2021] GET /compute/v2.1/servers/cb36afe7-6664-4cd8-9de4-43f4458a436f => generated 1317 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 02:02:37.980889 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [req-c6a2fde5-87ca-406a-8ade-a4a8dff2bfe4 req-7799d826-8b73-433f-b0c7-7b52c91d049b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb36afe7-6664-4cd8-9de4-43f4458a436f", "tag": "df0b9dfc-ed37-4e2d-9b57-045311702db1"}]} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 02:02:37.982700 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 01 02:02:37.982700 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: warnings.warn(msg) Nov 01 02:02:37.990193 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [req-c6a2fde5-87ca-406a-8ade-a4a8dff2bfe4 req-7799d826-8b73-433f-b0c7-7b52c91d049b service nova] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:02:37.996317 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [req-c6a2fde5-87ca-406a-8ade-a4a8dff2bfe4 req-7799d826-8b73-433f-b0c7-7b52c91d049b service nova] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:02:38.001599 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.compute.server_external_events [req-c6a2fde5-87ca-406a-8ade-a4a8dff2bfe4 req-7799d826-8b73-433f-b0c7-7b52c91d049b service nova] Creating event network-changed:df0b9dfc-ed37-4e2d-9b57-045311702db1 for instance cb36afe7-6664-4cd8-9de4-43f4458a436f on hv-cinder-81561 Nov 01 02:02:38.006483 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [req-c6a2fde5-87ca-406a-8ade-a4a8dff2bfe4 req-7799d826-8b73-433f-b0c7-7b52c91d049b service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029354 Nov 01 02:02:38.007243 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1721/3345] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Nov 1 02:02:37 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 02:02:38.591263 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-e0e936cb-e86b-4903-88e8-2d4545e48739 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 02:02:38.591805 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-e0e936cb-e86b-4903-88e8-2d4545e48739 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] [instance: cb36afe7-6664-4cd8-9de4-43f4458a436f] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 02:02:38.597940 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e0e936cb-e86b-4903-88e8-2d4545e48739 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:02:38.598389 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e0e936cb-e86b-4903-88e8-2d4545e48739 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:02:38.599179 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e0e936cb-e86b-4903-88e8-2d4545e48739 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:02:38.599610 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e0e936cb-e86b-4903-88e8-2d4545e48739 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:02:38.722997 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-e0e936cb-e86b-4903-88e8-2d4545e48739 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3a4d85a244d42adf006700e2e312a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc399e683fbf435a8917245373404232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 02:02:38.730161 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-e0e936cb-e86b-4903-88e8-2d4545e48739 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] 10.222.0.47 "GET /compute/v2.1/servers/cb36afe7-6664-4cd8-9de4-43f4458a436f" status: 200 len: 1317 microversion: 2.1 time: 0.143234 Nov 01 02:02:38.730761 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1625/3346] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 02:02:38 2021] GET /compute/v2.1/servers/cb36afe7-6664-4cd8-9de4-43f4458a436f => generated 1317 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 02:02:39.748324 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-3bb35406-ff8c-481b-a818-0473ce8cc7f1 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 02:02:39.749013 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-3bb35406-ff8c-481b-a818-0473ce8cc7f1 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] [instance: cb36afe7-6664-4cd8-9de4-43f4458a436f] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 02:02:39.755056 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3bb35406-ff8c-481b-a818-0473ce8cc7f1 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:02:39.755501 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3bb35406-ff8c-481b-a818-0473ce8cc7f1 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:02:39.756253 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3bb35406-ff8c-481b-a818-0473ce8cc7f1 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:02:39.756682 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3bb35406-ff8c-481b-a818-0473ce8cc7f1 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:02:39.873844 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-3bb35406-ff8c-481b-a818-0473ce8cc7f1 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3a4d85a244d42adf006700e2e312a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc399e683fbf435a8917245373404232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 02:02:39.880997 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-3bb35406-ff8c-481b-a818-0473ce8cc7f1 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] 10.222.0.47 "GET /compute/v2.1/servers/cb36afe7-6664-4cd8-9de4-43f4458a436f" status: 200 len: 1317 microversion: 2.1 time: 0.137770 Nov 01 02:02:39.881563 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1722/3347] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 02:02:39 2021] GET /compute/v2.1/servers/cb36afe7-6664-4cd8-9de4-43f4458a436f => generated 1317 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 02:02:40.897598 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-2b0d336a-a234-4d36-a03e-1a66acfd9280 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 02:02:40.898186 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-2b0d336a-a234-4d36-a03e-1a66acfd9280 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] [instance: cb36afe7-6664-4cd8-9de4-43f4458a436f] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 02:02:40.904896 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2b0d336a-a234-4d36-a03e-1a66acfd9280 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:02:40.905339 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2b0d336a-a234-4d36-a03e-1a66acfd9280 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:02:40.906097 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2b0d336a-a234-4d36-a03e-1a66acfd9280 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:02:40.906568 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-2b0d336a-a234-4d36-a03e-1a66acfd9280 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:02:41.025946 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-2b0d336a-a234-4d36-a03e-1a66acfd9280 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3a4d85a244d42adf006700e2e312a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc399e683fbf435a8917245373404232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 02:02:41.033190 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-2b0d336a-a234-4d36-a03e-1a66acfd9280 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] 10.222.0.47 "GET /compute/v2.1/servers/cb36afe7-6664-4cd8-9de4-43f4458a436f" status: 200 len: 1317 microversion: 2.1 time: 0.139325 Nov 01 02:02:41.033744 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1626/3348] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 02:02:40 2021] GET /compute/v2.1/servers/cb36afe7-6664-4cd8-9de4-43f4458a436f => generated 1317 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 02:02:42.048975 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-3b38acea-e4a2-40f9-854e-a77f90a1d6f2 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 02:02:42.049574 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-3b38acea-e4a2-40f9-854e-a77f90a1d6f2 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] [instance: cb36afe7-6664-4cd8-9de4-43f4458a436f] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 02:02:42.055648 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3b38acea-e4a2-40f9-854e-a77f90a1d6f2 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:02:42.056087 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3b38acea-e4a2-40f9-854e-a77f90a1d6f2 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:02:42.056839 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3b38acea-e4a2-40f9-854e-a77f90a1d6f2 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:02:42.057269 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3b38acea-e4a2-40f9-854e-a77f90a1d6f2 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:02:42.180754 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-3b38acea-e4a2-40f9-854e-a77f90a1d6f2 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3a4d85a244d42adf006700e2e312a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc399e683fbf435a8917245373404232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 02:02:42.190319 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-3b38acea-e4a2-40f9-854e-a77f90a1d6f2 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] 10.222.0.47 "GET /compute/v2.1/servers/cb36afe7-6664-4cd8-9de4-43f4458a436f" status: 200 len: 1317 microversion: 2.1 time: 0.144904 Nov 01 02:02:42.190944 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1723/3349] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 02:02:42 2021] GET /compute/v2.1/servers/cb36afe7-6664-4cd8-9de4-43f4458a436f => generated 1317 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 02:02:43.207421 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-761cc039-9c5f-4c72-9ed8-04b0c5361d94 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 02:02:43.212163 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-761cc039-9c5f-4c72-9ed8-04b0c5361d94 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] [instance: cb36afe7-6664-4cd8-9de4-43f4458a436f] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 02:02:43.214216 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-761cc039-9c5f-4c72-9ed8-04b0c5361d94 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:02:43.214690 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-761cc039-9c5f-4c72-9ed8-04b0c5361d94 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:02:43.215432 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-761cc039-9c5f-4c72-9ed8-04b0c5361d94 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:02:43.215853 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-761cc039-9c5f-4c72-9ed8-04b0c5361d94 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:02:43.334513 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-761cc039-9c5f-4c72-9ed8-04b0c5361d94 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3a4d85a244d42adf006700e2e312a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc399e683fbf435a8917245373404232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 02:02:43.341654 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-761cc039-9c5f-4c72-9ed8-04b0c5361d94 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] 10.222.0.47 "GET /compute/v2.1/servers/cb36afe7-6664-4cd8-9de4-43f4458a436f" status: 200 len: 1317 microversion: 2.1 time: 0.137933 Nov 01 02:02:43.342217 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1627/3350] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 02:02:43 2021] GET /compute/v2.1/servers/cb36afe7-6664-4cd8-9de4-43f4458a436f => generated 1317 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 02:02:44.228716 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [req-dae8d3b9-0176-4c77-b0bf-a3902a11875d req-1c2c0f44-aa97-4222-ba48-edfb53bd8ca9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb36afe7-6664-4cd8-9de4-43f4458a436f", "name": "network-vif-plugged", "status": "completed", "tag": "df0b9dfc-ed37-4e2d-9b57-045311702db1"}]} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 02:02:44.230344 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 01 02:02:44.230344 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: warnings.warn(msg) Nov 01 02:02:44.237566 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [req-dae8d3b9-0176-4c77-b0bf-a3902a11875d req-1c2c0f44-aa97-4222-ba48-edfb53bd8ca9 service nova] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:02:44.243222 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [req-dae8d3b9-0176-4c77-b0bf-a3902a11875d req-1c2c0f44-aa97-4222-ba48-edfb53bd8ca9 service nova] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:02:44.249091 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.compute.server_external_events [req-dae8d3b9-0176-4c77-b0bf-a3902a11875d req-1c2c0f44-aa97-4222-ba48-edfb53bd8ca9 service nova] Creating event network-vif-plugged:df0b9dfc-ed37-4e2d-9b57-045311702db1 for instance cb36afe7-6664-4cd8-9de4-43f4458a436f on hv-cinder-81561 Nov 01 02:02:44.253860 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [req-dae8d3b9-0176-4c77-b0bf-a3902a11875d req-1c2c0f44-aa97-4222-ba48-edfb53bd8ca9 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028744 Nov 01 02:02:44.254397 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1724/3351] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Nov 1 02:02:44 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 02:02:44.358125 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-b9f82b9e-6ae4-44d5-9299-30b93ee3637e tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 02:02:44.365859 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-b9f82b9e-6ae4-44d5-9299-30b93ee3637e tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] [instance: cb36afe7-6664-4cd8-9de4-43f4458a436f] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 02:02:44.372942 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b9f82b9e-6ae4-44d5-9299-30b93ee3637e tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:02:44.373381 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b9f82b9e-6ae4-44d5-9299-30b93ee3637e tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:02:44.374153 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b9f82b9e-6ae4-44d5-9299-30b93ee3637e tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:02:44.374610 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b9f82b9e-6ae4-44d5-9299-30b93ee3637e tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:02:44.494721 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-b9f82b9e-6ae4-44d5-9299-30b93ee3637e tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3a4d85a244d42adf006700e2e312a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc399e683fbf435a8917245373404232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 02:02:44.502535 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-b9f82b9e-6ae4-44d5-9299-30b93ee3637e tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] 10.222.0.47 "GET /compute/v2.1/servers/cb36afe7-6664-4cd8-9de4-43f4458a436f" status: 200 len: 1317 microversion: 2.1 time: 0.148113 Nov 01 02:02:44.503095 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1628/3352] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 02:02:44 2021] GET /compute/v2.1/servers/cb36afe7-6664-4cd8-9de4-43f4458a436f => generated 1317 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 02:02:45.519603 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-b6336a28-48ec-4bb4-9ef8-7505e0b80f44 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 02:02:45.520332 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-b6336a28-48ec-4bb4-9ef8-7505e0b80f44 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] [instance: cb36afe7-6664-4cd8-9de4-43f4458a436f] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 02:02:45.526573 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b6336a28-48ec-4bb4-9ef8-7505e0b80f44 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:02:45.527023 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b6336a28-48ec-4bb4-9ef8-7505e0b80f44 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:02:45.527783 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b6336a28-48ec-4bb4-9ef8-7505e0b80f44 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:02:45.528727 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b6336a28-48ec-4bb4-9ef8-7505e0b80f44 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:02:45.651275 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-b6336a28-48ec-4bb4-9ef8-7505e0b80f44 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3a4d85a244d42adf006700e2e312a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc399e683fbf435a8917245373404232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 02:02:45.659142 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-b6336a28-48ec-4bb4-9ef8-7505e0b80f44 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] 10.222.0.47 "GET /compute/v2.1/servers/cb36afe7-6664-4cd8-9de4-43f4458a436f" status: 200 len: 1317 microversion: 2.1 time: 0.144171 Nov 01 02:02:45.659698 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1725/3353] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 02:02:45 2021] GET /compute/v2.1/servers/cb36afe7-6664-4cd8-9de4-43f4458a436f => generated 1317 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 02:02:46.675485 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-93583a36-1580-4c49-aae3-21a7c084690d tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 02:02:46.676119 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-93583a36-1580-4c49-aae3-21a7c084690d tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] [instance: cb36afe7-6664-4cd8-9de4-43f4458a436f] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 02:02:46.682318 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-93583a36-1580-4c49-aae3-21a7c084690d tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:02:46.682792 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-93583a36-1580-4c49-aae3-21a7c084690d tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:02:46.683544 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-93583a36-1580-4c49-aae3-21a7c084690d tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:02:46.683973 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-93583a36-1580-4c49-aae3-21a7c084690d tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:02:46.802410 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-93583a36-1580-4c49-aae3-21a7c084690d tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3a4d85a244d42adf006700e2e312a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc399e683fbf435a8917245373404232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 02:02:46.810126 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-93583a36-1580-4c49-aae3-21a7c084690d tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] 10.222.0.47 "GET /compute/v2.1/servers/cb36afe7-6664-4cd8-9de4-43f4458a436f" status: 200 len: 1507 microversion: 2.1 time: 0.137825 Nov 01 02:02:46.810712 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1629/3354] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 02:02:46 2021] GET /compute/v2.1/servers/cb36afe7-6664-4cd8-9de4-43f4458a436f => generated 1507 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 02:02:49.485946 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-ebee43bb-3633-4c8a-94b8-a935414efccc tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3e9d5ec2-7ef1-4be3-8517-48995852a787"}} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 02:02:49.487035 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-ebee43bb-3633-4c8a-94b8-a935414efccc tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] [instance: cb36afe7-6664-4cd8-9de4-43f4458a436f] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 02:02:49.493261 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ebee43bb-3633-4c8a-94b8-a935414efccc tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:02:49.493708 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ebee43bb-3633-4c8a-94b8-a935414efccc tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:02:49.494501 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ebee43bb-3633-4c8a-94b8-a935414efccc tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:02:49.494937 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-ebee43bb-3633-4c8a-94b8-a935414efccc tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:02:50.275488 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-ebee43bb-3633-4c8a-94b8-a935414efccc tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] 10.222.0.47 "POST /compute/v2.1/servers/cb36afe7-6664-4cd8-9de4-43f4458a436f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.792721 Nov 01 02:02:50.276180 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1726/3355] 10.222.0.47 () {60 vars in 1322 bytes} [Mon Nov 1 02:02:49 2021] POST /compute/v2.1/servers/cb36afe7-6664-4cd8-9de4-43f4458a436f/os-volume_attachments => generated 194 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 02:02:58.781297 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-e9dba9b4-8ca5-4473-b110-97d28915536b tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3e9d5ec2-7ef1-4be3-8517-48995852a787"}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 02:02:58.782567 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-e9dba9b4-8ca5-4473-b110-97d28915536b tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] [instance: cb36afe7-6664-4cd8-9de4-43f4458a436f] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 02:02:58.788266 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e9dba9b4-8ca5-4473-b110-97d28915536b tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:02:58.788705 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e9dba9b4-8ca5-4473-b110-97d28915536b tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:02:58.789463 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e9dba9b4-8ca5-4473-b110-97d28915536b tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:02:58.789884 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-e9dba9b4-8ca5-4473-b110-97d28915536b tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:02:58.865586 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.wsgi [None req-e9dba9b4-8ca5-4473-b110-97d28915536b tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] HTTP exception thrown: Invalid volume: volume 3e9d5ec2-7ef1-4be3-8517-48995852a787 is already attached to instances: cb36afe7-6664-4cd8-9de4-43f4458a436f Nov 01 02:02:58.866179 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-e9dba9b4-8ca5-4473-b110-97d28915536b tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Returning 400 to user: Invalid volume: volume 3e9d5ec2-7ef1-4be3-8517-48995852a787 is already attached to instances: cb36afe7-6664-4cd8-9de4-43f4458a436f {{(pid=116266) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 01 02:02:58.867021 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-e9dba9b4-8ca5-4473-b110-97d28915536b tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] 10.222.0.47 "POST /compute/v2.1/servers/cb36afe7-6664-4cd8-9de4-43f4458a436f/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.089537 Nov 01 02:02:58.867556 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1630/3356] 10.222.0.47 () {60 vars in 1322 bytes} [Mon Nov 1 02:02:58 2021] POST /compute/v2.1/servers/cb36afe7-6664-4cd8-9de4-43f4458a436f/os-volume_attachments => generated 174 bytes in 91 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 01 02:02:58.929833 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-661280ba-6baf-4437-bef5-e0d8e531f0fa tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 02:02:58.930549 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-661280ba-6baf-4437-bef5-e0d8e531f0fa tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] [instance: cb36afe7-6664-4cd8-9de4-43f4458a436f] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 02:02:58.937580 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-661280ba-6baf-4437-bef5-e0d8e531f0fa tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:02:58.937958 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-661280ba-6baf-4437-bef5-e0d8e531f0fa tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:02:58.938747 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-661280ba-6baf-4437-bef5-e0d8e531f0fa tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:02:58.939171 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-661280ba-6baf-4437-bef5-e0d8e531f0fa tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:02:59.016715 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.objects.instance [None req-661280ba-6baf-4437-bef5-e0d8e531f0fa tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lazy-loading 'services' on Instance uuid cb36afe7-6664-4cd8-9de4-43f4458a436f {{(pid=116267) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 01 02:02:59.259189 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-661280ba-6baf-4437-bef5-e0d8e531f0fa tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] 10.222.0.47 "DELETE /compute/v2.1/servers/cb36afe7-6664-4cd8-9de4-43f4458a436f/os-volume_attachments/3e9d5ec2-7ef1-4be3-8517-48995852a787" status: 202 len: 0 microversion: 2.1 time: 0.333264 Nov 01 02:02:59.259796 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1727/3357] 10.222.0.47 () {58 vars in 1415 bytes} [Mon Nov 1 02:02:58 2021] DELETE /compute/v2.1/servers/cb36afe7-6664-4cd8-9de4-43f4458a436f/os-volume_attachments/3e9d5ec2-7ef1-4be3-8517-48995852a787 => generated 0 bytes in 335 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 01 02:02:59.267858 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-0b97297f-c4de-4282-84e6-d7ea99bc1ab2 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 02:02:59.268845 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-0b97297f-c4de-4282-84e6-d7ea99bc1ab2 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] [instance: cb36afe7-6664-4cd8-9de4-43f4458a436f] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 02:02:59.275109 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0b97297f-c4de-4282-84e6-d7ea99bc1ab2 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:02:59.279766 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0b97297f-c4de-4282-84e6-d7ea99bc1ab2 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:02:59.279766 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0b97297f-c4de-4282-84e6-d7ea99bc1ab2 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:02:59.279766 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-0b97297f-c4de-4282-84e6-d7ea99bc1ab2 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:02:59.307052 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-0b97297f-c4de-4282-84e6-d7ea99bc1ab2 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] 10.222.0.47 "GET /compute/v2.1/servers/cb36afe7-6664-4cd8-9de4-43f4458a436f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042991 Nov 01 02:02:59.307854 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1631/3358] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 02:02:59 2021] GET /compute/v2.1/servers/cb36afe7-6664-4cd8-9de4-43f4458a436f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 01 02:03:00.319744 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-66e34f10-6795-4c2e-8368-45919d893769 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 02:03:00.320803 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-66e34f10-6795-4c2e-8368-45919d893769 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] [instance: cb36afe7-6664-4cd8-9de4-43f4458a436f] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 02:03:00.326717 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-66e34f10-6795-4c2e-8368-45919d893769 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:03:00.327155 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-66e34f10-6795-4c2e-8368-45919d893769 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:03:00.327921 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-66e34f10-6795-4c2e-8368-45919d893769 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:03:00.328342 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-66e34f10-6795-4c2e-8368-45919d893769 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:03:00.357060 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-66e34f10-6795-4c2e-8368-45919d893769 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] 10.222.0.47 "GET /compute/v2.1/servers/cb36afe7-6664-4cd8-9de4-43f4458a436f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041768 Nov 01 02:03:00.357736 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1728/3359] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 02:03:00 2021] GET /compute/v2.1/servers/cb36afe7-6664-4cd8-9de4-43f4458a436f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 02:03:01.369002 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-63aafd7a-71ab-4a83-a715-f4a9809239c2 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 02:03:01.369901 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-63aafd7a-71ab-4a83-a715-f4a9809239c2 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] [instance: cb36afe7-6664-4cd8-9de4-43f4458a436f] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 02:03:01.376067 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-63aafd7a-71ab-4a83-a715-f4a9809239c2 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:03:01.376506 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-63aafd7a-71ab-4a83-a715-f4a9809239c2 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:03:01.377250 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-63aafd7a-71ab-4a83-a715-f4a9809239c2 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:03:01.377673 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-63aafd7a-71ab-4a83-a715-f4a9809239c2 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:03:01.404406 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-63aafd7a-71ab-4a83-a715-f4a9809239c2 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] 10.222.0.47 "GET /compute/v2.1/servers/cb36afe7-6664-4cd8-9de4-43f4458a436f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.039250 Nov 01 02:03:01.404944 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1632/3360] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 02:03:01 2021] GET /compute/v2.1/servers/cb36afe7-6664-4cd8-9de4-43f4458a436f/os-volume_attachments => generated 25 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 01 02:03:01.498894 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-b4692216-1ac4-4cad-8c44-2b228c1508cc tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-413817248", "imageRef": "b9068d8d-b02d-4043-9f0c-3d774cb372b3", "flavorRef": "452", "networks": [{"uuid": "8d4ac867-bf0b-462f-8ac6-2516bf6ce1bc"}]}} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 02:03:01.549335 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.network.neutron [None req-b4692216-1ac4-4cad-8c44-2b228c1508cc tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] validate_networks() for [('8d4ac867-bf0b-462f-8ac6-2516bf6ce1bc', None, None, None, None, None)] {{(pid=116267) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Nov 01 02:03:01.915151 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.virt.hardware [None req-b4692216-1ac4-4cad-8c44-2b228c1508cc tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Flavor limits 0:0:0 {{(pid=116267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 01 02:03:01.915600 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.virt.hardware [None req-b4692216-1ac4-4cad-8c44-2b228c1508cc tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Image limits 0:0:0 {{(pid=116267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 01 02:03:01.916182 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.virt.hardware [None req-b4692216-1ac4-4cad-8c44-2b228c1508cc tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Flavor pref 0:0:0 {{(pid=116267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 01 02:03:01.916593 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.virt.hardware [None req-b4692216-1ac4-4cad-8c44-2b228c1508cc tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Image pref 0:0:0 {{(pid=116267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 01 02:03:01.917005 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.virt.hardware [None req-b4692216-1ac4-4cad-8c44-2b228c1508cc tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 01 02:03:01.925826 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b4692216-1ac4-4cad-8c44-2b228c1508cc tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:03:01.926268 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b4692216-1ac4-4cad-8c44-2b228c1508cc tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:03:01.927096 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b4692216-1ac4-4cad-8c44-2b228c1508cc tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:03:01.927527 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-b4692216-1ac4-4cad-8c44-2b228c1508cc tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:03:01.944035 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.quota [None req-b4692216-1ac4-4cad-8c44-2b228c1508cc tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Getting quotas for project bc399e683fbf435a8917245373404232. Resources: {'instances', 'cores', 'ram'} {{(pid=116267) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 01 02:03:01.947833 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.quota [None req-b4692216-1ac4-4cad-8c44-2b228c1508cc tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Getting quotas for user 61b3a4d85a244d42adf006700e2e312a and project bc399e683fbf435a8917245373404232. Resources: {'instances', 'cores', 'ram'} {{(pid=116267) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 01 02:03:01.958832 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-b4692216-1ac4-4cad-8c44-2b228c1508cc tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Going to run 1 instances... {{(pid=116267) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 01 02:03:01.961070 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-b4692216-1ac4-4cad-8c44-2b228c1508cc tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] [instance: c0fdfd73-4324-481f-afe4-7c31f91ec7d4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b9068d8d-b02d-4043-9f0c-3d774cb372b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116267) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 01 02:03:02.066328 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-b4692216-1ac4-4cad-8c44-2b228c1508cc tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.571031 Nov 01 02:03:02.067006 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1729/3361] 10.222.0.47 () {60 vars in 1146 bytes} [Mon Nov 1 02:03:01 2021] POST /compute/v2.1/servers => generated 380 bytes in 572 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 01 02:03:02.076706 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-9a549eec-89b2-461c-aa4e-1f6403cd1ce2 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 02:03:02.077518 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-9a549eec-89b2-461c-aa4e-1f6403cd1ce2 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] [instance: c0fdfd73-4324-481f-afe4-7c31f91ec7d4] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 02:03:02.131830 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-9a549eec-89b2-461c-aa4e-1f6403cd1ce2 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3a4d85a244d42adf006700e2e312a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc399e683fbf435a8917245373404232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 02:03:02.138324 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-9a549eec-89b2-461c-aa4e-1f6403cd1ce2 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] 10.222.0.47 "GET /compute/v2.1/servers/c0fdfd73-4324-481f-afe4-7c31f91ec7d4" status: 200 len: 1217 microversion: 2.1 time: 0.065427 Nov 01 02:03:02.138925 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1633/3362] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 02:03:02 2021] GET /compute/v2.1/servers/c0fdfd73-4324-481f-afe4-7c31f91ec7d4 => generated 1217 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 01 02:03:03.155894 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-50d4736a-ba6c-4a76-bd75-639158380014 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 02:03:03.156489 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-50d4736a-ba6c-4a76-bd75-639158380014 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] [instance: c0fdfd73-4324-481f-afe4-7c31f91ec7d4] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 02:03:03.163178 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-50d4736a-ba6c-4a76-bd75-639158380014 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:03:03.163618 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-50d4736a-ba6c-4a76-bd75-639158380014 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:03:03.164375 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-50d4736a-ba6c-4a76-bd75-639158380014 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:03:03.164800 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-50d4736a-ba6c-4a76-bd75-639158380014 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:03:03.229840 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-50d4736a-ba6c-4a76-bd75-639158380014 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3a4d85a244d42adf006700e2e312a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc399e683fbf435a8917245373404232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 02:03:03.237289 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-50d4736a-ba6c-4a76-bd75-639158380014 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] 10.222.0.47 "GET /compute/v2.1/servers/c0fdfd73-4324-481f-afe4-7c31f91ec7d4" status: 200 len: 1213 microversion: 2.1 time: 0.085468 Nov 01 02:03:03.237980 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1730/3363] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 02:03:03 2021] GET /compute/v2.1/servers/c0fdfd73-4324-481f-afe4-7c31f91ec7d4 => generated 1213 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 02:03:04.256045 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-5a726597-85e1-4f80-b91d-7d37baee1578 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 02:03:04.256817 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-5a726597-85e1-4f80-b91d-7d37baee1578 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] [instance: c0fdfd73-4324-481f-afe4-7c31f91ec7d4] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 02:03:04.263476 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5a726597-85e1-4f80-b91d-7d37baee1578 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:03:04.263845 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5a726597-85e1-4f80-b91d-7d37baee1578 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:03:04.264633 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5a726597-85e1-4f80-b91d-7d37baee1578 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:03:04.265062 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5a726597-85e1-4f80-b91d-7d37baee1578 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:03:04.329986 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-5a726597-85e1-4f80-b91d-7d37baee1578 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3a4d85a244d42adf006700e2e312a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc399e683fbf435a8917245373404232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 02:03:04.337984 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-5a726597-85e1-4f80-b91d-7d37baee1578 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] 10.222.0.47 "GET /compute/v2.1/servers/c0fdfd73-4324-481f-afe4-7c31f91ec7d4" status: 200 len: 1275 microversion: 2.1 time: 0.085585 Nov 01 02:03:04.338568 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1634/3364] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 02:03:04 2021] GET /compute/v2.1/servers/c0fdfd73-4324-481f-afe4-7c31f91ec7d4 => generated 1275 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 02:03:05.355124 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-36fef5a7-4b13-4edc-ac95-defa3f93192d tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 02:03:05.355755 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-36fef5a7-4b13-4edc-ac95-defa3f93192d tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] [instance: c0fdfd73-4324-481f-afe4-7c31f91ec7d4] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 02:03:05.362246 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-36fef5a7-4b13-4edc-ac95-defa3f93192d tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:03:05.362717 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-36fef5a7-4b13-4edc-ac95-defa3f93192d tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:03:05.363495 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-36fef5a7-4b13-4edc-ac95-defa3f93192d tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:03:05.363919 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-36fef5a7-4b13-4edc-ac95-defa3f93192d tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:03:05.484228 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-36fef5a7-4b13-4edc-ac95-defa3f93192d tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3a4d85a244d42adf006700e2e312a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc399e683fbf435a8917245373404232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 02:03:05.491565 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-36fef5a7-4b13-4edc-ac95-defa3f93192d tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] 10.222.0.47 "GET /compute/v2.1/servers/c0fdfd73-4324-481f-afe4-7c31f91ec7d4" status: 200 len: 1317 microversion: 2.1 time: 0.140185 Nov 01 02:03:05.492134 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1731/3365] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 02:03:05 2021] GET /compute/v2.1/servers/c0fdfd73-4324-481f-afe4-7c31f91ec7d4 => generated 1317 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 02:03:05.627696 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [req-601f022a-72ef-46e3-ba96-2b9bfcec6f30 req-dc1f26ff-b11c-4894-af38-148c0077642a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0fdfd73-4324-481f-afe4-7c31f91ec7d4", "tag": "aa5d3f7d-0518-4434-a6f1-9f1717e6fe4b"}]} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 02:03:05.629234 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 01 02:03:05.629234 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: warnings.warn(msg) Nov 01 02:03:05.636038 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [req-601f022a-72ef-46e3-ba96-2b9bfcec6f30 req-dc1f26ff-b11c-4894-af38-148c0077642a service nova] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:03:05.636469 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [req-601f022a-72ef-46e3-ba96-2b9bfcec6f30 req-dc1f26ff-b11c-4894-af38-148c0077642a service nova] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:03:05.648707 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.compute.server_external_events [req-601f022a-72ef-46e3-ba96-2b9bfcec6f30 req-dc1f26ff-b11c-4894-af38-148c0077642a service nova] Creating event network-changed:aa5d3f7d-0518-4434-a6f1-9f1717e6fe4b for instance c0fdfd73-4324-481f-afe4-7c31f91ec7d4 on hv-cinder-81561 Nov 01 02:03:05.653620 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [req-601f022a-72ef-46e3-ba96-2b9bfcec6f30 req-dc1f26ff-b11c-4894-af38-148c0077642a service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090150 Nov 01 02:03:05.653965 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1635/3366] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Nov 1 02:03:05 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 01 02:03:06.508172 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-0f7b331a-1d34-43e4-a6f8-964e935e0387 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 02:03:06.508786 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-0f7b331a-1d34-43e4-a6f8-964e935e0387 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] [instance: c0fdfd73-4324-481f-afe4-7c31f91ec7d4] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 02:03:06.515055 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0f7b331a-1d34-43e4-a6f8-964e935e0387 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:03:06.515504 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0f7b331a-1d34-43e4-a6f8-964e935e0387 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:03:06.516271 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0f7b331a-1d34-43e4-a6f8-964e935e0387 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:03:06.516702 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-0f7b331a-1d34-43e4-a6f8-964e935e0387 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:03:06.634010 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-0f7b331a-1d34-43e4-a6f8-964e935e0387 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3a4d85a244d42adf006700e2e312a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc399e683fbf435a8917245373404232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 02:03:06.641155 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-0f7b331a-1d34-43e4-a6f8-964e935e0387 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] 10.222.0.47 "GET /compute/v2.1/servers/c0fdfd73-4324-481f-afe4-7c31f91ec7d4" status: 200 len: 1317 microversion: 2.1 time: 0.136641 Nov 01 02:03:06.642228 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1732/3367] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 02:03:06 2021] GET /compute/v2.1/servers/c0fdfd73-4324-481f-afe4-7c31f91ec7d4 => generated 1317 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 02:03:07.659646 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-927a4686-aca4-4d01-a820-3c93de86432e tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 02:03:07.660247 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-927a4686-aca4-4d01-a820-3c93de86432e tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] [instance: c0fdfd73-4324-481f-afe4-7c31f91ec7d4] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 02:03:07.666257 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-927a4686-aca4-4d01-a820-3c93de86432e tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:03:07.666720 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-927a4686-aca4-4d01-a820-3c93de86432e tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:03:07.667732 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-927a4686-aca4-4d01-a820-3c93de86432e tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:03:07.668156 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-927a4686-aca4-4d01-a820-3c93de86432e tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:03:07.789117 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-927a4686-aca4-4d01-a820-3c93de86432e tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3a4d85a244d42adf006700e2e312a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc399e683fbf435a8917245373404232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 02:03:07.796529 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-927a4686-aca4-4d01-a820-3c93de86432e tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] 10.222.0.47 "GET /compute/v2.1/servers/c0fdfd73-4324-481f-afe4-7c31f91ec7d4" status: 200 len: 1317 microversion: 2.1 time: 0.141678 Nov 01 02:03:07.797083 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1636/3368] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 02:03:07 2021] GET /compute/v2.1/servers/c0fdfd73-4324-481f-afe4-7c31f91ec7d4 => generated 1317 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 02:03:08.813196 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-36fddbfd-0281-46d7-ab82-57a8eb0af2e9 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 02:03:08.813806 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-36fddbfd-0281-46d7-ab82-57a8eb0af2e9 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] [instance: c0fdfd73-4324-481f-afe4-7c31f91ec7d4] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 02:03:08.820654 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-36fddbfd-0281-46d7-ab82-57a8eb0af2e9 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:03:08.821099 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-36fddbfd-0281-46d7-ab82-57a8eb0af2e9 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:03:08.821852 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-36fddbfd-0281-46d7-ab82-57a8eb0af2e9 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:03:08.822296 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-36fddbfd-0281-46d7-ab82-57a8eb0af2e9 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:03:08.938577 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-36fddbfd-0281-46d7-ab82-57a8eb0af2e9 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3a4d85a244d42adf006700e2e312a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc399e683fbf435a8917245373404232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 02:03:08.946211 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-36fddbfd-0281-46d7-ab82-57a8eb0af2e9 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] 10.222.0.47 "GET /compute/v2.1/servers/c0fdfd73-4324-481f-afe4-7c31f91ec7d4" status: 200 len: 1317 microversion: 2.1 time: 0.136567 Nov 01 02:03:08.946728 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1733/3369] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 02:03:08 2021] GET /compute/v2.1/servers/c0fdfd73-4324-481f-afe4-7c31f91ec7d4 => generated 1317 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 02:03:09.962583 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-aa4f3fa6-ad0f-4116-9f41-3f0fc03b4306 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 02:03:09.963174 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-aa4f3fa6-ad0f-4116-9f41-3f0fc03b4306 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] [instance: c0fdfd73-4324-481f-afe4-7c31f91ec7d4] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 02:03:09.969371 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-aa4f3fa6-ad0f-4116-9f41-3f0fc03b4306 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:03:09.969822 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-aa4f3fa6-ad0f-4116-9f41-3f0fc03b4306 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:03:09.971203 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-aa4f3fa6-ad0f-4116-9f41-3f0fc03b4306 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:03:09.971638 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-aa4f3fa6-ad0f-4116-9f41-3f0fc03b4306 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:03:10.087748 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-aa4f3fa6-ad0f-4116-9f41-3f0fc03b4306 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3a4d85a244d42adf006700e2e312a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc399e683fbf435a8917245373404232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 02:03:10.094888 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-aa4f3fa6-ad0f-4116-9f41-3f0fc03b4306 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] 10.222.0.47 "GET /compute/v2.1/servers/c0fdfd73-4324-481f-afe4-7c31f91ec7d4" status: 200 len: 1317 microversion: 2.1 time: 0.135910 Nov 01 02:03:10.095446 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1637/3370] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 02:03:09 2021] GET /compute/v2.1/servers/c0fdfd73-4324-481f-afe4-7c31f91ec7d4 => generated 1317 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 02:03:11.111423 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-37e923bd-10b5-472c-ba81-fae58dd0d4e4 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 02:03:11.112045 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-37e923bd-10b5-472c-ba81-fae58dd0d4e4 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] [instance: c0fdfd73-4324-481f-afe4-7c31f91ec7d4] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 02:03:11.119002 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-37e923bd-10b5-472c-ba81-fae58dd0d4e4 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:03:11.119365 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-37e923bd-10b5-472c-ba81-fae58dd0d4e4 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:03:11.120117 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-37e923bd-10b5-472c-ba81-fae58dd0d4e4 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:03:11.120543 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-37e923bd-10b5-472c-ba81-fae58dd0d4e4 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:03:11.243259 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-37e923bd-10b5-472c-ba81-fae58dd0d4e4 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3a4d85a244d42adf006700e2e312a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc399e683fbf435a8917245373404232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 02:03:11.251098 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-37e923bd-10b5-472c-ba81-fae58dd0d4e4 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] 10.222.0.47 "GET /compute/v2.1/servers/c0fdfd73-4324-481f-afe4-7c31f91ec7d4" status: 200 len: 1317 microversion: 2.1 time: 0.143199 Nov 01 02:03:11.251715 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1734/3371] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 02:03:11 2021] GET /compute/v2.1/servers/c0fdfd73-4324-481f-afe4-7c31f91ec7d4 => generated 1317 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 02:03:12.268233 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-a7571c60-b10f-47e2-9529-1d69e86b43dd tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 02:03:12.269474 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-a7571c60-b10f-47e2-9529-1d69e86b43dd tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] [instance: c0fdfd73-4324-481f-afe4-7c31f91ec7d4] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 02:03:12.275800 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a7571c60-b10f-47e2-9529-1d69e86b43dd tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:03:12.276240 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a7571c60-b10f-47e2-9529-1d69e86b43dd tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:03:12.276986 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a7571c60-b10f-47e2-9529-1d69e86b43dd tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:03:12.277411 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-a7571c60-b10f-47e2-9529-1d69e86b43dd tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:03:12.396407 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-a7571c60-b10f-47e2-9529-1d69e86b43dd tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3a4d85a244d42adf006700e2e312a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc399e683fbf435a8917245373404232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 02:03:12.404277 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-a7571c60-b10f-47e2-9529-1d69e86b43dd tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] 10.222.0.47 "GET /compute/v2.1/servers/c0fdfd73-4324-481f-afe4-7c31f91ec7d4" status: 200 len: 1317 microversion: 2.1 time: 0.139774 Nov 01 02:03:12.405023 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1638/3372] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 02:03:12 2021] GET /compute/v2.1/servers/c0fdfd73-4324-481f-afe4-7c31f91ec7d4 => generated 1317 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 02:03:12.408545 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [req-bb5c121f-4edc-4fcd-8796-47981908467d req-fae21435-2e77-46e9-b71c-cf5aa860cae9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0fdfd73-4324-481f-afe4-7c31f91ec7d4", "name": "network-vif-plugged", "status": "completed", "tag": "aa5d3f7d-0518-4434-a6f1-9f1717e6fe4b"}]} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 02:03:12.411503 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 01 02:03:12.411503 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: warnings.warn(msg) Nov 01 02:03:12.418761 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [req-bb5c121f-4edc-4fcd-8796-47981908467d req-fae21435-2e77-46e9-b71c-cf5aa860cae9 service nova] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:03:12.419225 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [req-bb5c121f-4edc-4fcd-8796-47981908467d req-fae21435-2e77-46e9-b71c-cf5aa860cae9 service nova] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:03:12.429784 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.compute.server_external_events [req-bb5c121f-4edc-4fcd-8796-47981908467d req-fae21435-2e77-46e9-b71c-cf5aa860cae9 service nova] Creating event network-vif-plugged:aa5d3f7d-0518-4434-a6f1-9f1717e6fe4b for instance c0fdfd73-4324-481f-afe4-7c31f91ec7d4 on hv-cinder-81561 Nov 01 02:03:12.435353 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [req-bb5c121f-4edc-4fcd-8796-47981908467d req-fae21435-2e77-46e9-b71c-cf5aa860cae9 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030186 Nov 01 02:03:12.435916 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1735/3373] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Nov 1 02:03:12 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 01 02:03:13.421064 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-92d84a31-4751-479a-90bd-81e47d8b19b2 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 02:03:13.421688 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-92d84a31-4751-479a-90bd-81e47d8b19b2 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] [instance: c0fdfd73-4324-481f-afe4-7c31f91ec7d4] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 02:03:13.428483 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-92d84a31-4751-479a-90bd-81e47d8b19b2 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:03:13.428977 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-92d84a31-4751-479a-90bd-81e47d8b19b2 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:03:13.429707 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-92d84a31-4751-479a-90bd-81e47d8b19b2 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:03:13.430130 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-92d84a31-4751-479a-90bd-81e47d8b19b2 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:03:13.545779 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-92d84a31-4751-479a-90bd-81e47d8b19b2 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3a4d85a244d42adf006700e2e312a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc399e683fbf435a8917245373404232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 02:03:13.553377 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-92d84a31-4751-479a-90bd-81e47d8b19b2 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] 10.222.0.47 "GET /compute/v2.1/servers/c0fdfd73-4324-481f-afe4-7c31f91ec7d4" status: 200 len: 1317 microversion: 2.1 time: 0.136214 Nov 01 02:03:13.553924 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1639/3374] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 02:03:13 2021] GET /compute/v2.1/servers/c0fdfd73-4324-481f-afe4-7c31f91ec7d4 => generated 1317 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 02:03:14.572096 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-58b8e1e2-4705-44fc-8499-676b0e96d0f7 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 02:03:14.572788 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-58b8e1e2-4705-44fc-8499-676b0e96d0f7 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] [instance: c0fdfd73-4324-481f-afe4-7c31f91ec7d4] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 02:03:14.579761 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-58b8e1e2-4705-44fc-8499-676b0e96d0f7 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:03:14.580201 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-58b8e1e2-4705-44fc-8499-676b0e96d0f7 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:03:14.581553 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-58b8e1e2-4705-44fc-8499-676b0e96d0f7 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:03:14.582054 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-58b8e1e2-4705-44fc-8499-676b0e96d0f7 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:03:14.705152 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-58b8e1e2-4705-44fc-8499-676b0e96d0f7 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3a4d85a244d42adf006700e2e312a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc399e683fbf435a8917245373404232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 02:03:14.712553 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-58b8e1e2-4705-44fc-8499-676b0e96d0f7 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] 10.222.0.47 "GET /compute/v2.1/servers/c0fdfd73-4324-481f-afe4-7c31f91ec7d4" status: 200 len: 1508 microversion: 2.1 time: 0.145589 Nov 01 02:03:14.713118 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1736/3375] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 02:03:14 2021] GET /compute/v2.1/servers/c0fdfd73-4324-481f-afe4-7c31f91ec7d4 => generated 1508 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 02:03:16.258743 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-5f20414a-b5a7-4945-9b07-8edc024fa03d tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "19114ddd-2423-4f04-868c-6344cf3a5adf"}} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 02:03:16.260129 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-5f20414a-b5a7-4945-9b07-8edc024fa03d tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] [instance: c0fdfd73-4324-481f-afe4-7c31f91ec7d4] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 02:03:16.266778 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5f20414a-b5a7-4945-9b07-8edc024fa03d tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:03:16.267227 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5f20414a-b5a7-4945-9b07-8edc024fa03d tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:03:16.267991 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5f20414a-b5a7-4945-9b07-8edc024fa03d tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:03:16.269048 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-5f20414a-b5a7-4945-9b07-8edc024fa03d tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:03:16.966336 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-5f20414a-b5a7-4945-9b07-8edc024fa03d tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] 10.222.0.47 "POST /compute/v2.1/servers/c0fdfd73-4324-481f-afe4-7c31f91ec7d4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.710977 Nov 01 02:03:16.966976 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1640/3376] 10.222.0.47 () {60 vars in 1322 bytes} [Mon Nov 1 02:03:16 2021] POST /compute/v2.1/servers/c0fdfd73-4324-481f-afe4-7c31f91ec7d4/os-volume_attachments => generated 194 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 02:03:25.560041 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-a04270f7-767b-4ba2-9771-e97a6da3581e tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 02:03:25.560539 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-a04270f7-767b-4ba2-9771-e97a6da3581e tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] [instance: c0fdfd73-4324-481f-afe4-7c31f91ec7d4] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 02:03:25.566681 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a04270f7-767b-4ba2-9771-e97a6da3581e tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:03:25.569064 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a04270f7-767b-4ba2-9771-e97a6da3581e tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:03:25.569868 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a04270f7-767b-4ba2-9771-e97a6da3581e tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:03:25.570308 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-a04270f7-767b-4ba2-9771-e97a6da3581e tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:03:25.647358 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.objects.instance [None req-a04270f7-767b-4ba2-9771-e97a6da3581e tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lazy-loading 'services' on Instance uuid c0fdfd73-4324-481f-afe4-7c31f91ec7d4 {{(pid=116267) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 01 02:03:25.849907 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-a04270f7-767b-4ba2-9771-e97a6da3581e tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] 10.222.0.47 "DELETE /compute/v2.1/servers/c0fdfd73-4324-481f-afe4-7c31f91ec7d4/os-volume_attachments/19114ddd-2423-4f04-868c-6344cf3a5adf" status: 202 len: 0 microversion: 2.1 time: 0.293502 Nov 01 02:03:25.850510 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1737/3377] 10.222.0.47 () {58 vars in 1415 bytes} [Mon Nov 1 02:03:25 2021] DELETE /compute/v2.1/servers/c0fdfd73-4324-481f-afe4-7c31f91ec7d4/os-volume_attachments/19114ddd-2423-4f04-868c-6344cf3a5adf => generated 0 bytes in 295 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 01 02:03:25.859849 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-837de80c-86b1-462b-904f-1eff9dc36429 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 02:03:25.860902 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-837de80c-86b1-462b-904f-1eff9dc36429 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] [instance: c0fdfd73-4324-481f-afe4-7c31f91ec7d4] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 02:03:25.867136 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-837de80c-86b1-462b-904f-1eff9dc36429 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:03:25.867575 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-837de80c-86b1-462b-904f-1eff9dc36429 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:03:25.868325 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-837de80c-86b1-462b-904f-1eff9dc36429 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:03:25.868755 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-837de80c-86b1-462b-904f-1eff9dc36429 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:03:25.898196 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-837de80c-86b1-462b-904f-1eff9dc36429 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] 10.222.0.47 "GET /compute/v2.1/servers/c0fdfd73-4324-481f-afe4-7c31f91ec7d4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043217 Nov 01 02:03:25.898767 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1641/3378] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 02:03:25 2021] GET /compute/v2.1/servers/c0fdfd73-4324-481f-afe4-7c31f91ec7d4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 02:03:26.910143 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-189bdc02-fcb6-487b-9a5d-f7246d3dfe3e tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 02:03:26.911218 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-189bdc02-fcb6-487b-9a5d-f7246d3dfe3e tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] [instance: c0fdfd73-4324-481f-afe4-7c31f91ec7d4] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 02:03:26.917874 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-189bdc02-fcb6-487b-9a5d-f7246d3dfe3e tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:03:26.918314 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-189bdc02-fcb6-487b-9a5d-f7246d3dfe3e tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:03:26.919102 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-189bdc02-fcb6-487b-9a5d-f7246d3dfe3e tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:03:26.919531 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-189bdc02-fcb6-487b-9a5d-f7246d3dfe3e tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:03:26.954168 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-189bdc02-fcb6-487b-9a5d-f7246d3dfe3e tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] 10.222.0.47 "GET /compute/v2.1/servers/c0fdfd73-4324-481f-afe4-7c31f91ec7d4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045326 Nov 01 02:03:26.954168 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1738/3379] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 02:03:26 2021] GET /compute/v2.1/servers/c0fdfd73-4324-481f-afe4-7c31f91ec7d4/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 02:03:27.964784 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-30ebb503-aa32-4faf-8af9-3c8a410cc0b5 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 02:03:27.965678 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-30ebb503-aa32-4faf-8af9-3c8a410cc0b5 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] [instance: c0fdfd73-4324-481f-afe4-7c31f91ec7d4] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 02:03:27.972401 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-30ebb503-aa32-4faf-8af9-3c8a410cc0b5 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:03:27.972838 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-30ebb503-aa32-4faf-8af9-3c8a410cc0b5 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:03:27.973587 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-30ebb503-aa32-4faf-8af9-3c8a410cc0b5 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:03:27.974011 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-30ebb503-aa32-4faf-8af9-3c8a410cc0b5 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:03:28.003215 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-30ebb503-aa32-4faf-8af9-3c8a410cc0b5 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] 10.222.0.47 "GET /compute/v2.1/servers/c0fdfd73-4324-481f-afe4-7c31f91ec7d4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042242 Nov 01 02:03:28.003749 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1642/3380] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Nov 1 02:03:27 2021] GET /compute/v2.1/servers/c0fdfd73-4324-481f-afe4-7c31f91ec7d4/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 01 02:03:29.353683 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-3d51f709-21e8-4b1f-a0ca-0ec4f6609479 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 02:03:29.354173 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-3d51f709-21e8-4b1f-a0ca-0ec4f6609479 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] [instance: c0fdfd73-4324-481f-afe4-7c31f91ec7d4] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 02:03:29.360343 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3d51f709-21e8-4b1f-a0ca-0ec4f6609479 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:03:29.360782 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3d51f709-21e8-4b1f-a0ca-0ec4f6609479 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:03:29.362133 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3d51f709-21e8-4b1f-a0ca-0ec4f6609479 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:03:29.362599 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-3d51f709-21e8-4b1f-a0ca-0ec4f6609479 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:03:29.388078 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-3d51f709-21e8-4b1f-a0ca-0ec4f6609479 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] [instance: c0fdfd73-4324-481f-afe4-7c31f91ec7d4] Going to try to terminate instance {{(pid=116267) delete /opt/stack/nova/nova/compute/api.py:2612}} Nov 01 02:03:29.692067 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-3d51f709-21e8-4b1f-a0ca-0ec4f6609479 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] 10.222.0.47 "DELETE /compute/v2.1/servers/c0fdfd73-4324-481f-afe4-7c31f91ec7d4" status: 204 len: 0 microversion: 2.1 time: 0.341871 Nov 01 02:03:29.698165 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1739/3381] 10.222.0.47 () {58 vars in 1238 bytes} [Mon Nov 1 02:03:29 2021] DELETE /compute/v2.1/servers/c0fdfd73-4324-481f-afe4-7c31f91ec7d4 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 01 02:03:29.700258 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-99684f1e-f5e8-4389-87e1-89a092934ccb tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 02:03:29.700867 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-99684f1e-f5e8-4389-87e1-89a092934ccb tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] [instance: c0fdfd73-4324-481f-afe4-7c31f91ec7d4] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 02:03:29.708087 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-99684f1e-f5e8-4389-87e1-89a092934ccb tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:03:29.708530 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-99684f1e-f5e8-4389-87e1-89a092934ccb tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:03:29.709292 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-99684f1e-f5e8-4389-87e1-89a092934ccb tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:03:29.709741 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-99684f1e-f5e8-4389-87e1-89a092934ccb tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:03:29.832122 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-99684f1e-f5e8-4389-87e1-89a092934ccb tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3a4d85a244d42adf006700e2e312a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc399e683fbf435a8917245373404232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 02:03:29.839483 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-99684f1e-f5e8-4389-87e1-89a092934ccb tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] 10.222.0.47 "GET /compute/v2.1/servers/c0fdfd73-4324-481f-afe4-7c31f91ec7d4" status: 200 len: 1514 microversion: 2.1 time: 0.142810 Nov 01 02:03:29.840046 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1643/3382] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 02:03:29 2021] GET /compute/v2.1/servers/c0fdfd73-4324-481f-afe4-7c31f91ec7d4 => generated 1514 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 02:03:30.856235 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-f68a6440-b2b3-4d23-96f2-bdd96a26405b tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 02:03:30.856956 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-f68a6440-b2b3-4d23-96f2-bdd96a26405b tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] [instance: c0fdfd73-4324-481f-afe4-7c31f91ec7d4] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 02:03:30.863085 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f68a6440-b2b3-4d23-96f2-bdd96a26405b tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:03:30.863523 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f68a6440-b2b3-4d23-96f2-bdd96a26405b tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:03:30.864271 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f68a6440-b2b3-4d23-96f2-bdd96a26405b tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:03:30.864692 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f68a6440-b2b3-4d23-96f2-bdd96a26405b tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:03:30.981647 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-f68a6440-b2b3-4d23-96f2-bdd96a26405b tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3a4d85a244d42adf006700e2e312a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc399e683fbf435a8917245373404232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 02:03:30.988865 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-f68a6440-b2b3-4d23-96f2-bdd96a26405b tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] 10.222.0.47 "GET /compute/v2.1/servers/c0fdfd73-4324-481f-afe4-7c31f91ec7d4" status: 200 len: 1514 microversion: 2.1 time: 0.136635 Nov 01 02:03:30.989421 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1740/3383] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 02:03:30 2021] GET /compute/v2.1/servers/c0fdfd73-4324-481f-afe4-7c31f91ec7d4 => generated 1514 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 02:03:32.004757 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-4d8fbece-8107-4682-b5c1-fcfdce0c898c tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 02:03:32.005386 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-4d8fbece-8107-4682-b5c1-fcfdce0c898c tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] [instance: c0fdfd73-4324-481f-afe4-7c31f91ec7d4] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 02:03:32.011632 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4d8fbece-8107-4682-b5c1-fcfdce0c898c tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:03:32.012082 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4d8fbece-8107-4682-b5c1-fcfdce0c898c tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:03:32.012842 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4d8fbece-8107-4682-b5c1-fcfdce0c898c tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:03:32.013273 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-4d8fbece-8107-4682-b5c1-fcfdce0c898c tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:03:32.139937 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-4d8fbece-8107-4682-b5c1-fcfdce0c898c tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3a4d85a244d42adf006700e2e312a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc399e683fbf435a8917245373404232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 02:03:32.148770 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-4d8fbece-8107-4682-b5c1-fcfdce0c898c tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] 10.222.0.47 "GET /compute/v2.1/servers/c0fdfd73-4324-481f-afe4-7c31f91ec7d4" status: 200 len: 1514 microversion: 2.1 time: 0.147635 Nov 01 02:03:32.149440 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1644/3384] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 02:03:31 2021] GET /compute/v2.1/servers/c0fdfd73-4324-481f-afe4-7c31f91ec7d4 => generated 1514 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 02:03:32.365692 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [req-2c97ef13-130c-4851-9630-3edbe9eee9ca req-815c3352-4c52-481e-9125-8de52dd4a09e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0fdfd73-4324-481f-afe4-7c31f91ec7d4", "name": "network-vif-deleted", "tag": "aa5d3f7d-0518-4434-a6f1-9f1717e6fe4b"}]} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 02:03:32.368078 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 01 02:03:32.368078 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: warnings.warn(msg) Nov 01 02:03:32.375740 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [req-2c97ef13-130c-4851-9630-3edbe9eee9ca req-815c3352-4c52-481e-9125-8de52dd4a09e service nova] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:03:32.376171 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [req-2c97ef13-130c-4851-9630-3edbe9eee9ca req-815c3352-4c52-481e-9125-8de52dd4a09e service nova] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:03:32.388777 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.compute.server_external_events [req-2c97ef13-130c-4851-9630-3edbe9eee9ca req-815c3352-4c52-481e-9125-8de52dd4a09e service nova] Creating event network-vif-deleted:aa5d3f7d-0518-4434-a6f1-9f1717e6fe4b for instance c0fdfd73-4324-481f-afe4-7c31f91ec7d4 on hv-cinder-81561 Nov 01 02:03:32.394163 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [req-2c97ef13-130c-4851-9630-3edbe9eee9ca req-815c3352-4c52-481e-9125-8de52dd4a09e service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032713 Nov 01 02:03:32.395012 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1741/3385] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Nov 1 02:03:32 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 02:03:33.165361 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-61f214e5-c24e-4bb9-8ebf-4b5e50436577 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 02:03:33.165872 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-61f214e5-c24e-4bb9-8ebf-4b5e50436577 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] [instance: c0fdfd73-4324-481f-afe4-7c31f91ec7d4] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 02:03:33.172347 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-61f214e5-c24e-4bb9-8ebf-4b5e50436577 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:03:33.172981 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-61f214e5-c24e-4bb9-8ebf-4b5e50436577 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:03:33.174347 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-61f214e5-c24e-4bb9-8ebf-4b5e50436577 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:03:33.175004 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-61f214e5-c24e-4bb9-8ebf-4b5e50436577 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:03:33.205017 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-61f214e5-c24e-4bb9-8ebf-4b5e50436577 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:03:33.205460 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-61f214e5-c24e-4bb9-8ebf-4b5e50436577 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:03:33.205905 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.objects.instance [None req-61f214e5-c24e-4bb9-8ebf-4b5e50436577 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lazy-loading 'fault' on Instance uuid c0fdfd73-4324-481f-afe4-7c31f91ec7d4 {{(pid=116266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 01 02:03:33.248109 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-61f214e5-c24e-4bb9-8ebf-4b5e50436577 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3a4d85a244d42adf006700e2e312a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc399e683fbf435a8917245373404232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 02:03:33.252672 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-61f214e5-c24e-4bb9-8ebf-4b5e50436577 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] 10.222.0.47 "GET /compute/v2.1/servers/c0fdfd73-4324-481f-afe4-7c31f91ec7d4" status: 200 len: 1307 microversion: 2.1 time: 0.091032 Nov 01 02:03:33.253223 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1645/3386] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 02:03:33 2021] GET /compute/v2.1/servers/c0fdfd73-4324-481f-afe4-7c31f91ec7d4 => generated 1307 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 02:03:34.270351 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-90518b53-4cf2-4eb6-b104-51711477a972 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 02:03:34.271119 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-90518b53-4cf2-4eb6-b104-51711477a972 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] [instance: c0fdfd73-4324-481f-afe4-7c31f91ec7d4] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 02:03:34.277392 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-90518b53-4cf2-4eb6-b104-51711477a972 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:03:34.277828 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-90518b53-4cf2-4eb6-b104-51711477a972 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:03:34.278601 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-90518b53-4cf2-4eb6-b104-51711477a972 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:03:34.279025 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-90518b53-4cf2-4eb6-b104-51711477a972 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:03:34.291892 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.wsgi [None req-90518b53-4cf2-4eb6-b104-51711477a972 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] HTTP exception thrown: Instance c0fdfd73-4324-481f-afe4-7c31f91ec7d4 could not be found. Nov 01 02:03:34.292460 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-90518b53-4cf2-4eb6-b104-51711477a972 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Returning 404 to user: Instance c0fdfd73-4324-481f-afe4-7c31f91ec7d4 could not be found. {{(pid=116267) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 01 02:03:34.293254 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-90518b53-4cf2-4eb6-b104-51711477a972 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] 10.222.0.47 "GET /compute/v2.1/servers/c0fdfd73-4324-481f-afe4-7c31f91ec7d4" status: 404 len: 111 microversion: 2.1 time: 0.027474 Nov 01 02:03:34.293763 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1742/3387] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 02:03:34 2021] GET /compute/v2.1/servers/c0fdfd73-4324-481f-afe4-7c31f91ec7d4 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 02:03:35.595582 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-454abe49-abce-499d-980a-5c1c42055efc tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 02:03:35.596076 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-454abe49-abce-499d-980a-5c1c42055efc tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] [instance: cb36afe7-6664-4cd8-9de4-43f4458a436f] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 02:03:35.602228 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-454abe49-abce-499d-980a-5c1c42055efc tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:03:35.602707 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-454abe49-abce-499d-980a-5c1c42055efc tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:03:35.603468 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-454abe49-abce-499d-980a-5c1c42055efc tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:03:35.603899 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-454abe49-abce-499d-980a-5c1c42055efc tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:03:35.627401 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-454abe49-abce-499d-980a-5c1c42055efc tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] [instance: cb36afe7-6664-4cd8-9de4-43f4458a436f] Going to try to terminate instance {{(pid=116266) delete /opt/stack/nova/nova/compute/api.py:2612}} Nov 01 02:03:35.919872 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-454abe49-abce-499d-980a-5c1c42055efc tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] 10.222.0.47 "DELETE /compute/v2.1/servers/cb36afe7-6664-4cd8-9de4-43f4458a436f" status: 204 len: 0 microversion: 2.1 time: 0.327562 Nov 01 02:03:35.920371 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1646/3388] 10.222.0.47 () {58 vars in 1238 bytes} [Mon Nov 1 02:03:35 2021] DELETE /compute/v2.1/servers/cb36afe7-6664-4cd8-9de4-43f4458a436f => generated 0 bytes in 329 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 01 02:03:35.928746 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-41544bf3-5fb9-4c46-9bdc-c2da07ae5f04 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 02:03:35.929351 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-41544bf3-5fb9-4c46-9bdc-c2da07ae5f04 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] [instance: cb36afe7-6664-4cd8-9de4-43f4458a436f] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 02:03:35.935628 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-41544bf3-5fb9-4c46-9bdc-c2da07ae5f04 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:03:35.936067 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-41544bf3-5fb9-4c46-9bdc-c2da07ae5f04 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:03:35.936813 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-41544bf3-5fb9-4c46-9bdc-c2da07ae5f04 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:03:35.937232 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-41544bf3-5fb9-4c46-9bdc-c2da07ae5f04 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:03:36.056463 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-41544bf3-5fb9-4c46-9bdc-c2da07ae5f04 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3a4d85a244d42adf006700e2e312a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc399e683fbf435a8917245373404232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 02:03:36.063606 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-41544bf3-5fb9-4c46-9bdc-c2da07ae5f04 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] 10.222.0.47 "GET /compute/v2.1/servers/cb36afe7-6664-4cd8-9de4-43f4458a436f" status: 200 len: 1513 microversion: 2.1 time: 0.139167 Nov 01 02:03:36.064164 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1743/3389] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 02:03:35 2021] GET /compute/v2.1/servers/cb36afe7-6664-4cd8-9de4-43f4458a436f => generated 1513 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 02:03:37.080611 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-61e0ca51-a817-442e-a54d-b815d6696f8c tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 02:03:37.081333 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-61e0ca51-a817-442e-a54d-b815d6696f8c tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] [instance: cb36afe7-6664-4cd8-9de4-43f4458a436f] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 02:03:37.088117 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-61e0ca51-a817-442e-a54d-b815d6696f8c tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:03:37.088556 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-61e0ca51-a817-442e-a54d-b815d6696f8c tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:03:37.089309 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-61e0ca51-a817-442e-a54d-b815d6696f8c tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:03:37.089735 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-61e0ca51-a817-442e-a54d-b815d6696f8c tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:03:37.210201 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-61e0ca51-a817-442e-a54d-b815d6696f8c tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3a4d85a244d42adf006700e2e312a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc399e683fbf435a8917245373404232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 02:03:37.217468 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-61e0ca51-a817-442e-a54d-b815d6696f8c tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] 10.222.0.47 "GET /compute/v2.1/servers/cb36afe7-6664-4cd8-9de4-43f4458a436f" status: 200 len: 1513 microversion: 2.1 time: 0.140815 Nov 01 02:03:37.218020 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1647/3390] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 02:03:37 2021] GET /compute/v2.1/servers/cb36afe7-6664-4cd8-9de4-43f4458a436f => generated 1513 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 02:03:38.233582 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-dd2351fe-87ad-4132-993d-32893cbc1e74 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 02:03:38.234094 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-dd2351fe-87ad-4132-993d-32893cbc1e74 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] [instance: cb36afe7-6664-4cd8-9de4-43f4458a436f] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 02:03:38.241165 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-dd2351fe-87ad-4132-993d-32893cbc1e74 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:03:38.241609 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-dd2351fe-87ad-4132-993d-32893cbc1e74 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:03:38.242369 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-dd2351fe-87ad-4132-993d-32893cbc1e74 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:03:38.242820 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-dd2351fe-87ad-4132-993d-32893cbc1e74 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:03:38.373989 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-dd2351fe-87ad-4132-993d-32893cbc1e74 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3a4d85a244d42adf006700e2e312a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc399e683fbf435a8917245373404232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 02:03:38.382294 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-dd2351fe-87ad-4132-993d-32893cbc1e74 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] 10.222.0.47 "GET /compute/v2.1/servers/cb36afe7-6664-4cd8-9de4-43f4458a436f" status: 200 len: 1513 microversion: 2.1 time: 0.152385 Nov 01 02:03:38.383092 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1744/3391] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 02:03:38 2021] GET /compute/v2.1/servers/cb36afe7-6664-4cd8-9de4-43f4458a436f => generated 1513 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 02:03:38.677585 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [req-8bcf9870-5fe7-46a3-b13e-55410205526a req-6184840c-19d4-4230-a714-570e98237a31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb36afe7-6664-4cd8-9de4-43f4458a436f", "name": "network-vif-deleted", "tag": "df0b9dfc-ed37-4e2d-9b57-045311702db1"}]} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 02:03:38.679661 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 01 02:03:38.679661 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: warnings.warn(msg) Nov 01 02:03:38.687167 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [req-8bcf9870-5fe7-46a3-b13e-55410205526a req-6184840c-19d4-4230-a714-570e98237a31 service nova] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:03:38.689440 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [req-8bcf9870-5fe7-46a3-b13e-55410205526a req-6184840c-19d4-4230-a714-570e98237a31 service nova] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:03:38.701233 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.compute.server_external_events [req-8bcf9870-5fe7-46a3-b13e-55410205526a req-6184840c-19d4-4230-a714-570e98237a31 service nova] Creating event network-vif-deleted:df0b9dfc-ed37-4e2d-9b57-045311702db1 for instance cb36afe7-6664-4cd8-9de4-43f4458a436f on hv-cinder-81561 Nov 01 02:03:38.706296 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [req-8bcf9870-5fe7-46a3-b13e-55410205526a req-6184840c-19d4-4230-a714-570e98237a31 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032423 Nov 01 02:03:38.706924 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1648/3392] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Nov 1 02:03:38 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 02:03:39.400250 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-7a428f5d-cc6a-4070-bcd8-5e572fca5c65 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 02:03:39.400854 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-7a428f5d-cc6a-4070-bcd8-5e572fca5c65 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] [instance: cb36afe7-6664-4cd8-9de4-43f4458a436f] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 02:03:39.407216 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-7a428f5d-cc6a-4070-bcd8-5e572fca5c65 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:03:39.407665 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-7a428f5d-cc6a-4070-bcd8-5e572fca5c65 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:03:39.408433 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-7a428f5d-cc6a-4070-bcd8-5e572fca5c65 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:03:39.408868 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-7a428f5d-cc6a-4070-bcd8-5e572fca5c65 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:03:39.438772 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-7a428f5d-cc6a-4070-bcd8-5e572fca5c65 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:03:39.439224 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-7a428f5d-cc6a-4070-bcd8-5e572fca5c65 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:03:39.439672 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.objects.instance [None req-7a428f5d-cc6a-4070-bcd8-5e572fca5c65 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lazy-loading 'fault' on Instance uuid cb36afe7-6664-4cd8-9de4-43f4458a436f {{(pid=116267) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 01 02:03:39.485060 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-7a428f5d-cc6a-4070-bcd8-5e572fca5c65 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3a4d85a244d42adf006700e2e312a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc399e683fbf435a8917245373404232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 02:03:39.492806 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-7a428f5d-cc6a-4070-bcd8-5e572fca5c65 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] 10.222.0.47 "GET /compute/v2.1/servers/cb36afe7-6664-4cd8-9de4-43f4458a436f" status: 200 len: 1307 microversion: 2.1 time: 0.096991 Nov 01 02:03:39.493372 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1745/3393] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 02:03:39 2021] GET /compute/v2.1/servers/cb36afe7-6664-4cd8-9de4-43f4458a436f => generated 1307 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 02:03:40.510043 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-f710d1c5-b8c9-4ad0-871e-b846f0a322a8 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 02:03:40.510756 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-f710d1c5-b8c9-4ad0-871e-b846f0a322a8 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] [instance: cb36afe7-6664-4cd8-9de4-43f4458a436f] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 02:03:40.516760 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f710d1c5-b8c9-4ad0-871e-b846f0a322a8 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:03:40.517204 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f710d1c5-b8c9-4ad0-871e-b846f0a322a8 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:03:40.517953 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f710d1c5-b8c9-4ad0-871e-b846f0a322a8 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:03:40.518380 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-f710d1c5-b8c9-4ad0-871e-b846f0a322a8 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:03:40.531369 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.wsgi [None req-f710d1c5-b8c9-4ad0-871e-b846f0a322a8 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] HTTP exception thrown: Instance cb36afe7-6664-4cd8-9de4-43f4458a436f could not be found. Nov 01 02:03:40.531941 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-f710d1c5-b8c9-4ad0-871e-b846f0a322a8 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Returning 404 to user: Instance cb36afe7-6664-4cd8-9de4-43f4458a436f could not be found. {{(pid=116266) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 01 02:03:40.532730 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-f710d1c5-b8c9-4ad0-871e-b846f0a322a8 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] 10.222.0.47 "GET /compute/v2.1/servers/cb36afe7-6664-4cd8-9de4-43f4458a436f" status: 404 len: 111 microversion: 2.1 time: 0.027159 Nov 01 02:03:40.533232 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1649/3394] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 02:03:40 2021] GET /compute/v2.1/servers/cb36afe7-6664-4cd8-9de4-43f4458a436f => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 02:03:40.540848 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-496c1c05-2273-4bb4-bd5f-99fbb2da9445 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 02:03:40.541324 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-496c1c05-2273-4bb4-bd5f-99fbb2da9445 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] [instance: e2a04587-1f86-4f76-9a97-08098a35e56e] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 02:03:40.548292 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-496c1c05-2273-4bb4-bd5f-99fbb2da9445 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:03:40.548728 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-496c1c05-2273-4bb4-bd5f-99fbb2da9445 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:03:40.549475 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-496c1c05-2273-4bb4-bd5f-99fbb2da9445 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:03:40.549895 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-496c1c05-2273-4bb4-bd5f-99fbb2da9445 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:03:40.574254 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-496c1c05-2273-4bb4-bd5f-99fbb2da9445 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] [instance: e2a04587-1f86-4f76-9a97-08098a35e56e] Going to try to terminate instance {{(pid=116267) delete /opt/stack/nova/nova/compute/api.py:2612}} Nov 01 02:03:40.891142 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-496c1c05-2273-4bb4-bd5f-99fbb2da9445 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] 10.222.0.47 "DELETE /compute/v2.1/servers/e2a04587-1f86-4f76-9a97-08098a35e56e" status: 204 len: 0 microversion: 2.1 time: 0.353612 Nov 01 02:03:40.891815 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1746/3395] 10.222.0.47 () {58 vars in 1238 bytes} [Mon Nov 1 02:03:40 2021] DELETE /compute/v2.1/servers/e2a04587-1f86-4f76-9a97-08098a35e56e => generated 0 bytes in 355 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 01 02:03:40.899740 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-b2bceb55-8128-4944-bbf5-ebca43041fb3 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 02:03:40.900344 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-b2bceb55-8128-4944-bbf5-ebca43041fb3 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] [instance: e2a04587-1f86-4f76-9a97-08098a35e56e] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 02:03:40.906145 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b2bceb55-8128-4944-bbf5-ebca43041fb3 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:03:40.906632 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b2bceb55-8128-4944-bbf5-ebca43041fb3 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:03:40.907391 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b2bceb55-8128-4944-bbf5-ebca43041fb3 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:03:40.907817 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-b2bceb55-8128-4944-bbf5-ebca43041fb3 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:03:41.026322 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-b2bceb55-8128-4944-bbf5-ebca43041fb3 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3a4d85a244d42adf006700e2e312a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc399e683fbf435a8917245373404232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 02:03:41.033551 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-b2bceb55-8128-4944-bbf5-ebca43041fb3 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] 10.222.0.47 "GET /compute/v2.1/servers/e2a04587-1f86-4f76-9a97-08098a35e56e" status: 200 len: 1514 microversion: 2.1 time: 0.137656 Nov 01 02:03:41.034114 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1650/3396] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 02:03:40 2021] GET /compute/v2.1/servers/e2a04587-1f86-4f76-9a97-08098a35e56e => generated 1514 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 02:03:42.051263 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-81a4fc73-f691-4a20-a6a8-1579409151b8 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 02:03:42.051945 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-81a4fc73-f691-4a20-a6a8-1579409151b8 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] [instance: e2a04587-1f86-4f76-9a97-08098a35e56e] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 02:03:42.058727 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-81a4fc73-f691-4a20-a6a8-1579409151b8 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:03:42.059167 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-81a4fc73-f691-4a20-a6a8-1579409151b8 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:03:42.059917 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-81a4fc73-f691-4a20-a6a8-1579409151b8 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:03:42.060340 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-81a4fc73-f691-4a20-a6a8-1579409151b8 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:03:42.183383 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-81a4fc73-f691-4a20-a6a8-1579409151b8 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3a4d85a244d42adf006700e2e312a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc399e683fbf435a8917245373404232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 02:03:42.190654 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-81a4fc73-f691-4a20-a6a8-1579409151b8 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] 10.222.0.47 "GET /compute/v2.1/servers/e2a04587-1f86-4f76-9a97-08098a35e56e" status: 200 len: 1514 microversion: 2.1 time: 0.143370 Nov 01 02:03:42.191213 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1747/3397] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 02:03:42 2021] GET /compute/v2.1/servers/e2a04587-1f86-4f76-9a97-08098a35e56e => generated 1514 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 02:03:43.103475 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [req-a033a5ad-304f-4052-88ff-366569c39007 req-ab6bf58d-68c4-4ae2-a244-6c1b1b4fd94e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2a04587-1f86-4f76-9a97-08098a35e56e", "name": "network-vif-deleted", "tag": "8641bfc5-5c3c-4884-b29a-40c7f1fdeab6"}]} {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 02:03:43.104968 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 01 02:03:43.104968 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: warnings.warn(msg) Nov 01 02:03:43.112014 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [req-a033a5ad-304f-4052-88ff-366569c39007 req-ab6bf58d-68c4-4ae2-a244-6c1b1b4fd94e service nova] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:03:43.115236 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [req-a033a5ad-304f-4052-88ff-366569c39007 req-ab6bf58d-68c4-4ae2-a244-6c1b1b4fd94e service nova] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:03:43.123175 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.compute.server_external_events [req-a033a5ad-304f-4052-88ff-366569c39007 req-ab6bf58d-68c4-4ae2-a244-6c1b1b4fd94e service nova] Creating event network-vif-deleted:8641bfc5-5c3c-4884-b29a-40c7f1fdeab6 for instance e2a04587-1f86-4f76-9a97-08098a35e56e on hv-cinder-81561 Nov 01 02:03:43.128646 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [req-a033a5ad-304f-4052-88ff-366569c39007 req-ab6bf58d-68c4-4ae2-a244-6c1b1b4fd94e service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028758 Nov 01 02:03:43.129390 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1651/3398] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Nov 1 02:03:43 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 02:03:43.207401 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-1e2cc926-a479-4250-8c8c-e4ed2c8c7d2d tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 02:03:43.212619 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-1e2cc926-a479-4250-8c8c-e4ed2c8c7d2d tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] [instance: e2a04587-1f86-4f76-9a97-08098a35e56e] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 02:03:43.214973 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-1e2cc926-a479-4250-8c8c-e4ed2c8c7d2d tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:03:43.215419 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-1e2cc926-a479-4250-8c8c-e4ed2c8c7d2d tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:03:43.216226 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-1e2cc926-a479-4250-8c8c-e4ed2c8c7d2d tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:03:43.216649 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-1e2cc926-a479-4250-8c8c-e4ed2c8c7d2d tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:03:43.276366 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-1e2cc926-a479-4250-8c8c-e4ed2c8c7d2d tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3a4d85a244d42adf006700e2e312a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc399e683fbf435a8917245373404232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 02:03:43.283808 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-1e2cc926-a479-4250-8c8c-e4ed2c8c7d2d tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] 10.222.0.47 "GET /compute/v2.1/servers/e2a04587-1f86-4f76-9a97-08098a35e56e" status: 200 len: 1472 microversion: 2.1 time: 0.080174 Nov 01 02:03:43.284372 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1748/3399] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 02:03:43 2021] GET /compute/v2.1/servers/e2a04587-1f86-4f76-9a97-08098a35e56e => generated 1472 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 02:03:44.301822 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-95cdeba9-696f-4091-b6f5-4f34241948d1 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 02:03:44.302533 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-95cdeba9-696f-4091-b6f5-4f34241948d1 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] [instance: e2a04587-1f86-4f76-9a97-08098a35e56e] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 02:03:44.309063 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-95cdeba9-696f-4091-b6f5-4f34241948d1 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:03:44.309508 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-95cdeba9-696f-4091-b6f5-4f34241948d1 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:03:44.310325 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-95cdeba9-696f-4091-b6f5-4f34241948d1 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:03:44.310786 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-95cdeba9-696f-4091-b6f5-4f34241948d1 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:03:44.324181 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.wsgi [None req-95cdeba9-696f-4091-b6f5-4f34241948d1 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] HTTP exception thrown: Instance e2a04587-1f86-4f76-9a97-08098a35e56e could not be found. Nov 01 02:03:44.324757 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-95cdeba9-696f-4091-b6f5-4f34241948d1 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Returning 404 to user: Instance e2a04587-1f86-4f76-9a97-08098a35e56e could not be found. {{(pid=116266) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 01 02:03:44.325559 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-95cdeba9-696f-4091-b6f5-4f34241948d1 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] 10.222.0.47 "GET /compute/v2.1/servers/e2a04587-1f86-4f76-9a97-08098a35e56e" status: 404 len: 111 microversion: 2.1 time: 0.028310 Nov 01 02:03:44.326073 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1652/3400] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 02:03:44 2021] GET /compute/v2.1/servers/e2a04587-1f86-4f76-9a97-08098a35e56e => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 02:03:45.576980 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-dd849a31-8fed-4c41-b37e-f2943d5b0e1d tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 02:03:45.577471 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-dd849a31-8fed-4c41-b37e-f2943d5b0e1d tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] [instance: 01cdb4c3-37bc-411a-9fc4-2a1f70e02c61] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 02:03:45.583704 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-dd849a31-8fed-4c41-b37e-f2943d5b0e1d tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:03:45.584148 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-dd849a31-8fed-4c41-b37e-f2943d5b0e1d tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:03:45.585404 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-dd849a31-8fed-4c41-b37e-f2943d5b0e1d tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:03:45.585832 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-dd849a31-8fed-4c41-b37e-f2943d5b0e1d tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:03:45.610208 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-dd849a31-8fed-4c41-b37e-f2943d5b0e1d tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] [instance: 01cdb4c3-37bc-411a-9fc4-2a1f70e02c61] Going to try to terminate instance {{(pid=116267) delete /opt/stack/nova/nova/compute/api.py:2612}} Nov 01 02:03:45.886951 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-dd849a31-8fed-4c41-b37e-f2943d5b0e1d tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] 10.222.0.47 "DELETE /compute/v2.1/servers/01cdb4c3-37bc-411a-9fc4-2a1f70e02c61" status: 204 len: 0 microversion: 2.1 time: 0.313180 Nov 01 02:03:45.887565 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1749/3401] 10.222.0.47 () {58 vars in 1238 bytes} [Mon Nov 1 02:03:45 2021] DELETE /compute/v2.1/servers/01cdb4c3-37bc-411a-9fc4-2a1f70e02c61 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 01 02:03:45.895177 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-603ef26e-e154-4d97-a1e2-11fe4230b248 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 02:03:45.895834 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-603ef26e-e154-4d97-a1e2-11fe4230b248 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] [instance: 01cdb4c3-37bc-411a-9fc4-2a1f70e02c61] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 02:03:45.902813 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-603ef26e-e154-4d97-a1e2-11fe4230b248 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:03:45.903259 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-603ef26e-e154-4d97-a1e2-11fe4230b248 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:03:45.904018 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-603ef26e-e154-4d97-a1e2-11fe4230b248 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:03:45.904449 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-603ef26e-e154-4d97-a1e2-11fe4230b248 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:03:46.021814 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-603ef26e-e154-4d97-a1e2-11fe4230b248 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3a4d85a244d42adf006700e2e312a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc399e683fbf435a8917245373404232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 02:03:46.029600 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-603ef26e-e154-4d97-a1e2-11fe4230b248 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] 10.222.0.47 "GET /compute/v2.1/servers/01cdb4c3-37bc-411a-9fc4-2a1f70e02c61" status: 200 len: 1514 microversion: 2.1 time: 0.138011 Nov 01 02:03:46.030156 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1653/3402] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 02:03:45 2021] GET /compute/v2.1/servers/01cdb4c3-37bc-411a-9fc4-2a1f70e02c61 => generated 1514 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 02:03:47.047190 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-d12a4e78-8cfc-4e16-81eb-168df84e49b5 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 02:03:47.047900 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-d12a4e78-8cfc-4e16-81eb-168df84e49b5 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] [instance: 01cdb4c3-37bc-411a-9fc4-2a1f70e02c61] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 02:03:47.054411 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d12a4e78-8cfc-4e16-81eb-168df84e49b5 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:03:47.054886 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d12a4e78-8cfc-4e16-81eb-168df84e49b5 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:03:47.055658 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d12a4e78-8cfc-4e16-81eb-168df84e49b5 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:03:47.056203 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-d12a4e78-8cfc-4e16-81eb-168df84e49b5 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:03:47.178785 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.policy [None req-d12a4e78-8cfc-4e16-81eb-168df84e49b5 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3a4d85a244d42adf006700e2e312a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc399e683fbf435a8917245373404232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116267) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 02:03:47.185978 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-d12a4e78-8cfc-4e16-81eb-168df84e49b5 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] 10.222.0.47 "GET /compute/v2.1/servers/01cdb4c3-37bc-411a-9fc4-2a1f70e02c61" status: 200 len: 1514 microversion: 2.1 time: 0.142785 Nov 01 02:03:47.186763 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1750/3403] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 02:03:47 2021] GET /compute/v2.1/servers/01cdb4c3-37bc-411a-9fc4-2a1f70e02c61 => generated 1514 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 02:03:48.202549 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-503c0ce1-765c-485d-b352-87dfed5d5e91 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 02:03:48.203155 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-503c0ce1-765c-485d-b352-87dfed5d5e91 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] [instance: 01cdb4c3-37bc-411a-9fc4-2a1f70e02c61] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 02:03:48.209348 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-503c0ce1-765c-485d-b352-87dfed5d5e91 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:03:48.222961 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-503c0ce1-765c-485d-b352-87dfed5d5e91 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:03:48.222961 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-503c0ce1-765c-485d-b352-87dfed5d5e91 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:03:48.222961 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-503c0ce1-765c-485d-b352-87dfed5d5e91 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:03:48.330822 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-503c0ce1-765c-485d-b352-87dfed5d5e91 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3a4d85a244d42adf006700e2e312a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc399e683fbf435a8917245373404232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 02:03:48.338758 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-503c0ce1-765c-485d-b352-87dfed5d5e91 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] 10.222.0.47 "GET /compute/v2.1/servers/01cdb4c3-37bc-411a-9fc4-2a1f70e02c61" status: 200 len: 1514 microversion: 2.1 time: 0.139870 Nov 01 02:03:48.339314 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1654/3404] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 02:03:48 2021] GET /compute/v2.1/servers/01cdb4c3-37bc-411a-9fc4-2a1f70e02c61 => generated 1514 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 02:03:48.458358 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [req-2c9bc930-6584-42a6-af6e-b048c5f38d6c req-fd5758ff-1a5d-4c60-aabc-36ad2f0ceb5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01cdb4c3-37bc-411a-9fc4-2a1f70e02c61", "name": "network-vif-deleted", "tag": "7df858e9-d560-4b9c-a8ca-e1371fcf4ac5"}]} {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 01 02:03:48.460573 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 01 02:03:48.460573 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: warnings.warn(msg) Nov 01 02:03:48.467767 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [req-2c9bc930-6584-42a6-af6e-b048c5f38d6c req-fd5758ff-1a5d-4c60-aabc-36ad2f0ceb5e service nova] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:03:48.468211 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [req-2c9bc930-6584-42a6-af6e-b048c5f38d6c req-fd5758ff-1a5d-4c60-aabc-36ad2f0ceb5e service nova] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:03:48.478807 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.compute.server_external_events [req-2c9bc930-6584-42a6-af6e-b048c5f38d6c req-fd5758ff-1a5d-4c60-aabc-36ad2f0ceb5e service nova] Creating event network-vif-deleted:7df858e9-d560-4b9c-a8ca-e1371fcf4ac5 for instance 01cdb4c3-37bc-411a-9fc4-2a1f70e02c61 on hv-cinder-81561 Nov 01 02:03:48.483440 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [req-2c9bc930-6584-42a6-af6e-b048c5f38d6c req-fd5758ff-1a5d-4c60-aabc-36ad2f0ceb5e service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028676 Nov 01 02:03:48.484080 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1751/3405] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Nov 1 02:03:48 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 01 02:03:49.355319 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.api.openstack.wsgi [None req-25206cb0-5b23-46ab-a73a-37b81b0728b2 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Calling method '>' {{(pid=116266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 02:03:49.355951 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.compute.api [None req-25206cb0-5b23-46ab-a73a-37b81b0728b2 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] [instance: 01cdb4c3-37bc-411a-9fc4-2a1f70e02c61] Fetching instance by UUID {{(pid=116266) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 02:03:49.362874 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-25206cb0-5b23-46ab-a73a-37b81b0728b2 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:03:49.363236 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-25206cb0-5b23-46ab-a73a-37b81b0728b2 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:03:49.363973 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-25206cb0-5b23-46ab-a73a-37b81b0728b2 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:03:49.364395 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-25206cb0-5b23-46ab-a73a-37b81b0728b2 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:03:49.400170 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-25206cb0-5b23-46ab-a73a-37b81b0728b2 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:03:49.400611 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG oslo_concurrency.lockutils [None req-25206cb0-5b23-46ab-a73a-37b81b0728b2 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:03:49.401085 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.objects.instance [None req-25206cb0-5b23-46ab-a73a-37b81b0728b2 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lazy-loading 'fault' on Instance uuid 01cdb4c3-37bc-411a-9fc4-2a1f70e02c61 {{(pid=116266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 01 02:03:49.445006 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: DEBUG nova.policy [None req-25206cb0-5b23-46ab-a73a-37b81b0728b2 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b3a4d85a244d42adf006700e2e312a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc399e683fbf435a8917245373404232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116266) authorize /opt/stack/nova/nova/policy.py:199}} Nov 01 02:03:49.452775 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO nova.api.openstack.requestlog [None req-25206cb0-5b23-46ab-a73a-37b81b0728b2 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] 10.222.0.47 "GET /compute/v2.1/servers/01cdb4c3-37bc-411a-9fc4-2a1f70e02c61" status: 200 len: 1308 microversion: 2.1 time: 0.101192 Nov 01 02:03:49.453343 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: [pid: 116266|app: 0|req: 1655/3406] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 02:03:49 2021] GET /compute/v2.1/servers/01cdb4c3-37bc-411a-9fc4-2a1f70e02c61 => generated 1308 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 01 02:03:50.470549 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-f7001ead-7e87-4672-bf55-97766f0f5b01 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Calling method '>' {{(pid=116267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 01 02:03:50.471246 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.compute.api [None req-f7001ead-7e87-4672-bf55-97766f0f5b01 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] [instance: 01cdb4c3-37bc-411a-9fc4-2a1f70e02c61] Fetching instance by UUID {{(pid=116267) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 01 02:03:50.477296 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f7001ead-7e87-4672-bf55-97766f0f5b01 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:03:50.477738 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f7001ead-7e87-4672-bf55-97766f0f5b01 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:03:50.478518 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f7001ead-7e87-4672-bf55-97766f0f5b01 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 01 02:03:50.478950 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG oslo_concurrency.lockutils [None req-f7001ead-7e87-4672-bf55-97766f0f5b01 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Lock "4c03a77a-7438-491d-92a6-ffcc24307f49" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 01 02:03:50.491635 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.wsgi [None req-f7001ead-7e87-4672-bf55-97766f0f5b01 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] HTTP exception thrown: Instance 01cdb4c3-37bc-411a-9fc4-2a1f70e02c61 could not be found. Nov 01 02:03:50.492210 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: DEBUG nova.api.openstack.wsgi [None req-f7001ead-7e87-4672-bf55-97766f0f5b01 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] Returning 404 to user: Instance 01cdb4c3-37bc-411a-9fc4-2a1f70e02c61 could not be found. {{(pid=116267) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 01 02:03:50.493002 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO nova.api.openstack.requestlog [None req-f7001ead-7e87-4672-bf55-97766f0f5b01 tempest-AttachVolumeNegativeTest-1525037691 tempest-AttachVolumeNegativeTest-1525037691-project] 10.222.0.47 "GET /compute/v2.1/servers/01cdb4c3-37bc-411a-9fc4-2a1f70e02c61" status: 404 len: 111 microversion: 2.1 time: 0.027052 Nov 01 02:03:50.493519 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: [pid: 116267|app: 0|req: 1752/3407] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Nov 1 02:03:50 2021] GET /compute/v2.1/servers/01cdb4c3-37bc-411a-9fc4-2a1f70e02c61 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 01 02:03:54.395873 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 01 02:03:54.396423 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: Mon Nov 1 02:03:54 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 01 02:04:38.330563 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 01 02:04:38.331159 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: Mon Nov 1 02:04:38 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 01 02:05:32.744757 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 01 02:05:32.745303 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: Mon Nov 1 02:05:32 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 01 02:05:40.149302 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 01 02:05:40.149934 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: Mon Nov 1 02:05:40 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 01 02:06:25.256469 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 01 02:06:25.257148 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: Mon Nov 1 02:06:25 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 01 02:07:14.414876 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 01 02:07:14.415320 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: Mon Nov 1 02:07:14 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 01 02:07:58.348036 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 01 02:07:58.348640 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: Mon Nov 1 02:07:58 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 01 02:08:52.762038 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 01 02:08:52.762621 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: Mon Nov 1 02:08:52 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 01 02:09:00.166723 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 01 02:09:00.167226 dv-cinder-815614-2-iscsi devstack@n-api.service[116266]: Mon Nov 1 02:09:00 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 01 02:09:11.481087 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 01 02:09:11.481514 dv-cinder-815614-2-iscsi devstack@n-api.service[116267]: Mon Nov 1 02:09:11 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!